caikit.runtime.servicers.prediction_job_management_servicer

Attributes

log

Classes

PredictionJobManagementServicerImpl

This class contains the implementation of all of the RPCs that are required to manage

Module Contents

caikit.runtime.servicers.prediction_job_management_servicer.log[source]

class caikit.runtime.servicers.prediction_job_management_servicer.PredictionJobManagementServicerImpl[source]

This class contains the implementation of all of the RPCs that are required to manage a prediction job. This includes fetching status, cancelling jobs, and getting the results.

GetPredictionJobResult(request: caikit.interfaces.runtime.data_model.PredictionJobInfoRequest, context, *_, **__) → google.protobuf.message.Message | Iterable[google.protobuf.message.Message][source]: Get the result of a prediction job by ID

GetPredictionJobStatus(request: caikit.interfaces.runtime.data_model.PredictionJobInfoRequest, context, *_, **__)[source]: Get the status of a prediction job ID

CancelPredictionJob(request: caikit.interfaces.runtime.data_model.PredictionJobInfoRequest, context, *_, **__)[source]: Cancel a prediction job.

get_prediction_result(prediction_id: str) → caikit.core.DataObjectBase[source]: Get the result of a job by ID

get_prediction_status(prediction_id: str) → caikit.interfaces.runtime.data_model.PredictionJobStatusResponse[source]: Get the status of a job by ID

cancel_prediction(prediction_id: str) → caikit.interfaces.runtime.data_model.PredictionJobStatusResponse[source]: Cancel a prediction job.

static _get_prediction_future(prediction_id: str, operation: str)[source]: Returns a model future, or raises 404 caikit runtime exception on error. Wrapped here so that we only catch errors directly in the predictor.get_prediction_future call