caikit.runtime.servicers.model_management_servicer

The Model Management Service is responsible for deploying and undeploying models

Attributes

`log`
`DeployModelRequestProto`
`ModelInfoProto`
`UndeployModelRequestProto`

Classes

ModelManagementServicerImpl

Module Contents

caikit.runtime.servicers.model_management_servicer.log[source]

caikit.runtime.servicers.model_management_servicer.DeployModelRequestProto

caikit.runtime.servicers.model_management_servicer.ModelInfoProto

caikit.runtime.servicers.model_management_servicer.UndeployModelRequestProto

class caikit.runtime.servicers.model_management_servicer.ModelManagementServicerImpl[source]

__doc__ = Multiline-String

Show Value

"""
The Model Management Service is responsible for deploying and undeploying models
"""

_model_manager = None

DeployModel(request: DeployModelRequestProto, context: grpc.RpcContext) → ModelInfoProto[source]: Deploy a model to the runtime

UndeployModel(request: UndeployModelRequestProto, context: grpc.RpcContext) → UndeployModelRequestProto[source]: Un-deploy a model to the runtime

deploy_model(model_id: str, model_files: Dict[str, bytes]) → caikit.interfaces.runtime.data_model.ModelInfo[source]: Deploy a model to the runtime

undeploy_model(model_id: str) → caikit.interfaces.runtime.data_model.UndeployModelRequest[source]: Un-deploy a model to the runtime