caikit.runtime.protobufs.model_mesh_pb2_grpc

Client and server classes corresponding to protobufs-defined services.

Classes

ModelMeshStub	this is a grpc version of the external model-mesh interface
ModelMeshServicer	this is a grpc version of the external model-mesh interface
ModelMesh	this is a grpc version of the external model-mesh interface

Functions

add_ModelMeshServicer_to_server(servicer, server)

Module Contents

class caikit.runtime.protobufs.model_mesh_pb2_grpc.ModelMeshStub(channel)

Bases: object

this is a grpc version of the external model-mesh interface for managing and serving models

registerModel

unregisterModel

getModelStatus

ensureLoaded

setVModel

deleteVModel

getVModelStatus

class caikit.runtime.protobufs.model_mesh_pb2_grpc.ModelMeshServicer

Bases: object

this is a grpc version of the external model-mesh interface for managing and serving models

registerModel(request, context)

model lifecycle rpcs

Registers a trained model to this model-mesh cluster

unregisterModel(request, context)

Unregisters (deletes) a model from this model-mesh cluster, has no effect if the specified model isn’t found

getModelStatus(request, context)

Returns the status of the specified model. See the ModelStatus enum

ensureLoaded(request, context)

Ensures the model with the specified id is loaded in this model-mesh cluster

setVModel(request, context)

vmodel lifecycle rpcs

Creates a new vmodel id (alias) which maps to a new or existing concrete model, or sets the target model for an existing vmodel to a new or existing concrete model

deleteVModel(request, context)

Deletes a vmodel, optionally deleting any referenced concrete models at the same time

getVModelStatus(request, context)

Gets the status of a vmodel, including associated target/active model ids If the vmodel is not found, the returned VModelStatusInfo will have empty active and target model ids and an active model status of NOT_FOUND

caikit.runtime.protobufs.model_mesh_pb2_grpc.add_ModelMeshServicer_to_server(servicer, server)

class caikit.runtime.protobufs.model_mesh_pb2_grpc.ModelMesh

Bases: object

this is a grpc version of the external model-mesh interface for managing and serving models

static registerModel(request, target, options=(), channel_credentials=None, call_credentials=None, insecure=False, compression=None, wait_for_ready=None, timeout=None, metadata=None)

static unregisterModel(request, target, options=(), channel_credentials=None, call_credentials=None, insecure=False, compression=None, wait_for_ready=None, timeout=None, metadata=None)

static getModelStatus(request, target, options=(), channel_credentials=None, call_credentials=None, insecure=False, compression=None, wait_for_ready=None, timeout=None, metadata=None)

static ensureLoaded(request, target, options=(), channel_credentials=None, call_credentials=None, insecure=False, compression=None, wait_for_ready=None, timeout=None, metadata=None)

static setVModel(request, target, options=(), channel_credentials=None, call_credentials=None, insecure=False, compression=None, wait_for_ready=None, timeout=None, metadata=None)

static deleteVModel(request, target, options=(), channel_credentials=None, call_credentials=None, insecure=False, compression=None, wait_for_ready=None, timeout=None, metadata=None)

static getVModelStatus(request, target, options=(), channel_credentials=None, call_credentials=None, insecure=False, compression=None, wait_for_ready=None, timeout=None, metadata=None)