caikit.runtime.servicers.info_servicer
This module contains the implementation for retrieving information about the library and services.
Attributes
Classes
This class contains the implementation for retrieving information about the |
Module Contents
- class caikit.runtime.servicers.info_servicer.InfoServicer[source]
This class contains the implementation for retrieving information about the library and services.
- GetModelsInfo(request: caikit.interfaces.runtime.data_model.ModelInfoRequest, context) caikit.interfaces.runtime.data_model.ModelInfoResponse[source]
Get information on the loaded models for the GRPC server
- Args:
request: ModelInfoRequest context
- Returns:
- models_info: ModelInfoResponse
DataObject containing the model info
- get_models_info_dict(model_ids: List[str] | None) Dict[str, List[Dict[str, Any]]][source]
Get information on models for the HTTP server
- Returns:
- model_info_dict: Dict[str, List[Dict[str, str]]]
Dict representation of ModelInfoResponse
- _get_models_info(model_ids: List[str] | None = None) caikit.interfaces.runtime.data_model.ModelInfoResponse[source]
Helper function to get the list of models
- Returns:
- model_info: ModelInfoResponse
DataObject with model information
- GetRuntimeInfo(request, context) caikit.interfaces.runtime.data_model.RuntimeInfoResponse[source]
Get information on versions of libraries and server for GRPC
- get_version_dict() Dict[str, str | Dict][source]
Get information on versions of libraries and server for HTTP
- _get_runtime_info() caikit.interfaces.runtime.data_model.RuntimeInfoResponse[source]
Get information on versions of libraries and server from config