caikit.runtime.service_generation ================================= .. py:module:: caikit.runtime.service_generation Submodules ---------- .. toctree:: :maxdepth: 1 /autoapi/caikit/runtime/service_generation/compatibility_checker/index /autoapi/caikit/runtime/service_generation/create_service/index /autoapi/caikit/runtime/service_generation/data_stream_source/index /autoapi/caikit/runtime/service_generation/protoable/index /autoapi/caikit/runtime/service_generation/rpcs/index /autoapi/caikit/runtime/service_generation/type_helpers/index Functions --------- .. autoapisummary:: caikit.runtime.service_generation.assert_compatible caikit.runtime.service_generation.create_inference_rpcs caikit.runtime.service_generation.create_job_inference_rpcs caikit.runtime.service_generation.create_training_rpcs Package Contents ---------------- .. py:function:: assert_compatible(modules: List[str], previous_modules: List[str]) Logic about whether it's okay to include this set of modules in service generation Args: modules: list of module IDs that we are considering in service generation previous_modules: list of module IDs that were supported in the previous service version Raises: If a new service should not be built with this set of modules .. py:function:: create_inference_rpcs(modules: List[Type[caikit.core.ModuleBase]], caikit_config: aconfig.aconfig.Config = None) -> List[caikit.runtime.service_generation.rpcs.CaikitRPCBase] Handles the logic to create all the RPCs for inference .. py:function:: create_job_inference_rpcs(modules: List[Type[caikit.core.ModuleBase]], caikit_config: aconfig.aconfig.Config = None) -> List[caikit.runtime.service_generation.rpcs.CaikitRPCBase] Handles the logic to create all the RPCs for inference jobs .. py:function:: create_training_rpcs(modules: List[Type[caikit.core.ModuleBase]]) -> List[caikit.runtime.service_generation.rpcs.CaikitRPCBase] Handles the logic to create all the RPCs for training