caikit.runtime.service_generation

Submodules

• caikit.runtime.service_generation.compatibility_checker
• caikit.runtime.service_generation.create_service
• caikit.runtime.service_generation.data_stream_source
• caikit.runtime.service_generation.protoable
• caikit.runtime.service_generation.rpcs
• caikit.runtime.service_generation.type_helpers

Functions

assert_compatible(modules, previous_modules)	Logic about whether it's okay to include this set of modules in service generation
create_inference_rpcs(...)	Handles the logic to create all the RPCs for inference
create_job_inference_rpcs(...)	Handles the logic to create all the RPCs for inference jobs
create_training_rpcs(...)	Handles the logic to create all the RPCs for training

Package Contents

caikit.runtime.service_generation.assert_compatible(modules: List[str], previous_modules: List[str])

Logic about whether it’s okay to include this set of modules in service generation

Args:

modules: list of module IDs that we are considering in service generation previous_modules: list of module IDs that were supported in the previous service version

Raises:

If a new service should not be built with this set of modules

caikit.runtime.service_generation.create_inference_rpcs(modules: List[Type[caikit.core.ModuleBase]], caikit_config: aconfig.aconfig.Config = None) → List[caikit.runtime.service_generation.rpcs.CaikitRPCBase]

Handles the logic to create all the RPCs for inference

caikit.runtime.service_generation.create_job_inference_rpcs(modules: List[Type[caikit.core.ModuleBase]], caikit_config: aconfig.aconfig.Config = None) → List[caikit.runtime.service_generation.rpcs.CaikitRPCBase]

Handles the logic to create all the RPCs for inference jobs

caikit.runtime.service_generation.create_training_rpcs(modules: List[Type[caikit.core.ModuleBase]]) → List[caikit.runtime.service_generation.rpcs.CaikitRPCBase]

Handles the logic to create all the RPCs for training