caikit.runtime.model_management.core_model_loader

Attributes

log

CAIKIT_CORE_LOAD_DURATION_SUMMARY

Classes

CoreModelLoader

The CoreModelLoader loads a model using the caikit core.ModelManager

Module Contents

caikit.runtime.model_management.core_model_loader.log[source]
caikit.runtime.model_management.core_model_loader.CAIKIT_CORE_LOAD_DURATION_SUMMARY
class caikit.runtime.model_management.core_model_loader.CoreModelLoader(config: aconfig.Config, instance_name: str)[source]

Bases: caikit.runtime.model_management.model_loader_base.ModelLoaderBase

The CoreModelLoader loads a model using the caikit core.ModelManager

name = 'CORE'

This is the name of this constructible type that will be used by the factory to identify this class

load_module_instance(model_path: str, model_id: str, model_type: str, finder: str | caikit.core.model_management.ModelFinderBase | None = None, initializer: str | caikit.core.model_management.ModelInitializerBase | None = None) → caikit.core.ModuleBase[source]

Start loading a model from disk and associate the ID/size with it