Share via

OnnxGenAITextCompletion Class

  • Reference

OnnxGenAI text completion service.

Note: This class is marked as 'experimental' and may change in the future.

Initializes a new instance of the OnnxGenAITextCompletion class.

Constructor

OnnxGenAITextCompletion(ai_model_path: str | None = None, ai_model_id: str | None = None, env_file_path: str | None = None, env_file_encoding: str | None = None)

Parameters

Name Description
ai_model_path

Local path to the ONNX model Folder.

Default value: None
ai_model_id

The ID of the AI model. Defaults to None.

Default value: None
env_file_path

Use the environment settings file as a fallback to environment variables.

Default value: None
env_file_encoding

The encoding of the environment settings file.

Default value: None

Methods

get_prompt_execution_settings_class

Create a request settings object.

get_prompt_execution_settings_class

Create a request settings object.

get_prompt_execution_settings_class() -> type[PromptExecutionSettings]

Attributes

ai_model_id 

ai_model_id: Annotated[str, StringConstraints(strip_whitespace=True, to_upper=None, to_lower=None, strict=None, min_length=1, max_length=None, pattern=None)]

is_experimental 

is_experimental = True

service_id 

service_id: str

stage_status 

stage_status = 'experimental'