Interface LoadOptions

Load Options

interface LoadOptions {
    executionProviders: ExecutionProviderConfig[];
    externalData: boolean;
    fetch: ((url: string) => Promise<string>);
    max_tokens: number;
    verbose: boolean;
}

Hierarchy (view full)

Properties

executionProviders externalData fetch max_tokens verbose

Properties

executionProviders

executionProviders: ExecutionProviderConfig[]

List of execution providers for ONNX runtime.

externalData

externalData: boolean

Indicates if external data is used.

fetch

fetch: ((url: string) => Promise<string>)

Function to fetch external data.

max_tokens

max_tokens: number

The maximum number of tokens for text generation.

verbose

verbose: boolean

Enables verbose logging.

Settings

Member Visibility

On This Page

Properties