Class Base

Hierarchy (view full)

Base
- TextGeneration
- TextEmbedding

Index

Constructors

Properties

Methods

argmax initializeFeed load release updateKVCache

Constructors

constructor

new Base(): Base
Returns Base
- Defined in models/base.tsx:35

Properties

`Protected`eos

eos: bigint = 2n

`Protected`feed

feed: Record<string, Tensor> = {}

`Protected` `Optional`sess

sess?: InferenceSession

Methods

`Protected`argmax

argmax(t): number
Parameters
- t: Tensor
Returns number
- Defined in models/base.tsx:110

initializeFeed

initializeFeed(): void
Returns void
- Defined in models/base.tsx:82

load

load(model, onnx_file?, options): Promise<void>
Parameters
- model: string
- onnx_file: string = "onnx/model.onnx"
- options: LoadOptions
Returns Promise<void>
- Defined in models/base.tsx:37

release

release(): Promise<void>
Returns Promise<void>
- Defined in models/base.tsx:146

`Protected`updateKVCache

updateKVCache(feed, outputs): void
Parameters
- feed: Record<string, Tensor>
- outputs: OnnxValueMapType
Returns void
- Defined in models/base.tsx:129