Class Base

Hierarchy (View Summary)

Base
- TextGeneration

Index

Constructors

Properties

Methods

argmax initializeFeed load release updateKVCache

Constructors

constructor

new Base(): Base
Returns Base
- Defined in models/base.tsx:35

Properties

`Protected`eos

eos: bigint = 2n

`Protected`feed

feed: Record<string, Tensor> = {}

`Protected` `Optional`sess

sess?: InferenceSession

Methods

`Protected`argmax

argmax(t: Tensor): number
Parameters
- t: Tensor
Returns number
- Defined in models/base.tsx:110

initializeFeed

initializeFeed(): void
Returns void
- Defined in models/base.tsx:82

load

load(model: string, onnx_file?: string, options: LoadOptions): Promise<void>
Parameters
- model: string
- onnx_file: string = 'onnx/model.onnx'
- options: LoadOptions
Returns Promise<void>
- Defined in models/base.tsx:37

release

release(): Promise<void>
Returns Promise<void>
- Defined in models/base.tsx:155

`Protected`updateKVCache

updateKVCache(feed: Record<string, Tensor>, outputs: OnnxValueMapType): void
Parameters
- feed: Record<string, Tensor>
- outputs: OnnxValueMapType
Returns void
- Defined in models/base.tsx:135