react-native-transformers
    Preparing search index...

    Class TextGeneration

    Class to handle a large language model on top of onnxruntime

    Hierarchy (View Summary)

    Index

    Constructors

    Properties

    eos: bigint = 2n
    feed: Record<string, Tensor> = {}
    outputTokens: bigint[] = []
    sess?: InferenceSession

    Methods

    • Generate tokens using greedy search

      Parameters

      • tokens: bigint[]

        Initial tokens

      • callback: (tokens: bigint[]) => void

        Callback function to handle the generated tokens

      • options: { maxTokens: number }

        Generation options

      Returns Promise<bigint[]>

      Array of generated tokens

    • Parameters

      • feed: Record<string, Tensor>
      • outputs: OnnxValueMapType

      Returns void