Skip to main content

Interface: HasTokenizer<PROMPT>

Type parameters​

Name
PROMPT

Methods​

countPromptTokens​

▸ countPromptTokens(prompt): PromiseLike<number>

Parameters​

NameType
promptPROMPT

Returns​

PromiseLike<number>

Defined in​

packages/modelfusion/src/model-function/generate-text/TextGenerationModel.ts:73

Properties​

tokenizer​

• tokenizer: BasicTokenizer | FullTokenizer

Defined in​

packages/modelfusion/src/model-function/generate-text/TextGenerationModel.ts:71