Skip to main content

Interface: TextGenerationModelSettings

Hierarchy​

Properties​

maxGenerationTokens​

• Optional maxGenerationTokens: number

Specifies the maximum number of tokens (words, punctuation, parts of words) that the model can generate in a single response. It helps to control the length of the output.

Does nothing if the model does not support this setting.

Example: maxGenerationTokens: 1000

Defined in​

packages/modelfusion/src/model-function/generate-text/TextGenerationModel.ts:28

numberOfGenerations​

• Optional numberOfGenerations: number

Number of texts to generate.

Specifies the number of responses or completions the model should generate for a given prompt. This is useful when you need multiple different outputs or ideas for a single prompt. The model will generate 'n' distinct responses, each based on the same initial prompt. In a streaming model this will result in both responses streamed back in real time.

Does nothing if the model does not support this setting.

Example: numberOfGenerations: 3 // The model will produce 3 different responses.

Defined in​

packages/modelfusion/src/model-function/generate-text/TextGenerationModel.ts:55

observers​

• Optional observers: FunctionObserver[]

Observers that are called when the model is used in run functions.

Inherited from​

ModelSettings.observers

Defined in​

packages/modelfusion/src/model-function/Model.ts:8

stopSequences​

• Optional stopSequences: string[]

Stop sequences to use. Stop sequences are an array of strings or a single string that the model will recognize as end-of-text indicators. The model stops generating more content when it encounters any of these strings. This is particularly useful in scripted or formatted text generation, where a specific end point is required. Stop sequences not included in the generated text.

Does nothing if the model does not support this setting.

Example: stopSequences: ['\n', 'END']

Defined in​

packages/modelfusion/src/model-function/generate-text/TextGenerationModel.ts:41

trimWhitespace​

• Optional trimWhitespace: boolean

When true, the leading and trailing white space and line terminator characters are removed from the generated text.

Default: true.

Defined in​

packages/modelfusion/src/model-function/generate-text/TextGenerationModel.ts:63