Namespace: llamacpp

Namespaces

• grammar
• prompt

Functions

Api

▸ Api(settings): LlamaCppApiConfiguration

Creates an API configuration for the Llama.cpp server. It calls the API at http://127.0.0.1:8080 by default.

Parameters

Name	Type
settings	PartialBaseUrlPartsApiConfigurationOptions

Returns

LlamaCppApiConfiguration

Defined in

packages/modelfusion/src/model-provider/llamacpp/LlamaCppFacade.ts:18

---

CompletionTextGenerator

▸ CompletionTextGenerator<CONTEXT_WINDOW_SIZE>(settings?): LlamaCppCompletionModel<CONTEXT_WINDOW_SIZE>

Type parameters

Name	Type
CONTEXT_WINDOW_SIZE	extends number

Parameters

Name	Type
settings	LlamaCppCompletionModelSettings<CONTEXT_WINDOW_SIZE>

Returns

LlamaCppCompletionModel<CONTEXT_WINDOW_SIZE>

Defined in

packages/modelfusion/src/model-provider/llamacpp/LlamaCppFacade.ts:22

---

TextEmbedder

▸ TextEmbedder(settings?): LlamaCppTextEmbeddingModel

Parameters

Name	Type
settings	LlamaCppTextEmbeddingModelSettings

Returns

LlamaCppTextEmbeddingModel

Defined in

packages/modelfusion/src/model-provider/llamacpp/LlamaCppFacade.ts:28

---

Tokenizer

▸ Tokenizer(api?): LlamaCppTokenizer

Parameters

Name	Type
api	ApiConfiguration

Returns

LlamaCppTokenizer

Defined in

packages/modelfusion/src/model-provider/llamacpp/LlamaCppFacade.ts:34