Class: LlamaCppApiConfiguration
Creates an API configuration for the Llama.cpp server. It calls the API at http://127.0.0.1:8080 by default.
Hierarchy
-
BaseUrlApiConfigurationWithDefaults↳
LlamaCppApiConfiguration
Constructors
constructor
• new LlamaCppApiConfiguration(settings?): LlamaCppApiConfiguration
Parameters
| Name | Type |
|---|---|
settings | PartialBaseUrlPartsApiConfigurationOptions |
Returns
Overrides
BaseUrlApiConfigurationWithDefaults.constructor
Defined in
packages/modelfusion/src/model-provider/llamacpp/LlamaCppApiConfiguration.ts:11
Methods
assembleUrl
▸ assembleUrl(path): string
Parameters
| Name | Type |
|---|---|
path | string |
Returns
string
Inherited from
BaseUrlApiConfigurationWithDefaults.assembleUrl
Defined in
packages/modelfusion/src/core/api/BaseUrlApiConfiguration.ts:47
fixedHeaders
▸ fixedHeaders(): Record<string, string>
Returns
Record<string, string>
Inherited from
BaseUrlApiConfigurationWithDefaults.fixedHeaders
Defined in
packages/modelfusion/src/core/api/BaseUrlApiConfiguration.ts:43
headers
▸ headers(params): Record<string, string>
Parameters
| Name | Type |
|---|---|
params | HeaderParameters |
Returns
Record<string, string>
Inherited from
BaseUrlApiConfigurationWithDefaults.headers
Defined in
packages/modelfusion/src/core/api/AbstractApiConfiguration.ts:31
Properties
baseUrl
• Readonly baseUrl: UrlParts
Inherited from
BaseUrlApiConfigurationWithDefaults.baseUrl
Defined in
packages/modelfusion/src/core/api/BaseUrlApiConfiguration.ts:27
retry
• Optional Readonly retry: RetryFunction
Inherited from
BaseUrlApiConfigurationWithDefaults.retry
Defined in
packages/modelfusion/src/core/api/AbstractApiConfiguration.ts:7
throttle
• Optional Readonly throttle: ThrottleFunction
Inherited from
BaseUrlApiConfigurationWithDefaults.throttle
Defined in
packages/modelfusion/src/core/api/AbstractApiConfiguration.ts:8