Skip to main content

Model Providers

Model providers (e.g., OpenAI) offer APIs (either local or in the cloud) for using AI models, e.g. large language models (LLMs), image generation models, or speech-to-text models.

Generate Text​

Generate textStream textTokenize text
OpenAI✅✅full
OpenAI Compatible✅✅
Llama.cpp✅✅basic
Ollama✅✅
Mistral✅✅
Hugging Face✅
Cohere✅✅full

Generate Object​

  • OpenAI chat models (function call, json mode)
  • Ollama json mode, with compatible models
  • Llama.cpp json and json array grammars, with compatible models

Generate Tool Call and Generate Tool Calls​

Generate Image​

Generate Speech​

Generate Transcription​

Embed Value​