Skip to main content
Tiny Talk gives you access to models from multiple model providers (OpenAI, Anthropic, Google, Meta, xAI, DeepSeek, Mistral, Cohere, and Qwen) served through different inference providers (OpenAI, OpenRouter, Groq, and Azure). Each model has different strengths, speeds, and credit costs.

​
How credits work

On plans that include AI credits (Basic AI, Standard AI, Pro AI), each agent response consumes credits based on the model used. Credits reset monthly. Most models cost 1 credit per response. Mid-tier models (GPT-4o, Claude Sonnet, Gemini Pro) cost 2 credits. Higher-tier models (GPT-4, o1) cost 5 credits, and top-tier models (Claude Opus 4) cost 10 credits.

​
Bring Your Own Key (BYOK)

On legacy plans (Basic, Team, Enterprise) and some other plans, you can use your own API key instead of credits. Go to Integrations → Hub and enter your inference provider API key. The agent will use your key for all API calls, with no credit consumption on Tiny Talk’s side. After entering a key, click Verify to test it. Tiny Talk will check the key and display the models available for it. Make sure the model you want to use for your agent appears in this list.
An OpenAI key is always required on BYOK plans — Tiny Talk uses OpenAI’s embedding model for knowledge base indexing and search, regardless of which model you choose for agent responses.
Using your own OpenAI key? See OpenAI’s pricing page for per-token costs of each model.

​
Available models

​
OpenAI

​
Anthropic (via OpenRouter)

​
Google (via OpenRouter)

​
Meta (via OpenRouter)

​
xAI (via OpenRouter)

​
Other model providers (via OpenRouter)

​
Groq (inference provider)

​
Azure OpenAI (inference provider, EU data residency)

Available on Pro plan only. These models run on Azure’s European (Germany) infrastructure for data residency compliance.
Need a different model on Azure EU? Pro plan users can contact support to request provisioning of additional models.

​
Reasoning-capable models

Reasoning-capable models spend additional compute “thinking” before they answer, which improves quality on complex, multi-step questions in exchange for higher latency and credit cost. When you select one of these models, the Reasoning Effort and Reasoning Summary controls appear in your agent’s model configuration (and the temperature slider is hidden). See Reasoning configuration for details. Models marked Yes in the Reasoning column of the tables above support these controls. They span several providers:
  • OpenAI — o1, o3-mini, GPT-5, GPT-5 Mini, GPT-5 Nano, GPT-5.1, GPT-5.2, GPT-5.2 Chat
  • Google — Gemini 3.1 Pro Preview, Gemini 3 Flash Preview
  • xAI — Grok 4.1 Fast, Grok 4
  • DeepSeek — DeepSeek V4 Pro, DeepSeek V4 Flash, DeepSeek-V3.2, DeepSeek-R1
  • Groq — GPT-OSS 120B, GPT-OSS 20B
Available effort levels vary by model — for example, GPT-5.2 Chat only supports Medium, and GPT-OSS 120B/20B only support Low, Medium, and High. The dashboard only shows values the selected model accepts.

​
Selecting a model

Go to your agent’s Settings and choose a model from the dropdown. Consider:
  • Cost — 1-credit models are most efficient for high-volume agents
  • Quality — Premium models (GPT-5, Claude Sonnet/Opus) produce better responses for complex queries
  • Speed — Groq models offer the fastest inference; Mini/Nano variants are faster than full models
  • Reasoning — Reasoning-capable models deliver better answers on complex questions at the cost of latency and extra credits
  • Data residency — Use Azure EU models if you need European data processing (Pro plan)