Skip to main content
📖 The AI Tool Bible

AI tools tagged Supports Streaming

36 tools matching this tag.model

All tags →
GC

GitHub Copilot

Featured
Coding · GPT / Claude / OpenAI o-series (configurable)
9.1

The original AI pair programmer, now with chat and agents.

Paid· Free: $0 · Pro: $10 · Pro+: $39 · Max: $100autocompletechat
GA

Gemini Advanced

Writing · Gemini 2.5 Pro
9.0

Google's flagship — strong at math, long context, and Workspace integration.

Paid· $20/mo via Google One AI PremiumWorkspace integrationmath
AS

AssemblyAI

Audio · Universal / Slam-1
8.7

Speech-to-text API with diarisation, summarisation, and topic detection.

Freemium· Pre-recorded Speech-to-Text API: $0.21 /hr · Universal-2: $0.15 /hr · Realtime Speech-to-Text API: $0.45 /hr · Universal-Streaming: $0.15 /hr · Universal-Streaming Multilingual: $0.15 /hrtranscriptiondiarisation
AB

AWS Bedrock

Agents · Multi-model: Anthropic Claude, Meta Llama, Mistral, Cohere, AI21, Amazon Nova/Titan, DeepSeek, Stability, OpenAI GPT
8.6

Build and scale generative AI applications with foundation models

Paid· Standard: Contact sales · Flex: Contact sales · Priority: Contact sales · Reserved: Contact salesEnterprise RAG chatbot over private documentsMulti-step tool-using agents via AgentCore
CA

Claude Agent SDK

Agents · Claude Opus / Sonnet
8.6

Anthropic's official SDK for building autonomous Claude agents.

Free· Free SDK; API usage billed at Claude ratesClaude agentstool use
VL

vLLM

Fine-tuning · Multi-model (open-weight LLMs: Llama, Qwen, DeepSeek, Mistral, Gemma, Phi, etc.)
8.3

Open-source high-throughput inference engine for serving LLMs with PagedAttention and continuous batching.

Free· Free and open-source (Apache 2.0); self-hosted infrastructure costs applyllm-servingself-hosted-inference
SG

SGLang

Fine-tuning · Multi-model (DeepSeek, Qwen, Llama, Mistral, GLM, GPT-OSS)
8.2

Open-source high-throughput inference engine for LLMs and multimodal models with OpenAI-compatible serving.

Free· Free, open-source (Apache 2.0); self-hosted infra cost onlyllm-servingmultimodal-inference
EC

ElevenLabs Conversational AI

Audio · ElevenLabs Scribe (ASR) + pluggable LLM + ElevenLabs TTS
8.1

Production-grade voice agent platform layering ElevenLabs TTS, ASR, and LLM orchestration into a single deployable stack.

Paid· Free: $0 · Starter: $6 · Creator: $11 · Pro: $99 · Scale: $299voice-agentsivr-replacement
HA

Hume AI

Audio · Octave, EVI, TADA
8.0

Emotionally intelligent voice AI with expressive TTS, speech-to-speech, and human-feedback evaluation APIs.

Freemium· Free: $0 · Starter: $3 · Creator: $7 · Pro: $70 · Scale: $200expressive-ttsvoice-cloning
MI

MiniMax

Agents · MiniMax M3, Hailuo 2.3, Speech 2.8, Music 2.6
8.0

Chinese frontier-model lab shipping multimodal foundation models with a 1M-context coding/agent stack.

Freemium· Free tier; Token plan from ~$20/mo (~12.5B tokens); enterprise pricing on requestcoding-agentlong-context
SE

Sesame

Audio · Sesame CSM (1B / 3B / 8B)
8.0

Conversational voice AI aiming to cross the uncanny valley with context-aware, emotionally aware speech.

Free· Free research preview; consumer product pricing not announcedconversational-voicetext-to-speech
DE

Deepgram

Audio · Nova, Flux, Speak (proprietary)
7.9

Production-grade speech-to-text, text-to-speech, and voice-agent APIs for real-time and batch audio.

Freemium· Free credits on signup; usage-based pricing; enterprise contracts availablespeech-to-texttext-to-speech
FA

Fireworks AI

Fine-tuning · Multi-model (DeepSeek, Qwen, GLM, Kimi, Gemma, Minimax, others)
7.9

Production inference and fine-tuning platform for open-source LLMs, tuned for speed and enterprise economics.

Freemium· Free signup credits; pay-per-token from ~$0.14/M in; enterprise reserved capacity on requestllm-fine-tuningserverless-inference
AA

Azure AI Speech (Neural TTS)

Audio · Azure Neural TTS (plus HD and Azure OpenAI voices)
7.3

Microsoft's enterprise-grade neural text-to-speech with 100+ languages, custom brand voices, and SSML control.

Freemium· Free (F0): Free · Pay as You Go: Voice Live Prices: $- · Commitment Tiers – Standard: $- for 2,000 hourstext-to-speechvoice-cloning
BI

Bifrost

Agents · Multi-model (OpenAI, Anthropic, Bedrock, Vertex, 1000+ via providers)
7.3

Open-source AI gateway that unifies 1000+ models behind one OpenAI-compatible endpoint with failover, budgets, and MCP routing.

Freemium· Free Forever: Free · Enterprise: Contact salesllm-gatewaymulti-provider-routing
DE

DeepSeek

Coding · DeepSeek R1, V3, V2, Coder V2, VL
7.3

Chinese AI lab shipping open-weight reasoning models that punch well above their API price.

Freemium· deepseek-v4-flash: 0.02元 (缓存命中) / 1元 (缓存未命中) / 2元 (输出) · deepseek-v4-pro: 0.025元 (缓存命中) / 3元 (缓存未命中) / 6元 (输出)reasoningcode-generation
GE

Gemini

Writing · Gemini 2.x (Flash / Pro / Ultra)
7.3

Google's flagship multimodal AI assistant with deep integration into Workspace and Android.

Freemium· Free tier; Google One AI Premium $19.99/mo includes Gemini Advancedchat-assistantresearch
OP

OpenRouter

Coding · Multi-model
7.3

Unified API gateway to 400+ LLMs from 70+ providers, with one OpenAI-compatible endpoint and automatic failover.

Freemium· Pay-as-you-go credits; sample packs $10 and $99; some free-tier models availablellm-routingmulti-model-access
AS

AI SDK

Coding · Multi-model
7.2

Vercel's open-source TypeScript framework for building AI apps across 16+ providers with unified streaming, tools, and UI hooks.

Free· Open source (Apache 2.0); pay only for the underlying model APIschat-uiagent-building
BE

Beam

Coding · openai/gpt-oss-20b
7.2

Serverless GPU infrastructure for AI workloads with sub-second cold starts and bring-your-own-cloud support.

Freemium· $30 free credit refreshed monthly; usage-based beyond thatgpu-inferenceagent-sandboxes
CA

Cald.AI

Agents · Multi-model
7.2

Voice AI agents that run inbound and outbound phone calls with sub-second latency.

Freemium· 100 free minutes; volume pricing at 10k min/mo; enterprise customoutbound-callsinbound-support
CH

Chainlit

Agents · Multi-model
7.2

Open-source Python framework for building production-grade conversational AI interfaces in minutes.

Free· Open-source (Apache 2.0); optional paid Literal AI observability tierchatbot-uiagent-frontend
PA

Portkey AI Gateway

Agents · Multi-model (1,600+ LLMs)
7.2

Open-source AI gateway that routes a single API call across 1,600+ LLMs with caching, fallbacks, and observability.

Freemium· Developer: Free Forever · Production: $49/month · Enterprise: Custom Pricingllm-routingfallbacks-and-retries
GR

Groq

Coding · Multi-model (Llama, Mixtral, Gemma, Qwen, Whisper)
7.1

Custom-silicon LPU inference platform serving open models at GPU-trouncing latency via an OpenAI-compatible API.

Freemium· Free API key with rate limits; per-token paid tiers; enterprise contractslow-latency inferencevoice agents
PO

Portkey

Agents · Multi-model
7.1

Production LLM gateway with observability, guardrails, and prompt management for teams shipping AI in anger.

Freemium· Developer: Free Forever · Production: $49/month · Enterprise: Custom Pricingllm-gatewayobservability
RF

Respan (formerly Keywords AI)

Evaluation · Multi-model (500+ via gateway)
7.1

LLM engineering platform combining a multi-model gateway with tracing, evals, and prompt management.

Freemium· Free tier; paid plans (pricing not public); enterprise on requestllm-observabilityprompt-management
AM

AI/ML API

Coding · Multi-model (GPT, Claude, Gemini, Grok, Nemotron, Qwen, etc.)
6.9

Unified API gateway exposing 500+ AI models behind one OpenAI-compatible endpoint.

Freemium· Pay-as-you-go from $20 prepaid credit; enterprise custommulti-model-routingprototyping
RE

Reasonix

Coding · DeepSeek (e.g. deepseek-v4-flash)
6.8

DeepSeek-native terminal coding agent built around byte-stable prefix caching for cheap long sessions.

Free· MIT-licensed; BYO DeepSeek API key (pay DeepSeek directly)terminal-coding-agentlong-session-coding
BA

Bland AI

Audio · Proprietary in-house voice models

Enterprise voice AI for automated phone calls at scale

Enterprise· Start: $0 · Build: $299 · Scale: $499 · Enterprise: CustomOutbound appointment remindersInsurance claims intake calls
BR

Browserbase

Agents · Model-agnostic via Model Gateway (OpenAI, Anthropic, Google, others)

Headless browser infrastructure for AI agents

Freemium· Start for Free: Free · Get Developer: $20 · Get Startup: $99 · Contact Sales: CustomAI web-browsing agentsLLM-driven end-to-end testing
CB

Chatbot by Vercel

Coding · Provider-agnostic via the Vercel AI SDK (OpenAI, Anthropic, Google, xAI, Groq, Mistral, and others configurable)

Open-source Next.js chatbot template built on the Vercel AI SDK

Free· Free and open-source (MIT-style). Users cover their own hosting costs (e.g. Vercel plan) and AI provider API usage.Internal engineering copilotCustomer-facing support chatbot
GM

Generative MUI React

Coding · model-agnostic (any LLM emitting A2UI v0.9.1; examples use Google Gemini)

Render LLM-emitted A2UI as real Material UI components, with streaming, two-way binding, and charts.

Free· Free, MIT-licensed npm package. No paid tiers; you pay only for whatever LLM you wire it to (e.g. Gemini, OpenAI, Anthropic).LLM chat surfaces that render forms and cards instead of markdownAgent-driven dashboards with streamed MUI X Charts
KM

Kyutai Moshi

Audio · Moshi (7B-class speech-text foundation model) + Mimi neural audio codec, in-house by Kyutai

Open-source, full-duplex speech-to-speech foundation model with sub-200ms latency

Free· Free and open source. Models under CC-BY 4.0, code under MIT (Python) / Apache 2.0 (Rust). Self-hosted only — you pay your own compute (24GB+ GPU for PyTorch, or Apple Silicon via MLX).Real-time voice assistant prototypesResearch on full-duplex spoken dialogue
LG

LLM Gateway

Agents · Routes to GPT-4o, Claude 3.5 Sonnet, Gemini 1.5, Llama 3.1, Mistral, and 200+ others

One API, 200+ models, transparent pricing, and no vendor lock-in.

Freemium· Free: $0 · Enterprise: CustomMulti-provider LLM routingAutomatic failover between model vendors
RA

Retell AI

Audio · LLM-agnostic (OpenAI, Anthropic, Google and others selectable per agent); proprietary turn-taking model and voice pipeline in-house

Build, test and deploy production-grade AI voice agents for inbound and outbound calls.

Freemium· Pay-as-you-go: $0.07-$0.31/minute · Enterprise: Custom PricingAI inbound call answeringOutbound lead qualification
VA

Vapi

Audio · Model-agnostic: OpenAI GPT-4o, Anthropic Claude, Google Gemini, Groq, DeepSeek, Llama; STT/TTS via Deepgram, ElevenLabs, PlayHT, Cartesia, Azure

Developer platform for building, deploying, and scaling production voice AI agents

Freemium· Build: Usage based · Scale: Contact UsAI phone receptionistOutbound lead qualification calls