Jamba 1.5 Large

by AI21open weights

Jamba family

Parameters

398B

Context window

256K tokens

Released

2024-08-22

Input price / 1M tok

$2.00

Output price / 1M tok

$8.00

Modality

tools

About Jamba 1.5 Large

AI21's hybrid Mamba-Transformer flagship. Trades some benchmark scores for dramatically faster long-context throughput. 256K context at 1/10th the memory cost of pure-Transformer peers. Popular for cost-sensitive long-context work.

Strengths

Fast long-context throughput
Open weights (research licence)
256K context
Cheap on hosted APIs

Weaknesses

Weaker on short-context reasoning
Text-only
Smaller ecosystem

Best for

Long-doc RAGBatch processingCost-sensitive long context

Vendor page →HuggingFace →