Llama 3.1 8B Instruct is Meta's small open-weight instruction-tuned model, designed for fast, low-cost chat and general text tasks with a 128K context window. It suits lightweight applications and resource-constrained self-hosted deployments.
Cost rate
0.1x
Context
131K
Released
Jul 23, 2024
Input
Text
Output
Text
Support
ReasoningTool callingStructured outputs
Performance
Median latency and throughput measured across recent requests.
Throughput128 tok/s
Latency1.49s
Best at
The categories where this model ranks highest.
Medicine & Healthcare
#334 路 top 85%
Legal & Government
#335 路 top 85%
Software & IT Services
#343 路 top 81%
Business, Management, & Finance
#343 路 top 83%
| Domain | Score | Rank |
|---|---|---|
| Software & IT Services | 1244 | #343 |
| Writing, Literature, & Language | 1182 | #350 |
| Life, Physical, & Social Science | 1229 | #347 |
| Entertainment, Sports, & Media | 1174 | #347 |
| Business, Management, & Finance | 1210 | #343 |
| Mathematical | 1193 | #346 |
| Legal & Government | 1246 | #335 |
| Medicine & Healthcare | 1231 | #334 |
Latest news about Llama 3.1 8B Instruct
Recent articles and community posts, linked to their original sources.

- How Meta's Llama strategy aims to become the 'Linux' of AIRick Orford - Trading Stocks and Options For All on MSN
Meta Llama for OCR is Better Than ExpectedTech Expert Tutorials1,277- Meta's Llama open-source strategy and MTIA chipsRick Orford - Trading Stocks and Options For All on MSN
How Free AI Models Like Llama 4 Are Changing the GameHarper Carroll AI8,375