Llama 3.1 8B Instruct

Llama 3.1 8B Instruct

Meta馃嚭馃嚫meta-llama/llama-3.1-8b-instruct
Compare

Llama 3.1 8B Instruct is Meta's small open-weight instruction-tuned model, designed for fast, low-cost chat and general text tasks with a 128K context window. It suits lightweight applications and resource-constrained self-hosted deployments.

Released
Jul 23, 2024
Input
Text
Output
Text
Support
ReasoningTool callingStructured outputs

Performance

Median latency and throughput measured across recent requests.

Throughput128 tok/s
Latency1.49s

Best at

The categories where this model ranks highest.

Medicine & Healthcare

#334 路 top 85%

Legal & Government

#335 路 top 85%

Software & IT Services

#343 路 top 81%

Business, Management, & Finance

#343 路 top 83%

DomainScoreRank
Software & IT Services1244#343
Writing, Literature, & Language1182#350
Life, Physical, & Social Science1229#347
Entertainment, Sports, & Media1174#347
Business, Management, & Finance1210#343
Mathematical1193#346
Legal & Government1246#335
Medicine & Healthcare1231#334

Latest news about Llama 3.1 8B Instruct

Recent articles and community posts, linked to their original sources.