Llama 3.2 1B
Model Overview¶
The Llama 3.2 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction-tuned generative models in 1B and 3B sizes (text in/text out). The Llama 3.2 instruction-tuned text only models are optimized for multilingual dialogue use cases, including agentic retrieval and summarization tasks.
- Model Architecture: Llama 3.2 is an auto-regressive language model that uses an optimized transformer architecture. The tuned versions use supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to align with human preferences for helpfulness and safety.
- Model Release Date: Sept 25, 2024.
- Model Source: meta-llama/Llama-3.2-1B
- License: llama3.2
- Supported languages: English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai
QPC Configurations¶
| Precision | SoCs / Tensor slicing | NSP-Cores (per SoC) | Full Batch Size | Chunking Prompt Length | Context Length (CL) | QPC URL | QPC Size | QPC Download | Onnx URL | Onnx Download | Generation Date |
|---|---|---|---|---|---|---|---|---|---|---|---|
| MXFP6 | 2 | 16 | 1 | 128 | 8192 | https://dc00tk1pxen80.cloudfront.net/SDK1.21.2/meta-llama/Llama-3.2-1B/meta-llama_Llama-3.2-1B_qpc_16cores_128pl_8192cl_1fbs_2devices_mxfp6_mxint8.tar.gz | 3GB | Download | https://dc00tk1pxen80.cloudfront.net/SDK1.21.2/meta-llama/Llama-3.2-1B/meta-llama_Llama-3.2-1B_ONNX.tar.gz | Download | 25-Mar-2026 |