Edit Models filters

Model Tree

meta-llama/Llama-3.1-8B-Instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

888

Base only

Active filters: meta-llama/Llama-3.1-8B-Instruct

bartowski/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Dec 1, 2024 • 259k • 379

mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF

8B • Updated Aug 3, 2024 • 30.6k • 197

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 508 • 255

unsloth/Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated May 9, 2025 • 7.47k • 41

nvidia/Llama-3.1-8B-Instruct-NVFP4

5B • Updated Sep 15, 2025 • 273k • 14

Zynerji/Ektome-Llama-3.1-8B-PristinelyUncensored

Text Generation • 8B • Updated 5 days ago • 1.34k • 2

hugging-quants/Meta-Llama-3.1-8B-Instruct-BNB-NF4

Text Generation • 8B • Updated Aug 8, 2024 • 260 • 8

YorkieOH10/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 349 • 10

DevQuasar-4/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Dec 4, 2024 • 154 • 2

leafspark/Meta-Llama-3.1-8B-Instruct-Q2_K-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 47

legraphista/Meta-Llama-3.1-8B-Instruct-IMat-GGUF

Text Generation • 8B • Updated Jul 27, 2024 • 649 • 6

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 8B • Updated Feb 15, 2025 • 104k • 102

brittlewis12/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 27, 2024 • 452 • 2

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 76.8k • 37

lmstudio-community/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 28, 2024 • 67.4k • 260

Ren6767/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 17

mtsdurica/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 91

SanctumAI/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Sep 11, 2024 • 23.7k • 18

backyardai/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 348 • 1

HeRksTAn/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 25

xyottax/Meta-Llama-3.1-8B-Instruct-Q3_K_S-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 80

rumbleFTW/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 21 • 1

mlc-ai/Llama-3.1-8B-Instruct-q3f16_1-MLC

Updated Sep 7, 2025 • 39

mlc-ai/Llama-3.1-8B-Instruct-q0f16-MLC

Updated Sep 7, 2025 • 12

mlc-ai/Llama-3.1-8B-Instruct-q4f32_1-MLC

Updated Sep 7, 2025 • 568 • 3

mlc-ai/Llama-3.1-8B-Instruct-q4f16_1-MLC

Updated Sep 7, 2025 • 595 • 5

RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8

Text Generation • 8B • Updated Oct 9, 2024 • 528k • 44

RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic

Text Generation • 8B • Updated 11 days ago • 76.4k • 9

Ayylex/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 14 • 1

3Simplex/Meta-Llama-3.1-8B-Instruct-gguf

Text Generation • 8B • Updated Jul 27, 2024 • 214 • 2