Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

965

Base only

Active filters: 4bit

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 7 days ago • 9.73k • 84

mlx-community/gemma-4-e4b-it-qat-OptiQ-4bit

Text Generation • 7B • Updated 1 day ago • 4.26k • 12

Jiunsong/supergemma4-26b-uncensored-mlx-4bit-v2

Text Generation • 25B • Updated Apr 12 • 16.4k • 278

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated 7 days ago • 12.5k • 69

mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated 7 days ago • 13.7k • 51

mlx-community/Agents-A1-OptiQ-4bit

Image-Text-to-Text • 35B • Updated 7 days ago • 204 • 2

mlx-community/gemma-4-12B-coder-fable5-composer2.5-v1-OptiQ-4bit

Image-Text-to-Text • 12B • Updated 1 day ago • 1.02k • 2

mlx-community/Ornith-1.0-35B-OptiQ-4bit

Image-Text-to-Text • 35B • Updated 7 days ago • 564 • 2

empero-ai/openNemo-Cascade-2-30B-A3B

Text Generation • 32B • Updated Mar 24 • 329 • 10

mlx-community/gemma-4-26B-A4B-it-OptiQ-4bit

Text Generation • 25B • Updated 1 day ago • 3.89k • 15

AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit

Text Generation • 35B • Updated May 27 • 1.04k • 44

DuoNeural/Cosmos3-Nano-GPTQ-4bit-Abliterated

Text-to-Video • Updated Jun 2 • 77 • 2

mlx-community/gemma-4-12B-it-OptiQ-4bit

Text Generation • 12B • Updated 1 day ago • 11k • 40

mlx-community/gemma-4-12B-it-qat-assistant-4bit

Text Generation • 66.1M • Updated Jun 5 • 1.76k • 3

mlx-community/gemma-4-26B-A4B-it-qat-OptiQ-4bit

Text Generation • 25B • Updated 1 day ago • 2.91k • 4

mlx-community/VibeThinker-3B-OptiQ-4bit

Text Generation • 0.6B • Updated 6 days ago • 578 • 3

fe-dev-dl/Ornith-1.0-9B-Hardware-Expert-fp16

Text Generation • 9B • Updated 6 days ago • 414 • 2

mlx-community/ThinkingCap-Qwen3.6-27B-OptiQ-4bit

Image-Text-to-Text • 27B • Updated 7 days ago • 771 • 2

mlx-community/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-OptiQ-4bit

Text Generation • 0.2B • Updated 7 days ago • 540 • 2

mlx-community/Ornith-1.0-9B-OptiQ-4bit

Image-Text-to-Text • 9B • Updated 7 days ago • 272 • 1

MarkChen1214/cohere-transcribe-03-2026-MLX-Mixed-2bit3bit4bit

Automatic Speech Recognition • 0.2B • Updated 3 days ago • 79 • 1

MarkChen1214/cohere-transcribe-arabic-07-2026-MLX-Mixed-2bit3bit4bit

Automatic Speech Recognition • 0.2B • Updated 3 days ago • 150 • 1

zhnagchenchne/Qwen3.6-27B-GPTQ-W4A16

28B • Updated 4 days ago • 35 • 1

mradermacher/ChunMengDie-1.0-0.4b-GGUF

0.3B • Updated 3 days ago • 145 • 2

Chun121/Qwen3-4B-RPG-Roleplay-V2

Text Generation • 4B • Updated Aug 24, 2025 • 16k • 62

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 12 • 40

mayaeary/pygmalion-6b_dev-4bit-128g

Text Generation • Updated Mar 28, 2023 • 11 • 121

mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g

Text Generation • Updated Mar 31, 2023 • 6 • 2

mayaeary/PPO_Pygway-6b-Mix-4bit-128g

Text Generation • Updated Mar 31, 2023 • 3 • 2

Ancestral/Dolly_Shygmalion-6b-4bit-128g

Text Generation • Updated Apr 9, 2023 • 6 • 5