Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

985

Base only

Active filters: language

ibm-granite/granite-4.1-8b

Text Generation • 9B • Updated May 4 • 2.44M • 224

ibm-granite/granite-4.1-3b

Text Generation • 3B • Updated May 4 • 372k • 93

unsloth/granite-4.1-8b-GGUF

9B • Updated Apr 30 • 7.5k • 49

ibm-granite/granite-4.1-3b-GGUF

Text Generation • 3B • Updated Apr 20 • 227k • 8

ibm-granite/granite-4.1-8b-GGUF

Text Generation • 9B • Updated Apr 20 • 3.85k • 9

ibm-granite/granite-vision-4.1-4b-GGUF

3B • Updated 27 days ago • 1.91k • 6

ibm-granite/granite-3.1-1b-a400m-base

Text Generation • 1B • Updated Jan 31, 2025 • 2.42k • 11

ibm-granite/granite-3.1-1b-a400m-instruct

Text Generation • 1B • Updated 14 days ago • 4.92k • 20

lmstudio-community/granite-3.1-1b-a400m-instruct-GGUF

Text Generation • 1B • Updated Dec 23, 2024 • 129 • 1

mradermacher/granite-3.1-8b-instruct-abliterated-GGUF

8B • Updated Dec 21, 2024 • 66 • 3

ibm-research/granite-3.2-8b-instruct-GGUF

Text Generation • 8B • Updated Mar 3, 2025 • 622 • 10

ibm-research/granite-3.2-2b-instruct-GGUF

Text Generation • 3B • Updated Mar 28, 2025 • 774 • 12

ibm-research/granite-vision-3.2-2b-GGUF

3B • Updated Mar 3, 2025 • 526 • 15

ibm-granite/granite-3.3-2b-instruct-GGUF

Text Generation • 3B • Updated Apr 16, 2025 • 1.06k • 15

ibm-granite/granite-3.3-8b-instruct-GGUF

Text Generation • 8B • Updated Apr 16, 2025 • 1.84k • 39

ibm-granite/granite-vision-3.3-2b-GGUF

3B • Updated Mar 13 • 1.49k • 16

ibm-granite/granite-4.0-h-micro

Text Generation • 3B • Updated Nov 3, 2025 • 6.01k • 148

ibm-granite/granite-4.0-h-micro-GGUF

3B • Updated Apr 23 • 1.34k • 20

ibm-granite/granite-4.0-h-1b-base

Text Generation • 1B • Updated Jun 12 • 338 • 34

ibm-granite/granite-4.0-h-350m

Text Generation • 0.3B • Updated Oct 23, 2025 • 8.87k • 108

ibm-granite/granite-4.0-350m-GGUF

0.4B • Updated Apr 23 • 1.41k • 8

ibm-granite/granite-4.0-h-350m-GGUF

0.3B • Updated Apr 23 • 896 • 5

ibm-granite/granite-4.0-1b-GGUF

2B • Updated Apr 23 • 3.55k • 5

ibm-granite/granite-4.0-h-1b-GGUF

1B • Updated Apr 23 • 798 • 6

onnx-community/granite-4.0-350m-ONNX-web

Text Generation • Updated Oct 28, 2025 • 633 • 6

ibm-granite/granite-4.1-30b

Text Generation • 29B • Updated May 4 • 29k • 138

ibm-granite/granite-4.1-30b-GGUF

Text Generation • 29B • Updated Apr 21 • 1.89k • 4

aifeifei798/granite-4.1-Queen-30b

Text Generation • 29B • Updated Apr 30 • 86 • 1

mlx-community/granite-4.1-30b-mxfp8

Text Generation • 29B • Updated Apr 30 • 274 • 3

ibm-granite/granite-speech-4.1-2b-GGUF

2B • Updated May 11 • 1.07k • 4