Bonsai 27B WebGPU Kernels
🌳
215
Run a 1-bit 27B LLM locally in your browser on WebGPU
Bonsai 27B
-
-
Ternary Bonsai 27B API Demo
🤗17Chat with the Ternary Bonsai 27B language model
-
prism-ml/Ternary-Bonsai-27B-gguf
Text Generation • 4B • Updated • 339k • • 807 -
prism-ml/Bonsai-27B-gguf
Text Generation • 4B • Updated • 1.26M • 512 -
prism-ml/Ternary-Bonsai-27B-mlx-2bit
Text Generation • 3B • Updated • 17.9k • 121 -
prism-ml/Bonsai-27B-mlx-1bit
Text Generation • 2B • Updated • 21.7k • 141 -
prism-ml/Ternary-Bonsai-27B-AWQ-4bit
Image-Text-to-Text • 27B • Updated • 3.07k • • 14 -
prism-ml/Bonsai-27B-AWQ-4bit
Image-Text-to-Text • 27B • Updated • 846 • 7 -
prism-ml/Ternary-Bonsai-27B-unpacked
27B • Updated • 1.08k • 14 -
prism-ml/Bonsai-27B-unpacked
27B • Updated • 552 • 12