Bonsai 27B WebGPU Kernels
🌳
235
Run a 1-bit 27B LLM locally in your browser on WebGPU
Bonsai 27B
-
-
Ternary Bonsai 27B API Demo
🤗20Chat with the Ternary Bonsai 27B language model
-
prism-ml/Ternary-Bonsai-27B-gguf
Text Generation • 4B • Updated • 432k • • 876 -
prism-ml/Bonsai-27B-gguf
Text Generation • 4B • Updated • 1.4M • 555 -
prism-ml/Ternary-Bonsai-27B-mlx-2bit
Text Generation • 3B • Updated • 20.4k • 131 -
prism-ml/Bonsai-27B-mlx-1bit
Text Generation • 2B • Updated • 25.3k • 158 -
prism-ml/Ternary-Bonsai-27B-AWQ-4bit
Image-Text-to-Text • 27B • Updated • 3.37k • • 16 -
prism-ml/Bonsai-27B-AWQ-4bit
Image-Text-to-Text • 27B • Updated • 1.05k • 8 -
prism-ml/Ternary-Bonsai-27B-unpacked
27B • Updated • 1.47k • 15 -
prism-ml/Bonsai-27B-unpacked
27B • Updated • 757 • 13