Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,474

Base only

Active filters: llama-cpp

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 4B • Updated about 13 hours ago • 302k • • 718

prism-ml/Bonsai-27B-gguf

Text Generation • 4B • Updated 1 day ago • 1.22M • 431

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated Jun 8 • 56.5k • 103

ewinregirgojr/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated 4 days ago • 12.6k • 58

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 22.5k • 752

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 33.8k • 119

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated Jun 10 • 4.38k • 34

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated Jun 13 • 20.5k • 103

jica98/qwen3.5-4B-super-coder

Text Generation • 4B • Updated 21 days ago • 36.3k • 44

Abiray/OvisOCR2-GGUF

Image-Text-to-Text • 0.8B • Updated 5 days ago • 1.66k • 7

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Jun 10 • 3.57k • 26

Jiunsong/SuperHY3-abliterated-gguf

Text Generation • 299B • Updated 5 days ago • 383 • 5

BafS/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 1.99k • 9

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 11k • 79

spiritbuun/buun-Qwen3.6-chat_template

Updated May 28 • 57

prithivMLmods/VibeThinker-3B-GGUF

Text Generation • 3B • Updated Jun 16 • 41.7k • 72

LordNeel/Agents-A1-GGUF

Text Generation • 35B • Updated about 9 hours ago • 36.6k • 15

Bahushruth/Qwen3.6-27B-abliterated-GGUF

Image-Text-to-Text • 27B • Updated 7 days ago • 4.42k • 3

AlicanKiraz0/Seneca-Cybersecurity-LLM-Q4_K_M-GGUF

8B • Updated Mar 15, 2025 • 350 • 42

giladgd/Qwen3-Coder-30B-A3B-Instruct-Q4_K_M-GGUF

Text Generation • 31B • Updated Aug 8, 2025 • 4.8k • 4

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 8.92k • 321

Nguuma/security-slm-unsloth-1.5b

Text Generation • 2B • Updated May 7 • 2.13k • 44

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 10.5k • 52

DavidOKB/MathThink-Qwen-3.5-4B

4B • Updated Apr 12 • 99 • 8

Medvedko/Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC-Q4_K_M-GGUF

Text Generation • 12B • Updated about 1 month ago • 5.66k • 5

BennyDaBall/Krea-2-Engineer-V1-GGUF

Text Generation • 4B • Updated 21 days ago • 7.37k • 29

audarai/Audar-ASR-V1-Flash

Automatic Speech Recognition • 0.8B • Updated 9 days ago • 1.5k • 4

audarai/Audar-TTS-V1-Flash

Text-to-Speech • 0.6B • Updated 11 days ago • 321 • 4

GZGavinZhao/Leanstral-1.5-119B-A6B-GGUF

119B • Updated 12 days ago • 3.42k • 6

maczzzzzz/ThinkingCap-Qwen3.6-27B-TQ3_4S-GGUF

27B • Updated 7 days ago • 331 • 2