Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,016

Base only

Active filters: quantization

tzervas/qwen2.5-coder-14b-bitnet-1.58b

Text Generation • 4B • Updated Jan 29 • 6.41k • 5

EricRollei/HunyuanImage-3.0-Instruct-Distil-INT8-v2

Text-to-Image • 83B • Updated Feb 22 • 108 • 8

embedl/sam3

Updated May 25 • 32 • 7

tonera/Qwen3-text-Nunchaku

Updated Apr 9 • 24.8k • 8

arjunbroepic/edgy-commenter-GGUF

Text Generation • 0.8B • Updated Mar 30 • 28 • 2

Neural-ICE/Gemma-4-E2B-it-NVFP4

Text Generation • 4B • Updated Apr 8 • 2.73k • 3

ebircak/gemma-4-31B-it-GGUF

Text Generation • 31B • Updated Apr 9 • 153 • 2

sphaela/Qwen3.6-35B-A3B-AutoRound-GGUF

36B • Updated 18 days ago • 3.27k • 18

sphaela/Qwen3.6-27B-AutoRound-GGUF

27B • Updated Jun 17 • 5.87k • 35

EnsueAI/DeepSeek-V4-Flash-Base-INT4

Updated Apr 26 • 7

keithnull/Qwen3.6-VL-REAP-26B-A3B-GGUF

Image-Text-to-Text • 27B • Updated May 5 • 2.2k • 6

lyf/Qwen3.6-27B-heretic-v2-mtp-int4-AutoRound

Image-Text-to-Text • 3B • Updated Apr 28 • 1.37k • 10

AEON-7/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-NVFP4

Any-to-Any • 20B • Updated 3 days ago • 3.31k • 9

hipfire-models/qwen3.6-27b-dev

Updated Jun 15 • 1

webhie/Qwen3.6-27B-int4-AutoRound-Code

Image-Text-to-Text • 6B • Updated May 12 • 23.1k • 17

Abiray/Anima-base-v1.0-GGUF

Text-to-Image • 2B • Updated May 14 • 2.28k • 9

YTan2000/Qwen3.6-35B-A3B-MTP-TQ3_4S

Image-Text-to-Text • 0.4B • Updated May 20 • 907 • 17

AMAImedia/Qwen3-8B-Guard-Gen-NOESIS-AWQ-INT4

Text Generation • 8B • Updated May 17 • 14 • 2

kizuna-intelligence/Command-A-Plus-Lite

Updated May 22 • 1

dangvansam/chandra-ocr-2-NVFP4A16

Image-Text-to-Text • 3B • Updated May 26 • 975 • 1

TheStageAI/gemma-4-E2B-it

Image-Text-to-Text • Updated Jun 2 • 158 • 5

TheStageAI/gemma-4-E4B-it

Image-Text-to-Text • Updated Jun 2 • 123 • 10

poolside-laguna-hackathon/Piscina-XS.2-GGUF

Text Generation • 33B • Updated May 30 • 809 • 8

Tivaphraen/LFM2-8B-A1B-Instruct-QwenDistill

Text Generation • 8B • Updated 11 days ago • 54 • 1

ArnavKewalram/gemma-4-E2B-coder-v1

Text Generation • 5B • Updated 27 days ago • 847 • 2

Mapika/GLM-5.2-NVFP4

Text Generation • 379B • Updated Jun 17 • 8.7k • 6

vinpix/Bonsai-8B-llama.cpp

Text Generation • 8B • Updated 6 days ago • 1.92k • 5

tonera/FLUX.2-klein-4B-Nunchaku

Image-to-Image • 4B • Updated 26 days ago • 515 • 4

donghyunli/Llama-2-7b-KronQ-W2A16

Text Generation • 2B • Updated 6 days ago • 1

wenshutang/ternlight

Sentence Similarity • Updated 10 days ago • 5