Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,097

Base only

Active filters: compression

kacaforyah/Opti-27B

Image-Text-to-Text • 27B • Updated 3 days ago • 1.64k • 10

unsloth/GLM-4.7-Flash-REAP-23B-A3B-GGUF

Text Generation • 23B • Updated Jan 28 • 26.7k • 275

Parda21/Qwen3-4B-NWC

Text Generation • 6B • Updated 5 days ago • 259 • 2

cyankiwi/GLM-4.7-Flash-REAP-23B-A3B-AWQ-8bit

Text Generation • 24B • Updated Jul 21 • 29 • 4

RepublicOfKorokke/GLM-4.7-Flash-REAP-23B-A3B-oQ3.5

Text Generation • 23B • Updated Mar 30 • 52 • 1

turintech/GLM-5.2-MaxMin108-GGUF

Text Generation • 325B • Updated 8 days ago • 534 • 6

Akicou/Qwen3.8-Flash-Next-REAM-60Pct

Text Generation • 129B • Updated 26 days ago • 613 • 7

Jeesup/svd-safety-l3_swift_remove30_swapgapiter_evfront_b010

Text Generation • 8B • Updated 3 days ago • 456 • 1

Parda21/Qwen3-0.6B-NWC

Text Generation • 0.8B • Updated 5 days ago • 243 • 1

Parda21/Qwen3-4B-NWC-fp8

Text Generation • 4B • Updated 5 days ago • 44 • 1

Jeesup/svd-safety-gemma2_9b_it_swift_remove20

Text Generation • 9B • Updated 3 days ago • 179 • 1

RedHatAI/oBERT-teacher-squadv1

Updated Jul 31, 2022 • 15

RedHatAI/oBERT-12-downstream-pruned-unstructured-80-squadv1

Updated Jul 31, 2022 • 15

RedHatAI/oBERT-12-downstream-pruned-unstructured-90-squadv1

Updated Jul 31, 2022 • 19

RedHatAI/oBERT-12-downstream-pruned-unstructured-97-squadv1

Updated Jul 31, 2022 • 27

RedHatAI/oBERT-teacher-mnli

Updated Jul 31, 2022 • 20

RedHatAI/oBERT-12-downstream-pruned-unstructured-80-mnli

Updated Jul 31, 2022 • 29

RedHatAI/oBERT-12-downstream-pruned-unstructured-90-mnli

Updated Jul 31, 2022 • 23

RedHatAI/oBERT-12-downstream-pruned-unstructured-97-mnli

Updated Jul 31, 2022 • 22

RedHatAI/oBERT-teacher-qqp

Updated Jul 31, 2022 • 48

RedHatAI/oBERT-12-downstream-pruned-unstructured-80-qqp

Updated Jul 31, 2022 • 24

RedHatAI/oBERT-12-downstream-pruned-unstructured-90-qqp

Updated Jul 31, 2022 • 24

RedHatAI/oBERT-12-downstream-pruned-unstructured-97-qqp

Updated Jul 31, 2022 • 22

RedHatAI/oBERT-12-upstream-pretrained-dense

Updated Jul 31, 2022 • 15

RedHatAI/oBERT-6-upstream-pretrained-dense

Updated Jul 31, 2022 • 14

RedHatAI/oBERT-3-upstream-pretrained-dense

Updated Jul 31, 2022 • 14

RedHatAI/oBERT-12-upstream-pruned-unstructured-90

Updated Jul 31, 2022 • 24

RedHatAI/oBERT-12-upstream-pruned-unstructured-97

Updated Jul 31, 2022 • 24

RedHatAI/oBERT-12-upstream-pruned-unstructured-90-finetuned-squadv1

Updated Jul 31, 2022 • 21

RedHatAI/oBERT-12-upstream-pruned-unstructured-97-finetuned-squadv1

Updated Jul 31, 2022 • 23