Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

llama-cpp-python

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

39

Base only

Active filters: llama-cpp-python

owao/Nanbeige4.2-3B-GGUF

Text Generation • 4B • Updated 28 days ago • 133k • 55

AeroxLabs/Aerova-Nova-2.5B-GGUF

Text Generation • 7B • Updated 1 day ago • 78 • 2

asumansaree/trendyol_llm_7b_chat_v1_0_gguf

Text Generation • 7B • Updated Jun 20, 2025 • 13

Sakalti/nekomata-7b-gguf

Text Generation • 8B • Updated Oct 17, 2024 • 15

erdemyavuz/llama-3-8b-chat-doctor

8B • Updated Mar 3 • 17 • 1

seasparks/Llama-3.1-8B-Instruct-LegalCite-gguf

Text Generation • 8B • Updated Apr 7, 2025 • 32

Prince-1/orpheus_3b_0.1_GGUF

Text-to-Speech • 3B • Updated May 1, 2025 • 275

marcorez8/llama-cpp-python-windows-blackwell-cuda

Updated Jun 2, 2025 • 4

dougeeai/llama-cpp-python-wheels

Updated Nov 9, 2025 • 12

terasut/typhoon-si-med-thinking-4b-research-preview-GGUF

Text Generation • 4B • Updated Jan 21 • 22

intrect/VELA

Text Generation • 8B • Updated Apr 1 • 176 • 3

Habibur2/Phi-3.5-mini-GGUF

Text Generation • 4B • Updated Jan 30 • 19

Habibur2/Qwen2.5-0.5B-GGUF

Text Generation • 0.5B • Updated Jan 30 • 86 • 1

Habibur2/Qwen2.5-Math-1.5B-GGUF

Text Generation • 2B • Updated Jan 31 • 20 • 2

chronorus/chatbot-poc

3B • Updated Feb 1 • 5

trajis-tech/llama-cpp-python-trajis-tech-nonavx512-cuda

ClaireLee2429/gemma-2b-recipes-gguf

Text Generation • 3B • Updated Feb 17 • 37

James040/llama-cpp-python-wheels

pushkarsharma/LegalSahayk_q4_k_m

Text Generation • 8B • Updated Mar 12 • 3

jeremygracey-ai/FetchMerck_AI

Text Generation • 7B • Updated Apr 23 • 39 • 1

AaryanK/ModelGate

Text Classification • 2B • Updated Mar 22 • 61 • 4

enwrit/writ-lint-0.8B

Text Generation • 0.8B • Updated Mar 25 • 11

ericflo/qwen3-0.6b-summarizer

Summarization • 0.6B • Updated Apr 5 • 87

kertpoli/lua-coder-qwen25-3b-gguf

Text Generation • 3B • Updated Apr 15 • 22

neuralbroker/blitzkode

Text Generation • 2B • Updated May 16 • 26

flwrlabs/Lizzy-7B-GGUF

Text Generation • 7B • Updated May 25 • 633 • 14

maytman12/s2s-complete-setup

Automatic Speech Recognition • Updated Apr 28 • 26 • 1

Theogott/spr-qwen3_5-9b-dora-vramsafe-gguf

Text Generation • 9B • Updated May 1 • 23 • 1

pragnyanramtha/gguf-chat-template-truncation-poc

1.03M • Updated May 12 • 8

Roopalgn/sahayak-tb-gemma4-e2b-gguf

Text Generation • 5B • Updated May 18 • 17