Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
- Website
- Community
- Solutions
Log In
Sign Up

Quant Factory

community

Activity Feed Request to join this org

AI & ML interests

None defined yet.

QuantFactory 's collections 9

IBM Granite 3.0

QuantFactory/granite-3.0-1b-a400m-base-GGUF

Text Generation • 1B • Updated Oct 21, 2024 • 104 • 4
QuantFactory/granite-3.0-1b-a400m-instruct-GGUF

Text Generation • 1B • Updated Oct 23, 2024 • 402 • 4
QuantFactory/granite-3.0-8b-instruct-GGUF

Text Generation • 8B • Updated Oct 21, 2024 • 157 • 2
QuantFactory/granite-3.0-2b-base-GGUF

Text Generation • 3B • Updated Oct 21, 2024 • 236 • 2

Collection of quantized version of Llama 3.2 models

QuantFactory/Llama-3.2-1B-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 932 • 10
QuantFactory/Llama-3.2-3B-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 612 • 16
QuantFactory/Llama-3.2-1B-Instruct-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 906 • 7
QuantFactory/Llama-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 1.04k • 16

Quantized versions of models by mistralai

QuantFactory/Mistral-Nemo-Instruct-2407-GGUF

12B • Updated Jul 26, 2024 • 1.06k • 51
QuantFactory/Mistral-Nemo-Base-2407-GGUF

12B • Updated Jul 22, 2024 • 857 • 20
QuantFactory/Mistral-Ita-7b-GGUF

Text Generation • 7B • Updated Jun 22, 2024 • 181
QuantFactory/Mistral-v0.3-Instruct-Matter-Slim-A-GGUF

Text Generation • 7B • Updated Jun 26, 2024 • 100 • 2

QuantFactory/Qwen2-7B-GGUF

Text Generation • 8B • Updated Jun 8, 2024 • 188 • 3
QuantFactory/Qwen2-7B-Instruct-GGUF

Text Generation • 8B • Updated Jun 8, 2024 • 94 • 3
QuantFactory/Qwen2-1.5B-GGUF

Text Generation • 2B • Updated Jun 8, 2024 • 299 • 3
QuantFactory/Qwen2-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Jun 8, 2024 • 364 • 1

QuantFactory/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 2.25k • 21
QuantFactory/Meta-Llama-3.1-8B-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 711 • 13
QuantFactory/Meta-Llama-3.1-8B-Claude-GGUF

8B • Updated Jul 26, 2024 • 177 • 1
QuantFactory/Meta-Llama-3-120B-Instruct-GGUF

Text Generation • 122B • Updated May 6, 2024 • 66 • 12

Space for requesting quants for models.

Runtime error

Agents

23

Quant Request

🦀

23

Submit Hugging Face model links for quantization requests

Collection of quantized versions of the latest Qwen 2.5 models

QuantFactory/Qwen2.5-0.5B-GGUF

Text Generation • 0.5B • Updated Sep 19, 2024 • 434 • 6
QuantFactory/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Sep 19, 2024 • 774 • 3
QuantFactory/Qwen2.5-1.5B-GGUF

Text Generation • 2B • Updated Sep 19, 2024 • 289 • 1
QuantFactory/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Sep 19, 2024 • 1.98k • 3

Quantizations of llama-3 models

QuantFactory/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • 8B • Updated Jan 23 • 13.7k • 331
QuantFactory/Meta-Llama-3-8B-GGUF

Text Generation • 8B • Updated Apr 20, 2024 • 1.7k • 115
QuantFactory/Meta-Llama-3-8B-Instruct-GGUF-v2

Text Generation • 8B • Updated May 6, 2024 • 444 • 15
QuantFactory/Meta-Llama-3-70B-Instruct-GGUF-v2

Text Generation • 71B • Updated May 6, 2024 • 411 • 16

Quantizations of ArliAI-Llama-3 models

QuantFactory/ArliAI-Llama-3-8B-Formax-v1.0-GGUF

Text Generation • 8B • Updated Jul 13, 2024 • 302 • 1
QuantFactory/ArliAI-Llama-3-8B-Argon-v1.0-GGUF

Text Generation • 8B • Updated Jul 13, 2024 • 86 • 1
QuantFactory/ArliAI-Llama-3-8B-Cumulus-v0.2-GGUF

Text Generation • 8B • Updated Jul 13, 2024 • 162 • 1
QuantFactory/ArliAI-Llama-3-8B-Instruct-Dolfin-v0.1-GGUF

Text Generation • 8B • Updated Jul 13, 2024 • 260 • 1

IBM Granite 3.0

QuantFactory/granite-3.0-1b-a400m-base-GGUF

Text Generation • 1B • Updated Oct 21, 2024 • 104 • 4
QuantFactory/granite-3.0-1b-a400m-instruct-GGUF

Text Generation • 1B • Updated Oct 23, 2024 • 402 • 4
QuantFactory/granite-3.0-8b-instruct-GGUF

Text Generation • 8B • Updated Oct 21, 2024 • 157 • 2
QuantFactory/granite-3.0-2b-base-GGUF

Text Generation • 3B • Updated Oct 21, 2024 • 236 • 2

Space for requesting quants for models.

Runtime error

Agents

23

Quant Request

🦀

23

Submit Hugging Face model links for quantization requests

Collection of quantized version of Llama 3.2 models

QuantFactory/Llama-3.2-1B-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 932 • 10
QuantFactory/Llama-3.2-3B-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 612 • 16
QuantFactory/Llama-3.2-1B-Instruct-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 906 • 7
QuantFactory/Llama-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 1.04k • 16

Collection of quantized versions of the latest Qwen 2.5 models

QuantFactory/Qwen2.5-0.5B-GGUF

Text Generation • 0.5B • Updated Sep 19, 2024 • 434 • 6
QuantFactory/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Sep 19, 2024 • 774 • 3
QuantFactory/Qwen2.5-1.5B-GGUF

Text Generation • 2B • Updated Sep 19, 2024 • 289 • 1
QuantFactory/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Sep 19, 2024 • 1.98k • 3

Quantized versions of models by mistralai

QuantFactory/Mistral-Nemo-Instruct-2407-GGUF

12B • Updated Jul 26, 2024 • 1.06k • 51
QuantFactory/Mistral-Nemo-Base-2407-GGUF

12B • Updated Jul 22, 2024 • 857 • 20
QuantFactory/Mistral-Ita-7b-GGUF

Text Generation • 7B • Updated Jun 22, 2024 • 181
QuantFactory/Mistral-v0.3-Instruct-Matter-Slim-A-GGUF

Text Generation • 7B • Updated Jun 26, 2024 • 100 • 2

Quantizations of llama-3 models

QuantFactory/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • 8B • Updated Jan 23 • 13.7k • 331
QuantFactory/Meta-Llama-3-8B-GGUF

Text Generation • 8B • Updated Apr 20, 2024 • 1.7k • 115
QuantFactory/Meta-Llama-3-8B-Instruct-GGUF-v2

Text Generation • 8B • Updated May 6, 2024 • 444 • 15
QuantFactory/Meta-Llama-3-70B-Instruct-GGUF-v2

Text Generation • 71B • Updated May 6, 2024 • 411 • 16

QuantFactory/Qwen2-7B-GGUF

Text Generation • 8B • Updated Jun 8, 2024 • 188 • 3
QuantFactory/Qwen2-7B-Instruct-GGUF

Text Generation • 8B • Updated Jun 8, 2024 • 94 • 3
QuantFactory/Qwen2-1.5B-GGUF

Text Generation • 2B • Updated Jun 8, 2024 • 299 • 3
QuantFactory/Qwen2-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Jun 8, 2024 • 364 • 1

Quantizations of ArliAI-Llama-3 models

QuantFactory/ArliAI-Llama-3-8B-Formax-v1.0-GGUF

Text Generation • 8B • Updated Jul 13, 2024 • 302 • 1
QuantFactory/ArliAI-Llama-3-8B-Argon-v1.0-GGUF

Text Generation • 8B • Updated Jul 13, 2024 • 86 • 1
QuantFactory/ArliAI-Llama-3-8B-Cumulus-v0.2-GGUF

Text Generation • 8B • Updated Jul 13, 2024 • 162 • 1
QuantFactory/ArliAI-Llama-3-8B-Instruct-Dolfin-v0.1-GGUF

Text Generation • 8B • Updated Jul 13, 2024 • 260 • 1

QuantFactory/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 2.25k • 21
QuantFactory/Meta-Llama-3.1-8B-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 711 • 13
QuantFactory/Meta-Llama-3.1-8B-Claude-GGUF

8B • Updated Jul 26, 2024 • 177 • 1
QuantFactory/Meta-Llama-3-120B-Instruct-GGUF

Text Generation • 122B • Updated May 6, 2024 • 66 • 12

Company

TOS Privacy About Careers

Website

Models Datasets Spaces Pricing Docs