QuantLLM/Qwen2.5-7B-Instruct-MLX
8B • Updated • 56
QuantLLM
non-profit
AI & ML interests
QuantLLM is an open-source community exploring AI and ML through practical models and real-world applications.
Recent Activity
View all activity
QuantLLM/Qwen2.5-7B-Instruct-ONNX
Updated • 43
QuantLLM/Qwen2.5-7B-Instruct-SafeTensors
8B • Updated • 47
QuantLLM/Qwen2.5-7B-Instruct-GGUF
8B • Updated • 198
QuantLLM/Phi-3.5-mini-instruct-MLX
4B • Updated • 20
QuantLLM/Phi-3.5-mini-instruct-ONNX
Updated
QuantLLM/Phi-3.5-mini-instruct-SafeTensors
4B • Updated • 40
QuantLLM/Phi-3.5-mini-instruct-GGUF
4B • Updated • 127
QuantLLM/TinyLlama-1.1B-Chat-GGUF
1B • Updated • 84
QuantLLM/SmolLM2-135M-QuantLLM
Text Generation • 0.1B • Updated • 15
QuantLLM/SmolLM2-135M-GGUF
0.1B • Updated • 47
QuantLLM/Qwen3-0.6B-2bit-gguf
0.6B • Updated • 11
QuantLLM/Qwen3-0.6B-8bit-gguf
0.6B • Updated • 5
QuantLLM/Qwen3-0.6B-4bit-gguf
0.6B • Updated • 13
QuantLLM/Meta-Llama-3-70B-Instruct-4bit-gguf
Text Generation • 71B • Updated • 11 • 1
QuantLLM/functiongemma-270m-it-4bit-mlx
Text Generation • 0.3B • Updated • 13
QuantLLM/functiongemma-270m-it-4bit-gguf
0.3B • Updated • 18
QuantLLM/functiongemma-270m-it-8bit-gguf
0.3B • Updated • 8 • 1
QuantLLM/Llama-3.2-3B-2bit-gguf
3B • Updated • 24
QuantLLM/Llama-3.2-3B-5bit-gguf
3B • Updated • 14
QuantLLM/Llama-3.2-3B-5bit-mlx
Text Generation • 3B • Updated • 17
QuantLLM/Llama-3.2-3B-8bit-mlx
Text Generation • 3B • Updated • 33
QuantLLM/Llama-3.2-3B-2bit-mlx
Text Generation • 3B • Updated • 8
QuantLLM/Llama-3.2-3B-4bit-mlx
Text Generation • 3B • Updated • 12