🌐 Q-Omni MLX — Qwen 2.5 3B Cagatay (4-bit)
A 4-bit quantized MLX model for Apple Silicon — fine-tuned for voice commands and robotics reasoning.
6.2 GB → 1.7 GB | 4-bit | Runs on MacBook Air
🚀 Use with Strands Agents + MLX
from strands import Agent
from strands_mlx import MLXModel
model = MLXModel(model_id="cagataydev/Qwen2.5-Omni-3B-cagatay-4bit")
agent = Agent(model=model)
agent("Listen to the voice command and plan the robot's next action")
📊 Model Details
| Property | Value |
|---|---|
| Base Model | Qwen/Qwen2.5-3B-Instruct |
| Fine-tune | cagataydev/qwen2.5-omni-3b-cagatay (LoRA) |
| Quantization | 4-bit MLX (group size 64) |
| Size | 1.7 GB |
| Platform | Apple Silicon (M1/M2/M3/M4) |
📦 Q-Model Family
| Model | Size | Quantized | Use Case |
|---|---|---|---|
| 🌐 Q-Omni (this) | 3B | 1.7 GB | Voice & multimodal |
| 🐤 Q-Tiny | 4B | 2.4 GB | Task planning |
| 🧠 Q-Brain | 35B MoE | — | Complex reasoning |
Built with DevDuck 🦆 and Strands Agents 🧬
- Downloads last month
- 14
Model size
0.5B params
Tensor type
F16
·
U32 ·
Hardware compatibility
Log In to add your hardware
4-bit