inference-optimization/DSV4-tiny-empty
3B • Updated • 4.93k • 1
Models in CI
Models used in CI tests across llm-compressor, compressed-tensors, and vllm repositories.
-
-
inference-optimization/GLM-5.2-0.8B-A0.8B
Text Generation • 0.8B • Updated • 5.19k • 4 -
inference-optimization/Llama-3.2-0.5B-Instruct
Text Generation • 0.5B • Updated • 23.9k • 1 -
inference-optimization/Qwen3-1.6B-A0.9B
Text Generation • 2B • Updated • 14.1k • 3 -
inference-optimization/DeepSeek-V3-debug-add
1B • Updated • 34 -
inference-optimization/DeepSeek-V3-debug-add-FP8_DYNAMIC
1B • Updated • 6 -
inference-optimization/DeepSeek-V3-debug-add-NVFP4A16
0.9B • Updated • 5 -
inference-optimization/DeepSeek-V3-debug-empty
1B • Updated • 1.1k -
inference-optimization/DeepSeek-V3-debug-empty-FP8_DYNAMIC
1B • Updated • 5.01k -
inference-optimization/DeepSeek-V3-debug-empty-NVFP4A16
0.9B • Updated • 439 -
inference-optimization/DeepSeek-V3-debug-multiply
1B • Updated • 6 -
inference-optimization/DeepSeek-V3-debug-multiply-FP8_DYNAMIC
1B • Updated • 4 -
inference-optimization/DeepSeek-V3-debug-multiply-NVFP4A16
0.9B • Updated • 4 -
inference-optimization/Qwen3-0.6B-debug-add
0.6B • Updated • 3 -
inference-optimization/Qwen3-0.6B-debug-add-FP8_BLOCK
0.6B • Updated • 4 -
inference-optimization/Qwen3-0.6B-debug-add-W4A16-G128
0.6B • Updated • 7 -
inference-optimization/Qwen3-0.6B-debug-multiply
0.6B • Updated • 7 -
inference-optimization/Qwen3-0.6B-debug-multiply-FP8_BLOCK
0.6B • Updated • 4 -
inference-optimization/Qwen3-0.6B-debug-multiply-W4A16-G128
0.6B • Updated • 10 -
inference-optimization/Qwen3-0.6B-FP8_BLOCK
0.6B • Updated • 138 -
inference-optimization/Qwen3-0.6B-W4A16-G128
0.6B • Updated • 493 -
inference-optimization/Qwen3-8B-speculators.peagle-qwen3arch-ckpt4
2B • Updated • 7.41k • 1 -
inference-optimization/DeepSeek-R1-Distill-Llama-8B-NVFP4
Text Generation • 5B • Updated • 257 -
inference-optimization/Kimi-K3-0.40B-MXFP4
0.4B • Updated • 1.07k • 7 -
inference-optimization/GLM-5.3-Flash-0.1B-A0.1B
Image-Text-to-Text • 84.4M • Updated • 625 • 3