YMRohit/icml2026-22249-self-distillation-logbook-artifacts
11.7 MB
Rohit Yelukati Mahendra PRO
YMRohit
AI & ML interests
None yet
Recent Activity
updated a Space about 20 hours ago
YMRohit/icml2026-22249-self-distillation-logbook updated a bucket about 20 hours ago
YMRohit/icml2026-22249-self-distillation-logbook-artifacts updated a dataset about 21 hours ago
YMRohit/icml2026-64918-memorybench-repro-resultsOrganizations
Posts 1
Post
3060
A 1B model that writes GPU kernels you can trust
I fine-tuned OpenBMB's MiniCPM5-1B to write Triton GPU kernels, then let an immutable referee decide if they are real: compile, check correctness against PyTorch on adversarial inputs, time against eager, torch.compile, and torch.compile max-autotune, then block the known ways of gaming the benchmark.
The 1B setup beat torch.compile max-autotune in 12/12 independently seeded runs. The larger Qwen3.6-27B smith pushed the same referee loop further: 76 verified compiler-beating kernels on H200, with 69 surviving a 5-run stability gate and 7 kept as single-shot probes on unseen problems. On a 376-cell shape/dtype grid, the stability-gated kernels keep a 1.49x geomean, with about 10% of cells losing and reported per cell.
Honest bound: these are scheduling wins on memory-bound ops, not new algorithms or wins over cuBLAS/FlashAttention. The scarce thing is not the big model, it is the verifier it cannot fool.
Full write-up: https://huggingface.co/blog/YMRohit/ouroboros-kernel-mint
Try it: build-small-hackathon/ouroboros-kernel-mint
2-min demo: https://youtu.be/ViicZHktb-A
Built for #BuildSmallHackathon with MiniCPM, Qwen, Triton, Gradio, Codex, and Modal H200s.
I fine-tuned OpenBMB's MiniCPM5-1B to write Triton GPU kernels, then let an immutable referee decide if they are real: compile, check correctness against PyTorch on adversarial inputs, time against eager, torch.compile, and torch.compile max-autotune, then block the known ways of gaming the benchmark.
The 1B setup beat torch.compile max-autotune in 12/12 independently seeded runs. The larger Qwen3.6-27B smith pushed the same referee loop further: 76 verified compiler-beating kernels on H200, with 69 surviving a 5-run stability gate and 7 kept as single-shot probes on unseen problems. On a 376-cell shape/dtype grid, the stability-gated kernels keep a 1.49x geomean, with about 10% of cells losing and reported per cell.
Honest bound: these are scheduling wins on memory-bound ops, not new algorithms or wins over cuBLAS/FlashAttention. The scarce thing is not the big model, it is the verifier it cannot fool.
Full write-up: https://huggingface.co/blog/YMRohit/ouroboros-kernel-mint
Try it: build-small-hackathon/ouroboros-kernel-mint
2-min demo: https://youtu.be/ViicZHktb-A
Built for #BuildSmallHackathon with MiniCPM, Qwen, Triton, Gradio, Codex, and Modal H200s.
spaces 12
Running
Repro - Optimal Unconstrained Self-Distillation in Ridge Regression
🔬
Explore and collaborate on project logbooks online
Running
Repro - d3LLM: Ultra-Fast Diffusion LLM using Pseudo-Trajectory Distillation
🎯
Browse and share experiment logs with a coding agent
Running
Repro - Efficiently Training Time-to-First-Spike SNNs from Scratch
🧪
Explore and sync experiment logs with an AI coding agent
Paused
Agents
Icml61269 D3llm
🎯
Running
Repro - Combinatorial Sparse PCA Beyond the Spiked Identity Model
🔬
Explore and organize your research logbook
Running
Repro - Scaling Laws for Precision in High-Dimensional Linear Regression
📐
Explore research logbook and sync with coding agent
models 16
YMRohit/ouroboros-kernelsmith-minicpm5-1b
Text Generation • Updated • 8
YMRohit/ouroboros-kernelsmith-minicpm5-1b-GGUF
Text Generation • 1B • Updated • 84 • 1
YMRohit/ouroboros-kernelsmith-qwen3.6-27b
Text Generation • Updated
YMRohit/rohit-portfolio-lfm25-350m-onnx
Text Generation • Updated • 4
YMRohit/smollm-135m-funcalling-rl-gpo
Updated
YMRohit/qwen0.5reasoning
Updated
YMRohit/GRPO-latest-checkpoint
Updated
YMRohit/sqltest
Updated
YMRohit/Llama-3.2-11B-Vision-Instruct-Radiology
Updated
YMRohit/Qwen2-VL-7B-Instruct-Radiology-Mini
Updated
datasets 6
YMRohit/icml2026-64918-memorybench-repro-results
Preview • Updated
YMRohit/icml2026-61269-d3llm-repro-results
Updated
YMRohit/icml20531-adam-degenerate-repro
Updated
YMRohit/icml17708-grok-grokking-repro
Updated
YMRohit/ouroboros-kernel-corpus
Viewer • Updated • 2.46k • 102 • 1
YMRohit/EmotionReasoning
Viewer • Updated • 20k • 95