SSH PRO

nvidia

I didn't know it was based off of ornith, that's pretty neat!
You can also make some more datasets. Every dataset you've made seems to be perfect quality somehow, and all of them do well.

While I'm here, how do you generate your datasets?
I thought it'd be cool to do something similar to what you do with grug for a custom finetune, and I have no idea how to generate a dataset anywhere near your 1m for grug v1.1.

Do you open source them (or the big one eventually?)

It is pretty much all synthetic data. It is very easy for me to generate data with AI because of my pro 6000 (can get 4500 tokens a sec on qwen 3.8 27b aggregate) but before then i just used gpt 5.6 luna through a codex subscription and that's it.

Grug 35b v1 didn’t get that much demand even though it was based off ornith 1 but I might do this! Thanks for suggestion

Matbe

Random side project