SSH PRO

nvidia

I didn't know it was based off of ornith, that's pretty neat!
You can also make some more datasets. Every dataset you've made seems to be perfect quality somehow, and all of them do well.

While I'm here, how do you generate your datasets?
I thought it'd be cool to do something similar to what you do with grug for a custom finetune, and I have no idea how to generate a dataset anywhere near your 1m for grug v1.1.

Do you open source them (or the big one eventually?)

It is pretty much all synthetic data. It is very easy for me to generate data with AI because of my pro 6000 (can get 4500 tokens a sec on qwen 3.8 27b aggregate) but before then i just used gpt 5.6 luna through a codex subscription and that's it.

Grug 35b v1 didn’t get that much demand even though it was based off ornith 1 but I might do this! Thanks for suggestion

Matbe

Random side project

Its very nicce too

thanks!

let me know how it goes!

@ProCreations can you run the thing when you have time? I put it in the dataset link above

I know I can’t do it right away lol

@ProCreations Or I can just put the code in a huggingface dataset and give you the link? Cuz I can’t have X where I live due to the under 16 age restriction.

yea that works too

nice

sooo you are one of the winners but i couldn't find you on X or your email so how can you send me the train script

results will all be open source or open weight yup, and the first winners project is now being trained am emailing the rest now

Also @ProCreations I submitted but I realized I can train locally faster with optimization, if I won give it to someone else!

Alright thanks for letting me know

only like 7 lol

@ProCreations Custom MoE 4.02 Billion parameters but only a few active like 300M active.

Dang that is big yea lol