Article
OpenRouter Leaderboard: 425 Models by Price, Measured Speed and Korean Quality
ginigen-ai
ā¢ ā¢ 12
KIM MS
VIDRAFT-lab
AI & ML interests
None yet
Recent Activity
upvoted an article 1 day ago
OpenRouter Leaderboard: 425 Models by Price, Measured Speed and Korean Quality liked a Space 1 day ago
ginigen-ai/open-router-leaderboard reacted to ginigen-ai's post with š 1 day ago
OpenRouter Leaderboard ā every model, every provider, one comparable table. Price, precision, uptime, measured latency and language quality on the same axes.
Building it turned up three things.
We graded 330 models on Korean and two axes collapsed.
Honorifics ā only 8.5% earn an A
Knowledge of Korean institutions ā 9.4%
Every other axis sits above 31%
Fluency hides it. A model can write clean, natural Korean and still attach an honorific to a coffee cup. Fluent and wrong at the same time is worse than obviously broken, because nobody catches it in review.
A 2023 model beats the 2026 flagships. gpt-3.5-turbo-16k scores a perfect 3.00. Korean cannot be inferred from release date, parameter count or English benchmarks ā it has to be measured, per model.
Quality, value and speed are three different models. Across five axes, the same model almost never takes two columns.
425 models, latency measured on 329 on a paid API, Korean graded on 330. Three languages, three currencies, daily refresh, open API, no key.
š https://huggingface.co/blog/ginigen-ai/openrouter-leaderboard š https://huggingface.co/spaces/ginigen-ai/open-router-leaderboardOrganizations
None yet
upvoted an article 1 day ago
liked a
Space 1 day ago
reacted to ginigen-ai's post with š 1 day ago
Post
1050
OpenRouter Leaderboard ā every model, every provider, one comparable table. Price, precision, uptime, measured latency and language quality on the same axes.
Building it turned up three things.
We graded 330 models on Korean and two axes collapsed.
Honorifics ā only 8.5% earn an A
Knowledge of Korean institutions ā 9.4%
Every other axis sits above 31%
Fluency hides it. A model can write clean, natural Korean and still attach an honorific to a coffee cup. Fluent and wrong at the same time is worse than obviously broken, because nobody catches it in review.
A 2023 model beats the 2026 flagships. gpt-3.5-turbo-16k scores a perfect 3.00. Korean cannot be inferred from release date, parameter count or English benchmarks ā it has to be measured, per model.
Quality, value and speed are three different models. Across five axes, the same model almost never takes two columns.
425 models, latency measured on 329 on a paid API, Korean graded on 330. Three languages, three currencies, daily refresh, open API, no key.
š https://huggingface.co/blog/ginigen-ai/openrouter-leaderboard š ginigen-ai/open-router-leaderboard
Building it turned up three things.
We graded 330 models on Korean and two axes collapsed.
Honorifics ā only 8.5% earn an A
Knowledge of Korean institutions ā 9.4%
Every other axis sits above 31%
Fluency hides it. A model can write clean, natural Korean and still attach an honorific to a coffee cup. Fluent and wrong at the same time is worse than obviously broken, because nobody catches it in review.
A 2023 model beats the 2026 flagships. gpt-3.5-turbo-16k scores a perfect 3.00. Korean cannot be inferred from release date, parameter count or English benchmarks ā it has to be measured, per model.
Quality, value and speed are three different models. Across five axes, the same model almost never takes two columns.
425 models, latency measured on 329 on a paid API, Korean graded on 330. Three languages, three currencies, daily refresh, open API, no key.
š https://huggingface.co/blog/ginigen-ai/openrouter-leaderboard š ginigen-ai/open-router-leaderboard
liked 3
models 3 days ago
upvoted a collection 3 days ago
upvoted an article 3 days ago
Article
Same bytes, closer to the original: two lines of AutoRound we had wrong
FINAL-Bench
ā¢ ā¢ 12 liked a
Space 4 days ago
reacted to SeaWolf-AI's post with š 4 days ago
Post
5537
Instead of making the fly brain play games, we measured what it is for
Since the Drosophila connectome was released, people have had the fly brain doomscroll a feed, play Beat Saber, drive in GTA. Those demos show that the brain runs. We wanted to show what it is for.
So we gave it a looming object ā one of the few things a fly brain is unambiguously built to detect ā then deleted a single cell type and repeated the identical stimulus. Remove LC4, 126 cells out of 173,023, and the escape signal falls from 0.840 to 0.091. Eighty-nine percent of the danger signal is gone while the other 172,897 neurons run exactly as before.
Deleting neurons does not do this on its own, which is the whole point of the controls. LC11 is the same class and larger than LC4 ā 143 cells and 9,940 outgoing connections against 126 and 7,846 ā and removing every one of them changes the signal by 0.000000, to six decimal places. It has to be those 126.
No server and no GPU: a looming stimulus drives fewer than one percent of neurons above threshold, so the whole thing is 40 KB gzipped and runs in your browser.
Try deleting one yourself ā
VIDraft/fruitfly-brain
The wiring is the measured connectome, but synaptic strength is a uniform count-based value and the dynamics are a firing-rate model of our choosing ā a total-effect measurement of a model, not a recording from a fly. Male CNS connectome, FlyEM / HHMI Janelia with Google Research, Columbia and Harvard (2026), CC BY.
Since the Drosophila connectome was released, people have had the fly brain doomscroll a feed, play Beat Saber, drive in GTA. Those demos show that the brain runs. We wanted to show what it is for.
So we gave it a looming object ā one of the few things a fly brain is unambiguously built to detect ā then deleted a single cell type and repeated the identical stimulus. Remove LC4, 126 cells out of 173,023, and the escape signal falls from 0.840 to 0.091. Eighty-nine percent of the danger signal is gone while the other 172,897 neurons run exactly as before.
Deleting neurons does not do this on its own, which is the whole point of the controls. LC11 is the same class and larger than LC4 ā 143 cells and 9,940 outgoing connections against 126 and 7,846 ā and removing every one of them changes the signal by 0.000000, to six decimal places. It has to be those 126.
No server and no GPU: a looming stimulus drives fewer than one percent of neurons above threshold, so the whole thing is 40 KB gzipped and runs in your browser.
Try deleting one yourself ā
VIDraft/fruitfly-brain
The wiring is the measured connectome, but synaptic strength is a uniform count-based value and the dynamics are a firing-rate model of our choosing ā a total-effect measurement of a model, not a recording from a fly. Male CNS connectome, FlyEM / HHMI Janelia with Google Research, Columbia and Harvard (2026), CC BY.