JANGQ-AI/DeepSeek-V4-Flash-0731-JANG
Text Generation • 31B • Updated • 266 • 3
Crypti
CryptoAIM
AI & ML interests
None yet
Recent Activity
liked a model about 1 hour ago
JANGQ-AI/DeepSeek-V4-Flash-0731-JANG liked a dataset 2 days ago
greghavens/kimi-k3-coding-and-debugging-traces liked a model 3 days ago
unsloth/Kimi-K3-GGUFOrganizations
None yet
liked a
model about 1 hour ago
liked a
dataset 2 days ago
liked a
model 3 days ago
liked 2
models 4 days ago
reacted to appvoid's post with 🔥 4 days ago
Post
1382
A Small Model is All You Need. Meet
After 3 years of experiments, we are finally releasing our flagship tiny model: **palmer-006**.
If you are building for edge hardware, SBCs (Raspberry Pi, etc.), or low-power devices, this is for you. Inspired by Andrej Karpathy's idea of a self-contained "cognitive core," we wanted to see how much power we could pack into a sub-100M parameter footprint.
🧠 **How we "Palmerized" it:**
We believe in starting our experiments with the absolute strongest baseline possible.
1. Light fine-tuning on highly curated data
2. Model merging
3. Another light fine-tuning round
4. Adjusted Mamba for maximum token speed ⚡️
⚠️ *Note: This is a foundational language model. It has not been instruction-tuned yet!*
Also, since this needs instruction tuning next to become a chat assistant—**what dataset would you recommend we use for the instruct tune?**
---
🔗 **Quick Links & Info:**
* **License:** Open for research, education, hobby, and modification! (For commercial use/hosted APIs, shoot an email to nosoyhackercodigo@gmail.com. *PS: Donators can claim a free commercial license!*)
* **Attribution:** Built using AI tech from the Technology Innovation Institute (TII).
Can't wait to see what you build at the edge. Let me know your prompt completions below! 👇
appvoid/palmer-006
palmer-006 (90M)After 3 years of experiments, we are finally releasing our flagship tiny model: **palmer-006**.
If you are building for edge hardware, SBCs (Raspberry Pi, etc.), or low-power devices, this is for you. Inspired by Andrej Karpathy's idea of a self-contained "cognitive core," we wanted to see how much power we could pack into a sub-100M parameter footprint.
🧠 **How we "Palmerized" it:**
We believe in starting our experiments with the absolute strongest baseline possible.
1. Light fine-tuning on highly curated data
2. Model merging
3. Another light fine-tuning round
4. Adjusted Mamba for maximum token speed ⚡️
⚠️ *Note: This is a foundational language model. It has not been instruction-tuned yet!*
Also, since this needs instruction tuning next to become a chat assistant—**what dataset would you recommend we use for the instruct tune?**
---
🔗 **Quick Links & Info:**
* **License:** Open for research, education, hobby, and modification! (For commercial use/hosted APIs, shoot an email to nosoyhackercodigo@gmail.com. *PS: Donators can claim a free commercial license!*)
* **Attribution:** Built using AI tech from the Technology Innovation Institute (TII).
Can't wait to see what you build at the edge. Let me know your prompt completions below! 👇
appvoid/palmer-006
- 10 replies
liked 2
datasets 4 days ago
liked a
model 8 days ago
liked a
dataset 8 days ago
liked a
model 9 days ago
liked a
dataset 10 days ago
liked a
model 10 days ago
liked a
dataset 11 days ago
New activity in Manusagents/GPT-5.5-Gemini-3.1-Pro-Grok-4-Claude-Fable-5-Mythos-5-Qwen-3.7-Max-and-more-Distillation-Dataset 12 days ago
multiple (potential) contaminations
👍 3
2
#3 opened 12 days ago
by CryptoAIM
liked 2
datasets 12 days ago
liked 2
datasets 15 days ago
liked a
model 15 days ago
