DavidAU/gemma-3-1b-it-heretic-abliterated-uncensored
Text Generation β’ 1.0B β’ Updated β’ 318 β’ β’ 11
Rev
Bredvige
Β·
AI & ML interests
None yet
Recent Activity
liked a model 3 months ago
DavidAU/gemma-3-1b-it-heretic-abliterated-uncensored liked a model 4 months ago
Malary/Mala-Anime-Mix-NSFW-PonyXL liked a model 5 months ago
AnhP/Vietnamese-RVC-ProjectOrganizations
None yet
liked a
model 3 months ago
liked a
model 4 months ago
liked a
model 5 months ago
liked a
Space 5 months ago
Create app.py
#1 opened 11 months ago
by 
emrealtay1
updated a
Space over 1 year ago
reacted to grimjim's post with π₯ over 1 year ago
Post
2873
I'm (finally) releasing a Python script that trims excess weights in Gemma2 full-weight models that bloated by ~1B parameters due to an early mergekit bug.
https://github.com/jim-plus/Gemma2-mergekit-remediation
I'd noticed something was off when merges of Gemma2 9B models ended up having ~10B parameters. The current mergekit package is fine, but there are still bloated models on HF that could stand to be fixed.
The script assumes that it will be run from the same directory as the model weights, and will trim the unnecessary lm_head.weight tensor and corresponding index entry.
https://github.com/jim-plus/Gemma2-mergekit-remediation
I'd noticed something was off when merges of Gemma2 9B models ended up having ~10B parameters. The current mergekit package is fine, but there are still bloated models on HF that could stand to be fixed.
The script assumes that it will be run from the same directory as the model weights, and will trim the unnecessary lm_head.weight tensor and corresponding index entry.
- 2 replies
updated a
model over 1 year ago
reacted to nroggendorff's post with π over 1 year ago
Post
3766
im so tired
- 3 replies
liked a
model over 1 year ago
updated 2
models over 1 year ago
