Final Models from the paper - ClimateModernBERT
Shantam
sraj
AI & ML interests
NLP, LLMs
Recent Activity
updated a collection 10 days ago
ClimateModernBERT updated a collection 10 days ago
ClimateModernBERT updated a collection 10 days ago
ClimateModernBERTOrganizations
models 73
sraj/Merge_Linear_Fhalf_CX_only
Fill-Mask • 0.1B • Updated • 48
sraj/Merge_Linear_NormBalanced_CX_only
Fill-Mask • 0.1B • Updated • 41
sraj/Merge_Linear_CX_only
Fill-Mask • 0.1B • Updated • 59
sraj/Llama-3.1-8B_sft_2026_n10_minlikes3_stories11425_2_epoch_1e-5lr
8B • Updated • 15
sraj/Llama-3.1-8B_sft_dataset_minlikes3_max10perprompt_top_likes_2_epoch_3e-6lr
8B • Updated • 17
sraj/CMB_FWEdu_V2_FastTxt_MARK_CX
0.1B • Updated • 3
sraj/CMB_FWEdu_V2_FastTxt_MARK_CX_LRD
0.1B • Updated • 7
sraj/CMB_FWEdu_V2_FastTxt_MARK_SYN_CX_LRD
0.1B • Updated • 4
sraj/Merge_Linear_Fhalf
Fill-Mask • 0.1B • Updated • 5
sraj/Merge_Linear_A3x
Fill-Mask • 0.1B • Updated • 3
datasets 7
sraj/zyda_arxiv-climate-v1
Viewer • Updated • 12.3k • 15
sraj/finewebedu-climate-v2
Viewer • Updated • 2.59M • 101
sraj/finewebedu-climate
Viewer • Updated • 614k • 24
sraj/fineweb-climate-test-conly
Viewer • Updated • 87 • 14
sraj/fineweb_climate_demo_sc
Viewer • Updated • 9 • 14
sraj/fineweb-climate-test
Viewer • Updated • 156 • 13
sraj/fineweb_climate_demo
Viewer • Updated • 9 • 17