melhoushi/slimpj_h2048_d40_gbs200_tpp30.0_warmup602_lp0.8_linear_linear_reverse
Updated
•
4
Mostafa Elhoushi
melhoushi
AI & ML interests
Make ML faster, smaller, smarter.
Recent Activity
published
a model
1 day ago
melhoushi/slimpj_h2048_d40_gbs200_tpp30.0_warmup602_lp0.8_linear_linear_reverse
published
a model
1 day ago
melhoushi/slimpj_h1536_d30_gbs136_tpp20.0_warmup602_lp0.6_linear_linear_reverse
updated
a model
1 day ago
melhoushi/slimpj_h2048_d40_gbs200_tpp30.0_warmup602_lp0.8_linear_linear_reverse
Organizations
melhoushi/slimpj_h2048_d40_gbs200_tpp30.0_lp0.0_uniform
Updated
•
15
melhoushi/slimpj_h1536_d30_gbs136_tpp20.0_warmup602_lp0.6_linear_linear_reverse
Updated
•
42
melhoushi/slimpj_h1152_d23_gbs124_tpp64.0_lp0.4_linear_linear_reverse
Updated
•
14
melhoushi/slimpj_h1152_d23_gbs124_tpp64.0_lp0.0_uniform
Updated
•
18
melhoushi/slimpj_h896_d17_gbs182_tpp256.0_lp0.2_linear_linear_reverse
Updated
•
14
melhoushi/slimpj_h896_d17_gbs182_tpp256.0_lp0.0_uniform
Updated
•
16
melhoushi/slimpj_h1152_d23_nh9_dhqk128_dhv128_ffnmult8_gbs76_tpp20.0_29117steps
Updated
•
291
melhoushi/slimpj_h640_d13_nh10_dhqk64_dhv64_ffnmult8_gbs48_tpp20.0_13773steps_lp0.4_row_null_linear
Updated
•
199
melhoushi/slimpj_h1152_d23_nh9_dhqk128_dhv128_ffnmult8_gbs76_tpp20.0_29117steps_layer_prob0.4
Updated
•
106
melhoushi/gpt_h2048_d40_gbs200_tpp30.0_lp0.0_uniform
Updated
•
12
melhoushi/gpt_h1536_d30_gbs136_tpp20.0_lp0.0_uniform
Updated
•
21
melhoushi/gpt_h1152_d23_gbs124_tpp64.0_lp0.0_uniform
Updated
•
7
melhoushi/gpt_h896_d17_gbs182_tpp256.0_lp0.2_linear_linear_reverse
Updated
•
10
melhoushi/gpt_h896_d17_gbs182_tpp256.0_lp0.0_uniform
Updated
•
10
melhoushi/gpt_h1152_d23_gbs124_tpp64.0_lp0.4_linear_linear_reverse
Updated
•
50
melhoushi/nanogpt-2025-12-13-recurrent-small-2-10-pool
Updated
melhoushi/slimpj_h640_d13_nh10_dhqk64_dhv64_ffnmult8_gbs48_tpp20.0_13773steps_dmup1215_depthsupar_pol1_v2
Updated
•
696
•
1
melhoushi/celerity_270m_20tpp
Text Generation
•
0.3B
•
Updated
•
1
melhoushi/celerity_906m_20tpp_0.4ld_linear
Updated
•
4
melhoushi/celerity_906m_20tpp
Updated
•
4
melhoushi/layerskip-Llama-3.2-1B-top_v2
1B
•
Updated
•
5
melhoushi/layerskip-Llama-2-7b-hf-top_v2
Updated
melhoushi/layerskip-SmolLM2-135M-top_v2
0.1B
•
Updated
•
1
melhoushi/layerskip-huggingface-smollm2-135m-topv1
0.1B
•
Updated
•
2
melhoushi/layerskip-huggingface-smollm-135m-topv1
0.1B
•
Updated
•
2
melhoushi/layerskip-llama3.2-1b-topv1
1B
•
Updated
•
2
melhoushi/layerskip-llama2-7b-topv1
Updated
melhoushi/exitskip-llama2-7b-topv1-v1
7B
•
Updated
•
1
melhoushi/layerskip-huggingface-smollm-135m-topv1-v2
0.1B
•
Updated
•
1