Distily Project

distily 's models 52

Sort:  Recently updated

distily/distily_attn_distilgpt2_sweep

81.9M • Updated Aug 31, 2024 • 29

distily/distily_test_attn_ortho_whiteners

0.1B • Updated Aug 29, 2024 • 18

distily/distily_attn_big_cross

0.1B • Updated Aug 29, 2024 • 3

distily/distily_test_attn_ortho

0.1B • Updated Aug 28, 2024 • 10

distily/distily_test_attn_ortho_whiten

Updated Aug 28, 2024

distily/distily_attn_big_cross_low_lr

Updated Aug 27, 2024

distily/distily_test_attn_identity

0.1B • Updated Aug 26, 2024 • 10

distily/distily_test_attn_mlp

0.1B • Updated Aug 26, 2024 • 12

distily/distily_test_attn_miles

0.1B • Updated Aug 26, 2024 • 16

distily/distily_test_attn_linear

0.1B • Updated Aug 25, 2024 • 12

distily/distily_multi_attn_experiment_miles

0.1B • Updated Aug 24, 2024 • 3

distily/distily_multi_attn_experiment_ortho

0.1B • Updated Aug 24, 2024 • 5

distily/distily_verify_compile

0.1B • Updated Aug 24, 2024 • 3

distily/verify_v0.3.0

0.1B • Updated Aug 23, 2024 • 10

distily/distily_multi_experiment

0.1B • Updated Aug 23, 2024 • 24

distily/distily_miles_projector_experiment

0.1B • Updated Aug 23, 2024 • 3

distily/distily_projector_experiment

0.1B • Updated Aug 22, 2024 • 21

distily/short_gpt2

81.9M • Updated Aug 22, 2024 • 10

distily/distily_bitnet_gpt2

0.1B • Updated Aug 22, 2024 • 13

distily/distily_TinyStories-33M_freeze_emb

68.5M • Updated Aug 15, 2024 • 4

distily/distily_TinyStories-33M_hs_attn

68.5M • Updated Aug 15, 2024 • 3

distily/distily_TinyStories-33M

68.5M • Updated Aug 15, 2024 • 6