Distily Project

distily 's models 52

Sort:  Recently updated

distily/distily_smollm_dataset_sweep

81.4M • Updated Sep 30, 2024 • 419

distily/distily_tinyBenchmarks

81.4M • Updated Sep 23, 2024 • 23

distily/distily_learning_params

81.4M • Updated Sep 22, 2024 • 149

distily/distily_seq_len_batch_size

81.4M • Updated Sep 17, 2024 • 274

distily/distily_distsmollm_max_length

81.4M • Updated Sep 14, 2024 • 95

distily/distily_distsmollm_long

81.4M • Updated Sep 14, 2024 • 75

distily/distily_additional_profiling

Updated Sep 13, 2024

distily/distily_profile_smollm_tritoned

81.4M • Updated Sep 12, 2024 • 24

distily/distily_profile_smollm

81.4M • Updated Sep 12, 2024 • 53

distily/distily_verify_new_attns

81.9M • Updated Sep 12, 2024 • 133

distily/distily_verify_new_attns2

81.9M • Updated Sep 12, 2024 • 35

distily/distily_performance_tests

81.9M • Updated Sep 12, 2024 • 11

distily/distily_long_dataset_sweep

81.9M • Updated Sep 11, 2024 • 108

distily/distily_dataset_sweep

81.9M • Updated Sep 9, 2024 • 109

distily/distily_smollm_liger_test

Updated Sep 9, 2024

distily/distily_attn_mlp_sweep

81.9M • Updated Sep 7, 2024 • 113

distily/distily_verify_update9

81.9M • Updated Sep 4, 2024 • 9

distily/distily_verify_update8

81.9M • Updated Sep 4, 2024 • 9

distily/distily_verify_update7

81.9M • Updated Sep 4, 2024 • 13

distily/distily_norm_affine_distilgpt2_sweep2

81.9M • Updated Sep 4, 2024 • 18

distily/distily_norm_affine_distilgpt2_sweep

81.9M • Updated Sep 4, 2024 • 12

distily/distily_grad_log_perf

81.9M • Updated Sep 3, 2024 • 14

distily/distily_norm_distilgpt2_sweep_extended

81.9M • Updated Sep 3, 2024 • 62

distily/distily_validate_extra_grad_stats5

81.9M • Updated Sep 2, 2024 • 14

distily/distily_validate_extra_grad_stats4

81.9M • Updated Sep 2, 2024 • 9

distily/distily_validate_extra_grad_stats3

81.9M • Updated Sep 2, 2024 • 17

distily/distily_validate_extra_grad_stats2

81.9M • Updated Sep 2, 2024 • 10

distily/distily_validate_extra_grad_stats

81.9M • Updated Sep 2, 2024 • 22

distily/distily_dummy

81.9M • Updated Sep 2, 2024 • 10

distily/distily_norm_distilgpt2_sweep

81.9M • Updated Sep 1, 2024 • 49