huggingface / smol-course

Duplication

Places in code with 6 or more lines that are exactly the same.

Longest Duplicates

The list of 50 longest duplicates.

See data for all 805,516 duplicates...

Size	#	Folders	Files	Lines	Code
8242	x 2	es/2_preference_alignment/notebooks pt-br/2_preference_alignment/notebooks	orpo_finetuning_example.ipynb orpo_finetuning_example.ipynb	403:8644 (95%) 402:8643 (95%)	view
8242	x 2	pt-br/2_preference_alignment/notebooks vi/2_preference_alignment/notebooks	orpo_finetuning_example.ipynb orpo_finetuning_example.ipynb	402:8643 (95%) 394:8635 (95%)	view
8242	x 2	2_preference_alignment/notebooks es/2_preference_alignment/notebooks	orpo_finetuning_example.ipynb orpo_finetuning_example.ipynb	402:8643 (95%) 403:8644 (95%)	view
8242	x 2	2_preference_alignment/notebooks vi/2_preference_alignment/notebooks	orpo_finetuning_example.ipynb orpo_finetuning_example.ipynb	402:8643 (95%) 394:8635 (95%)	view
8242	x 2	2_preference_alignment/notebooks pt-br/2_preference_alignment/notebooks	orpo_finetuning_example.ipynb orpo_finetuning_example.ipynb	402:8643 (95%) 402:8643 (95%)	view
8242	x 2	es/2_preference_alignment/notebooks vi/2_preference_alignment/notebooks	orpo_finetuning_example.ipynb orpo_finetuning_example.ipynb	403:8644 (95%) 394:8635 (95%)	view
5165	x 2	pt-br/2_preference_alignment/notebooks vi/2_preference_alignment/notebooks	dpo_finetuning_example.ipynb dpo_finetuning_example.ipynb	333:5497 (93%) 328:5492 (94%)	view
5164	x 2	es/2_preference_alignment/notebooks vi/2_preference_alignment/notebooks	dpo_finetuning_example.ipynb dpo_finetuning_example.ipynb	338:5501 (93%) 329:5492 (94%)	view
5164	x 2	es/2_preference_alignment/notebooks pt-br/2_preference_alignment/notebooks	dpo_finetuning_example.ipynb dpo_finetuning_example.ipynb	338:5501 (93%) 334:5497 (93%)	view
5162	x 2	1_instruction_tuning/notebooks ko/1_instruction_tuning/notebooks	chat_templates_example.ipynb chat_templates_example.ipynb	565:5726 (90%) 564:5725 (90%)	view
5162	x 2	ko/1_instruction_tuning/notebooks pt-br/1_instruction_tuning/notebooks	chat_templates_example.ipynb chat_templates_example.ipynb	564:5725 (90%) 564:5725 (90%)	view
5162	x 2	pt-br/1_instruction_tuning/notebooks vi/1_instruction_tuning/notebooks	chat_templates_example.ipynb chat_templates_example.ipynb	564:5725 (90%) 582:5743 (89%)	view
5162	x 2	1_instruction_tuning/notebooks pt-br/1_instruction_tuning/notebooks	chat_templates_example.ipynb chat_templates_example.ipynb	565:5726 (90%) 564:5725 (90%)	view
5162	x 2	ko/1_instruction_tuning/notebooks vi/1_instruction_tuning/notebooks	chat_templates_example.ipynb chat_templates_example.ipynb	564:5725 (90%) 582:5743 (89%)	view
5162	x 2	1_instruction_tuning/notebooks vi/1_instruction_tuning/notebooks	chat_templates_example.ipynb chat_templates_example.ipynb	565:5726 (90%) 582:5743 (89%)	view
5161	x 2	es/1_instruction_tuning/notebooks vi/1_instruction_tuning/notebooks	chat_templates_example.ipynb chat_templates_example.ipynb	572:5732 (90%) 583:5743 (89%)	view
5161	x 2	es/1_instruction_tuning/notebooks ko/1_instruction_tuning/notebooks	chat_templates_example.ipynb chat_templates_example.ipynb	572:5732 (90%) 565:5725 (90%)	view
5161	x 2	es/1_instruction_tuning/notebooks pt-br/1_instruction_tuning/notebooks	chat_templates_example.ipynb chat_templates_example.ipynb	572:5732 (90%) 565:5725 (90%)	view
5161	x 2	1_instruction_tuning/notebooks es/1_instruction_tuning/notebooks	chat_templates_example.ipynb chat_templates_example.ipynb	566:5726 (90%) 572:5732 (90%)	view
5139	x 2	2_preference_alignment/notebooks pt-br/2_preference_alignment/notebooks	dpo_finetuning_example.ipynb dpo_finetuning_example.ipynb	366:5504 (93%) 359:5497 (93%)	view
5139	x 2	2_preference_alignment/notebooks vi/2_preference_alignment/notebooks	dpo_finetuning_example.ipynb dpo_finetuning_example.ipynb	366:5504 (93%) 354:5492 (93%)	view
5139	x 2	2_preference_alignment/notebooks es/2_preference_alignment/notebooks	dpo_finetuning_example.ipynb dpo_finetuning_example.ipynb	366:5504 (93%) 363:5501 (93%)	view
4902	x 2	3_parameter_efficient_finetuning/notebooks pt-br/3_parameter_efficient_finetuning/notebooks	load_lora_adapter.ipynb load_lora_adapter.ipynb	160:5061 (96%) 160:5061 (96%)	view
4844	x 2	ko/3_parameter_efficient_finetuning/notebooks vi/3_parameter_efficient_finetuning/notebooks	load_lora_adapter.ipynb load_lora_adapter.ipynb	218:5061 (95%) 216:5059 (95%)	view
4844	x 2	pt-br/3_parameter_efficient_finetuning/notebooks vi/3_parameter_efficient_finetuning/notebooks	load_lora_adapter.ipynb load_lora_adapter.ipynb	218:5061 (95%) 216:5059 (95%)	view
4844	x 2	ko/3_parameter_efficient_finetuning/notebooks pt-br/3_parameter_efficient_finetuning/notebooks	load_lora_adapter.ipynb load_lora_adapter.ipynb	218:5061 (95%) 218:5061 (95%)	view
4844	x 2	3_parameter_efficient_finetuning/notebooks vi/3_parameter_efficient_finetuning/notebooks	load_lora_adapter.ipynb load_lora_adapter.ipynb	218:5061 (95%) 216:5059 (95%)	view
4844	x 2	3_parameter_efficient_finetuning/notebooks ko/3_parameter_efficient_finetuning/notebooks	load_lora_adapter.ipynb load_lora_adapter.ipynb	218:5061 (95%) 218:5061 (95%)	view
4828	x 2	es/3_parameter_efficient_finetuning/notebooks pt-br/3_parameter_efficient_finetuning/notebooks	load_lora_adapter_example.ipynb load_lora_adapter.ipynb	233:5060 (95%) 234:5061 (95%)	view
4828	x 2	es/3_parameter_efficient_finetuning/notebooks vi/3_parameter_efficient_finetuning/notebooks	load_lora_adapter_example.ipynb load_lora_adapter.ipynb	233:5060 (95%) 232:5059 (95%)	view
4828	x 2	es/3_parameter_efficient_finetuning/notebooks ko/3_parameter_efficient_finetuning/notebooks	load_lora_adapter_example.ipynb load_lora_adapter.ipynb	233:5060 (95%) 234:5061 (95%)	view
4828	x 2	3_parameter_efficient_finetuning/notebooks es/3_parameter_efficient_finetuning/notebooks	load_lora_adapter.ipynb load_lora_adapter_example.ipynb	234:5061 (95%) 233:5060 (95%)	view
314	x 2	ja/5_vision_language_models/notebooks ja/5_vision_language_models/notebooks	vlm_sft_sample.ipynb vlm_usage_sample.ipynb	1:314 (66%) 1:314 (66%)	view
160	x 2	2_preference_alignment/notebooks pt-br/2_preference_alignment/notebooks	orpo_finetuning_example.ipynb orpo_finetuning_example.ipynb	107:266 (1%) 107:266 (1%)	view
158	x 2	3_parameter_efficient_finetuning/notebooks es/3_parameter_efficient_finetuning/notebooks	load_lora_adapter.ipynb load_lora_adapter_example.ipynb	1:158 (3%) 1:158 (3%)	view
158	x 2	es/3_parameter_efficient_finetuning/notebooks ko/3_parameter_efficient_finetuning/notebooks	load_lora_adapter_example.ipynb load_lora_adapter.ipynb	1:158 (3%) 1:158 (3%)	view
158	x 2	es/3_parameter_efficient_finetuning/notebooks pt-br/3_parameter_efficient_finetuning/notebooks	load_lora_adapter_example.ipynb load_lora_adapter.ipynb	1:158 (3%) 1:158 (3%)	view
158	x 2	3_parameter_efficient_finetuning/notebooks ko/3_parameter_efficient_finetuning/notebooks	load_lora_adapter.ipynb load_lora_adapter.ipynb	1:158 (3%) 1:158 (3%)	view
158	x 2	3_parameter_efficient_finetuning/notebooks pt-br/3_parameter_efficient_finetuning/notebooks	load_lora_adapter.ipynb load_lora_adapter.ipynb	1:158 (3%) 1:158 (3%)	view
158	x 2	ko/3_parameter_efficient_finetuning/notebooks pt-br/3_parameter_efficient_finetuning/notebooks	load_lora_adapter.ipynb load_lora_adapter.ipynb	1:158 (3%) 1:158 (3%)	view
157	x 2	es/2_preference_alignment/notebooks pt-br/2_preference_alignment/notebooks	orpo_finetuning_example.ipynb orpo_finetuning_example.ipynb	108:264 (1%) 107:263 (1%)	view
157	x 2	2_preference_alignment/notebooks es/2_preference_alignment/notebooks	orpo_finetuning_example.ipynb orpo_finetuning_example.ipynb	107:263 (1%) 108:264 (1%)	view
157	x 2	ja/1_instruction_tuning/notebooks ja/1_instruction_tuning/notebooks	chat_templates_example.ipynb sft_finetuning_example.ipynb	1:157 (56%) 1:157 (56%)	view
154	x 2	ja/5_vision_language_models/notebooks ja/5_vision_language_models/notebooks	vlm_sft_sample.ipynb vlm_usage_sample.ipynb	316:469 (32%) 316:469 (32%)	view
149	x 2	pt-br/2_preference_alignment/notebooks vi/2_preference_alignment/notebooks	orpo_finetuning_example.ipynb orpo_finetuning_example.ipynb	107:255 (1%) 96:244 (1%)	view
149	x 2	es/2_preference_alignment/notebooks vi/2_preference_alignment/notebooks	orpo_finetuning_example.ipynb orpo_finetuning_example.ipynb	108:256 (1%) 96:244 (1%)	view
149	x 2	2_preference_alignment/notebooks vi/2_preference_alignment/notebooks	orpo_finetuning_example.ipynb orpo_finetuning_example.ipynb	107:255 (1%) 96:244 (1%)	view
148	x 2	ko/3_parameter_efficient_finetuning/notebooks vi/3_parameter_efficient_finetuning/notebooks	load_lora_adapter.ipynb load_lora_adapter.ipynb	1:148 (2%) 1:148 (2%)	view
148	x 2	es/3_parameter_efficient_finetuning/notebooks vi/3_parameter_efficient_finetuning/notebooks	load_lora_adapter_example.ipynb load_lora_adapter.ipynb	1:148 (2%) 1:148 (2%)	view
148	x 2	pt-br/3_parameter_efficient_finetuning/notebooks vi/3_parameter_efficient_finetuning/notebooks	load_lora_adapter.ipynb load_lora_adapter.ipynb	1:148 (2%) 1:148 (2%)	view

Duplicated Units

The list of top 1 duplicated units.

See data for all 1 unit duplicate

Size	#	Folders	Files	Lines	Code
15	x 4	vi/4_evaluation/project es/4_evaluation/project pt-br/4_evaluation/project 4_evaluation/project	evaluation_task.py evaluation_task.py evaluation_task.py evaluation_task.py	0:0  0:0  0:0  0:0	view