2_preference_alignment/notebooks/orpo_finetuning_example.ipynb
es/2_preference_alignment/notebooks/orpo_finetuning_example.ipynb

2_preference_alignment/notebooks/dpo_finetuning_example.ipynb
es/2_preference_alignment/notebooks/dpo_finetuning_example.ipynb

2_preference_alignment/notebooks/orpo_finetuning_example.ipynb
es/2_preference_alignment/notebooks/dpo_finetuning_example.ipynb

2_preference_alignment/notebooks/orpo_finetuning_example.ipynb
es/1_instruction_tuning/notebooks/chat_templates_example.ipynb

2_preference_alignment/notebooks/dpo_finetuning_example.ipynb
es/1_instruction_tuning/notebooks/chat_templates_example.ipynb

2_preference_alignment/notebooks/dpo_finetuning_example.ipynb
es/2_preference_alignment/notebooks/orpo_finetuning_example.ipynb

2_preference_alignment/notebooks/dpo_finetuning_example.ipynb
es/3_parameter_efficient_finetuning/notebooks/finetune_sft_peft.ipynb

2_preference_alignment/notebooks/orpo_finetuning_example.ipynb
es/3_parameter_efficient_finetuning/notebooks/finetune_sft_peft.ipynb

2_preference_alignment/notebooks/dpo_finetuning_example.ipynb
es/1_instruction_tuning/notebooks/sft_finetuning_example.ipynb

2_preference_alignment/notebooks/orpo_finetuning_example.ipynb
es/1_instruction_tuning/notebooks/sft_finetuning_example.ipynb