--- license: apache-2.0 language: - en --- *[December 2023]* We are ranked *4th* on the overall leaderboard and **1st** in the 7B leaderboard! 🔥🔥🔥🔥 ![image/png](https://cdn-uploads.huggingface.co/production/uploads/63c06fba8d1175e3399c16e6/yEPpr0V-D9V4m1a2pMuQs.png) DPO from the model ranked *6th* on the overall leaderboard and **1st** in the 7B leaderboard (12th December 2023) - v1olet/v1olet_marcoroni-go-bruins-merge-7B https://huggingface.co/v1olet/v1olet_marcoroni-go-bruins-merge-7B Training data: comparison_gpt4_en,en_orca_dpo Train for 1 epoch. You can use alpaca template. ``` template_format = """{system} ### Instruction: {prompt} ### Response: """ ``` Developed by: Trong-Hieu Nguyen-Mau