We are delighted to announce that the The LLM Evaluation guidebook by Clémentine Fourrier is now available in French! 🥖
Whether you're a researcher, developer or simply curious to know more about LLM evaluation, this material will provide you with valuable information and proven methodologies for conducting successful evaluations.
In particular, it provides detailed information on topics such as:
- how to create your own evaluation 🧪
- an overview of the advantages and disadvantages of current methods ⚖️
- troubleshooting tips 🔧
- lots of recommendations and tips 👻
- a notebook illustrating how to conduct evaluation experiments quickly and apply best practices 📓
- and much more 🎉
Link to the guide on Hugging Face 🤗: https://huggingface.co/spaces/CATIE-AQ/Guide_Evaluation_LLM.
In addition to this, five other resources have been translated to accompany it (three blog posts and two recipes in the form of notebooks):
- https://huggingface.co/blog/fr/evaluation-structured-outputs
- https://huggingface.co/blog/fr/open-llm-leaderboard-drop
- https://huggingface.co/blog/fr/open-llm-leaderboard-mmlu
- https://huggingface.co/learn/cookbook/fr/llm_judge
- https://huggingface.co/learn/cookbook/fr/structured_generation
A huge thanks to Clémentine and Aymeric Roucher for reviewing these resources 🤗
We hope you find it useful and enjoyable.
Good reading!