Chatbot Arena: Test & Compare LLMs by Human Preference

Which is the best #LLM ? let's have them fight it out in the #Chatbot Arena!
The one that scores the best in "human satisfaction" wins! But how to measure this subjective metric? Anastasios Angelopoulo presented his work to me.

The core idea is simple. 🥊 Humans are presented with the outputs of two different LLMs for the same prompt and have to decide which one performs better. All votes are aggregated to a final ranking score. Try it out at: https://chat.lmsys.org/