← All Demos
Language Model Council — Live
Run a council of LLMs that evaluate each other's responses to your prompt
OpenRouter API KeyThis demo calls LLMs via OpenRouter using your API key. Each council run costs roughly $0.05–$0.25 depending on the models. Your key is stored only in your browser and sent directly to OpenRouter. Or load sample data to explore the UI without a key.
Models
Presets
Completion Models
Judge Models
Judging
Reference(s)Collecting exhaustive pairwise ratings is O(N²). Fixing one or more reference models makes judging O(N) — each model is compared only against the reference(s) — while still producing stable ELO estimates.
Scale