LLM as a Council

Route your question through multiple models at once with an LLM as a judge function to pick the best one. Inspired by Karpathy's X Post.

When to Use

• Most helpful when deciding what model to use for specific task.

Integrations

• Chat interface to Ask AI nodes

Output

• Rates each reply and picks best one.

Additional builds: you can replace the interface node with an import data step to run evals on a whole CSV, or a slack / email reader, if you want the reply to meet you in a messaging interface.