Vlad: Mother of all LLM benchmarks!
- Use GPT-4 if you need best quality
- Use claude-instant-v1 for everything else
- Google PaLM2 is nowhere near OpenAI/Anthropic
- OpenAI models are painfully slow compared to competition
- Open-source models next
source:
https://github.com/kagisearch/pyllms
