MMLU 是特别重要的指标（如果不是最重要的话包含了57个学科的综合知识能力是很多模型的衍生能力的基础Andrej Karpathy: Huge day indeed for AI and LLMs, congrats to Meta 👏This is now the most capable LLM available directly as weights to anyone from researchers to companies.The models look quite strong, e.g. Table 4 in the paper: MMLU is good to look at, the 70B model is just below GPT-3.5. But…

MMLU 是特别重要的指标（如果不是最重要的话
包含了57个学科的综合知识能力
是很多模型的衍生能力的基础

Andrej Karpathy: Huge day indeed for AI and LLMs, congrats to Meta 👏
This is now the most capable LLM available directly as weights to anyone from researchers to companies.

The models look quite strong, e.g. Table 4 in the paper: MMLU is good to look at, the 70B model is just below GPT-3.5. But… https://twitter.com/i/web/status/1681356674635034625 https://t.co/bY66FiadVE