实现同样水平的 Code 效果,开源模型需要生成100次,ChatGPT只需要生成1次。

Aman Sanger: There are times and places for training your own models... With the release OpenAI's chatGPT API - coding is looking less like one of them.

The human-eval pass@1 rate of ChatGPT is as good as the best Open Source model's pass@100 rate.

And this is still just GPT 3.5...
 
 
Back to Top