以此推论，开源模型微调的事实性很难有提升。而GPT4的事实性准确性也来自预训练。
anton: This is a useful recent talk on why LLMs hallucinate. It seems that fine tuning can teach the model to hallucinate more if that knowledge was not previously seen before during training
以此推论，开源模型微调的事实性很难有提升。而GPT4的事实性准确性也来自预训练。
anton: This is a useful recent talk on why LLMs hallucinate. It seems that fine tuning can teach the model to hallucinate more if that knowledge was not previously seen before during training
