Appreciate the funny post, but for anyone reading too much into this it’s misleading at best (also just barely passing at 60% only correct). It’s referencing a portion of the test with multiple choice questions. So that’s relatively easy for a language model, since it can predict an answer from a focused question. Please don’t ask chat gpt individualized questions about your health. It does decent for giving out some general information about medical topics, but you’d be better off at going to a reputable site like mayo clinic, Cleveland clinic, or all the resources at national library of medicine who maintain free very nice medical knowledge databases on tons of topics. It’s where chat gpt is probably scraping it’s answers from anyways, and you won’t have to worry about it making up nonsense that looks real and inserting it into the answer.
And if chat gpt comes up with sources in an answer, look them up yourself no matter how convincing they seem on their face. I’ve seen it invent doi numbers that don’t exist and all sorts of weird stuff.
Appreciate the funny post, but for anyone reading too much into this it’s misleading at best (also just barely passing at 60% only correct). It’s referencing a portion of the test with multiple choice questions. So that’s relatively easy for a language model, since it can predict an answer from a focused question. Please don’t ask chat gpt individualized questions about your health. It does decent for giving out some general information about medical topics, but you’d be better off at going to a reputable site like mayo clinic, Cleveland clinic, or all the resources at national library of medicine who maintain free very nice medical knowledge databases on tons of topics. It’s where chat gpt is probably scraping it’s answers from anyways, and you won’t have to worry about it making up nonsense that looks real and inserting it into the answer.
And if chat gpt comes up with sources in an answer, look them up yourself no matter how convincing they seem on their face. I’ve seen it invent doi numbers that don’t exist and all sorts of weird stuff.