Eryk Salvaggio on Nostr: Here’s a paper that shows the complexities of evaluating AI research without ...

Here’s a paper that shows the complexities of evaluating AI research without questioning AI myths. In this case, the paper (link at the end) suggests a conclusion — and many are circulating this conclusion — that “LLMs are able to generate novel research ideas beyond the level of human experts in a similar field.” Dig into the experiment, and you see a different story.