RE: https://mastodon.social/@renebekkers/117631302774936693
Task: find replications of previous experiments in the multidisciplinary field of research on charitable giving.
A comprehensive manual search identifies 48 replications of experiments. How many replications from the set of 48 can AI-powered tools identify?
Not many, it turns out. The best tool found one third of them. Most tools – even popular ones such as Perplexity, find fewer than 10. Many studies that the AI tools identified as replications were not replications at all.