ScholarCatalyst: A Benchmark for Retrieving Papers That Inspire New Research

Published in arXiv 2026, 2026

ScholarCatalyst is a literature inspiration retrieval benchmark grounded in researchers’ firsthand knowledge of their own projects. 184 researchers who led 207 recent computer science projects verified 894 research questions, labeling which prior papers did or could have advanced their work. The benchmark covers 207 source papers, 191k candidate documents, and 894 queries (207 core queries and 687 subfield queries).

Paper (arXiv)CodeDataset

Recommended citation: Sohyeon Kim, Yoonho Lee, Bo Liu, Dayoon Ko, Rulin Shao, Seungone Kim, Graham Neubig, Pang Wei Koh, Aakanksha Chowdhery, Akari Asai, Omar Khattab, Yejin Choi, Gunhee Kim, Chelsea Finn. (2026). "ScholarCatalyst: A Benchmark for Retrieving Papers That Inspire New Research." arXiv preprint arXiv:2610.02202.
Download Paper