This is a new award that recognizes the best papers in terms of reproducibility. The three most reproducible papers are picked every year and the awards are presented during the awards session of the SIGMOD conference (next year). Each award comes with a $750 honorarium sponsored by IBM.
The criteria are as follows: (i) coverage (ideal: all results can be verified), (ii) ease of reproducibility (ideal: just works), (iii) flexibility (ideal: can change workloads, queries, data and get similar behavior with published results), and (iv) portability (ideal: linux, mac, windows).
Awarded to Most Reproducible Papers of ACM SIGMOD 2019.
by Mohammad Mahdavi, Ziawasch Abedjan, Raul Castro Fernandez, Samuel Madden, Mourad Ouzzani, Michael Stonebraker, Nan Tang
Verified by: Subarna Chatterjee, Harvard University
by Su Feng, Aaron Huber, Boris Glavic, Oliver Kennedy
Verified by: Siqiang Luo, Harvard University
Awarded to Most Reproducible Papers of ACM SIGMOD 2018.
by Yiqiu Wang, Anshumali Shrivastava, Jonathan Wang, Junghee Ryu
Verified by: Manos Athanassoulis and Subhadeep Sarkar, Boston University
by Thomas Neumann, Bernhard Radke
Verified by: Wilson Qin and Abdul Wasay, Harvard University
by Sainyam Galhotra, Donatella Firmani, Barna Saha, Divesh Srivastava
Verified by: Wilson Qin and Abdul Wasay, Harvard University
Awarded to Most Reproducible Papers of ACM SIGMOD 2017.
by Mohammad Dashti (EPFL), Sachin Basil John (EPFL), Amir Shaikhha (EPFL), Christoph Koch (EPFL)
Verified by: Stratos Idreos, Abdul Wasay and Wilson Qin, Harvard University
by Abdul Wasay (Harvard), Xinding Wei (Harvard), Niv Dayan (Harvard), Stratos Idreos (Harvard)
Verified by: Peter Triantafillou, University of Glasgow
by Akhil Arora (Xerox Research Centre India), Sainyam Galhotra (University of Massachusetts, Amherst), Sayan Ranu (Indian Institute of Technology, Delhi)
Verified by: Dan Olteanu, Oxford
Awarded to Most Reproducible Papers of ACM SIGMOD 2016.
by Shrainik Jain, Dominik Moritz, Daniel Halperin, Bill Howe, Ed Lazowska
Verified by: Juliana Freire, Fernando Seabra Chirigati, Tuan-Anh Hoang-Vu
by Fernando Chirigati, Harish Doraiswamy, Theodoros Damoulas, Juliana Freire
Verified by: Azza Abouzied
by Manos Athanassoulis, Zheng Yan, Stratos Idreos
Verified by: Peter Triantafillou, George Sfakianakis