This is a new award that recognizes the best papers in terms of reproducibility. The three most reproducible papers are picked every year and the awards are presented during the awards session of the SIGMOD conference (next year). Each award comes with a $750 honorarium sponsored by IBM.
The criteria are as follows: (i) coverage (ideal: all results can be verified), (ii) ease of reproducibility (ideal: just works), (iii) flexibility (ideal: can change workloads, queries, data and get similar behavior with published results), and (iv) portability (ideal: linux, mac, windows).
Awarded to Most Reproducible Papers of ACM SIGMOD 2018.
by Yiqiu Wang, Anshumali Shrivastava, Jonathan Wang, Junghee Ryu
Verified by: Manos Athanassoulis and Subhadeep Sarkar, Boston University
by Thomas Neumann, Bernhard Radke
Verified by: Wilson Qin and Abdul Wasay, Harvard University
Awarded to Most Reproducible Papers of ACM SIGMOD 2017.
by Mohammad Dashti (EPFL), Sachin Basil John (EPFL), Amir Shaikhha (EPFL), Christoph Koch (EPFL)
Verified by: Stratos Idreos, Abdul Wasay and Wilson Qin, Harvard University
by Abdul Wasay (Harvard), Xinding Wei (Harvard), Niv Dayan (Harvard), Stratos Idreos (Harvard)
Verified by: Peter Triantafillou, University of Glasgow
by Akhil Arora (Xerox Research Centre India), Sainyam Galhotra (University of Massachusetts, Amherst), Sayan Ranu (Indian Institute of Technology, Delhi)
Verified by: Dan Olteanu, Oxford
Awarded to Most Reproducible Papers of ACM SIGMOD 2016.
by Ning Yan, Sona Hasani, Abolfazl Asudeh, Chengkai Li
Verified by: Hideaki Kimura
by Shrainik Jain, Dominik Moritz, Daniel Halperin, Bill Howe, Ed Lazowska
Verified by: Juliana Freire, Fernando Seabra Chirigati, Tuan-Anh Hoang-Vu
by Fernando Chirigati, Harish Doraiswamy, Theodoros Damoulas, Juliana Freire
Verified by: Azza Abouzied