[ Back to main page
Assorted articles and presentations PL conference papers to get a journal - discussing ACM proposal to formally recognize conference publications as equal in quality as journal publications - controversialOur experience report with encountered problems in computer systems' research and new proposal for community-driven reviewing and validation of publications [arXiv , ACM DL ]
Collective Tuning Initiative: automating and accelerating development and optimization of computing systems Science's Reproducibility Problem , Bob Grant, The ScientistFrom Repeatability to Reproducibility and Corroboration , Dror G. Feitelson, SIGOPS Operating Syst. Rev. 49(1), pp. 3-11, Jan 2015Reviewing peer review , Jeannette M. Wing, ACM BlogHow Should Peer Review Evolve? , Ed H. Chi, ACM BlogTwelve Ways to Fool the Masses When Giving Performance Results on Parallel Computers , David H. Bailey, Supercomputing Review, June 11, 1991[Ten Ways to Fool the Masses When Giving Performance Results on GPUs], Scott Pakin, HPCWire, December 13, 2011
Cambridge University news about open and reproducible research Interesting Replicable "Badge" for journal articles , Daniel S. KatzWhat's in a Name? The Concepts and Language of Replication and Reproducibility Are Cycle Accurate Simulations a Waste of Time? , Vincent M. Weaver and Sally A. McKeeResearch Wranglers: Initiatives to Improve Reproducibility of Study Findings (Environmental Health Perspectives)Reproducible Research in Computational Science: Problems and Solutions For Data and Code Sharing , Victoria Stodden, ICML workshop 2010Predatory publishing Three myths about scientific peer review The repeatability experiment of SIGMOD 2008 , SIGMOD Record, vol. 37, no. 1 (March 2008), 39-45. "Begin with an Author's response to Reviews" - proposal to submit past reviews along with articlesPresentation by Professor Carole Goble Dennis McCafferty, "Should Code be Released?"
Elsevier:Can data be peer-reviewed? Collective mind: Towards practical and collaborative auto-tuning Collective Mind, Part II: Towards Performance- and Cost-Aware Software Engineering as a Natural Science Elsevier:The Executable Paper Grand Challenge Special section on Data replication & reproducibility , Science magazine, 2 December 2011Chris Drummond, "Replicability is not Reproducibility: Nor is it Good Science"
Science is in a reproducibility crisis - how do we resolve it? W3C Dataset Descriptions: HCLS Community Profile My blog article on "Automatic performance tuning and reproducibility as a side effect" for the Software Sustainability Institute
Trouble at the Lab , The Economist, 2013Joint Declaration of Data Citation Principles Puzzling Measurement of "Big G" Gravitational Constant Ignites Debate International vocabulary of metrology – Basic and general concepts and associated terms (VIM) White House takes notice of reproducibility in science, and wants your opinion Problems during performance benchmarking:
ACM SIGOPS Operating Systems Review - Special Issue on Repeatability and Sharing of Experimental Artifacts Vinton G. Cerf. "Bit Rot: Long-Term Preservation of Digital Information" [Point of View ]About citations: less related though interesting Journals with artifact sharing and evaluation National requirements
(C) 2011-2014 cTuning foundation
