(→Assorted articles and presentations) |
(→Assorted articles and presentations) |
||
Line 15: | Line 15: | ||
*[http://reproduciblescience.blogspot.fr/2015/06/interesting-replicable-badge-for.html Interesting Replicable "Badge" for journal articles], Daniel S. Katz | *[http://reproduciblescience.blogspot.fr/2015/06/interesting-replicable-badge-for.html Interesting Replicable "Badge" for journal articles], Daniel S. Katz | ||
*[http://thomasleeper.com/2015/05/open-science-language What's in a Name? The Concepts and Language of Replication and Reproducibility] | *[http://thomasleeper.com/2015/05/open-science-language What's in a Name? The Concepts and Language of Replication and Reproducibility] | ||
+ | *[http://web.eece.maine.edu/~vweaver/papers/wddd08/wddd08_workshop.pdf Are Cycle Accurate Simulations a Waste of Time?], Vincent M. Weaver and Sally A. McKee | ||
*[http://ehp.niehs.nih.gov/122-a188 Research Wranglers: Initiatives to Improve Reproducibility of Study Findings] (Environmental Health Perspectives) | *[http://ehp.niehs.nih.gov/122-a188 Research Wranglers: Initiatives to Improve Reproducibility of Study Findings] (Environmental Health Perspectives) | ||
*[https://web.stanford.edu/~vcs/talks/VictoriaStoddenICML2010.pdf Reproducible Research in Computational Science: Problems and Solutions For Data and Code Sharing], Victoria Stodden, ICML workshop 2010 | *[https://web.stanford.edu/~vcs/talks/VictoriaStoddenICML2010.pdf Reproducible Research in Computational Science: Problems and Solutions For Data and Code Sharing], Victoria Stodden, ICML workshop 2010 | ||
Line 24: | Line 25: | ||
*Dennis McCafferty, [http://dl.acm.org/citation.cfm?id=1831415 "Should Code be Released?"] | *Dennis McCafferty, [http://dl.acm.org/citation.cfm?id=1831415 "Should Code be Released?"] | ||
*[http://www.elsevier.com/connect/can-data-be-peer-reviewed Elsevier:Can data be peer-reviewed?] | *[http://www.elsevier.com/connect/can-data-be-peer-reviewed Elsevier:Can data be peer-reviewed?] | ||
+ | *[https://hal.inria.fr/hal-01054763 Collective mind: Towards practical and collaborative auto-tuning] | ||
+ | *[http://arxiv.org/abs/1506.06256 Collective Mind, Part II: Towards Performance- and Cost-Aware Software Engineering as a Natural Science] | ||
*[http://www.executablepapers.com Elsevier:The Executable Paper Grand Challenge] | *[http://www.executablepapers.com Elsevier:The Executable Paper Grand Challenge] | ||
*[http://www.sciencemag.org/content/334/6060/1225.full Special section on Data replication & reproducibility], Science magazine, 2 December 2011 | *[http://www.sciencemag.org/content/334/6060/1225.full Special section on Data replication & reproducibility], Science magazine, 2 December 2011 |
Revision as of 05:23, 1 October 2015
Assorted articles and presentations
- PL conference papers to get a journal - discussing ACM proposal to formally recognize conference publications as equal in quality as journal publications - controversial
- Our experience report with encountered problems in computer systems' research and new proposal for community-driven reviewing and validation of publications [arXiv , ACM DL]
- Collective Tuning Initiative: automating and accelerating development and optimization of computing systems
- Science's Reproducibility Problem, Bob Grant, The Scientist
- From Repeatability to Reproducibility and Corroboration, Dror G. Feitelson, SIGOPS Operating Syst. Rev. 49(1), pp. 3-11, Jan 2015
- Reviewing peer review, Jeannette M. Wing, ACM Blog
- How Should Peer Review Evolve?, Ed H. Chi, ACM Blog
- Twelve Ways to Fool the Masses When Giving Performance Results on Parallel Computers, David H. Bailey, Supercomputing Review, June 11, 1991
- [Ten Ways to Fool the Masses When Giving Performance Results on GPUs], Scott Pakin, HPCWire, December 13, 2011
- Cambridge University news about open and reproducible research
- Interesting Replicable "Badge" for journal articles, Daniel S. Katz
- What's in a Name? The Concepts and Language of Replication and Reproducibility
- Are Cycle Accurate Simulations a Waste of Time?, Vincent M. Weaver and Sally A. McKee
- Research Wranglers: Initiatives to Improve Reproducibility of Study Findings (Environmental Health Perspectives)
- Reproducible Research in Computational Science: Problems and Solutions For Data and Code Sharing, Victoria Stodden, ICML workshop 2010
- Predatory publishing
- Three myths about scientific peer review
- The repeatability experiment of SIGMOD 2008, SIGMOD Record, vol. 37, no. 1 (March 2008), 39-45.
- "Begin with an Author's response to Reviews" - proposal to submit past reviews along with articles
- Presentation by Professor Carole Goble
- Dennis McCafferty, "Should Code be Released?"
- Elsevier:Can data be peer-reviewed?
- Collective mind: Towards practical and collaborative auto-tuning
- Collective Mind, Part II: Towards Performance- and Cost-Aware Software Engineering as a Natural Science
- Elsevier:The Executable Paper Grand Challenge
- Special section on Data replication & reproducibility, Science magazine, 2 December 2011
- Chris Drummond, "Replicability is not Reproducibility: Nor is it Good Science"
- Science is in a reproducibility crisis - how do we resolve it?
- W3C Dataset Descriptions: HCLS Community Profile
- My blog article on "Automatic performance tuning and reproducibility as a side effect" for the Software Sustainability Institute
- Trouble at the Lab, The Economist, 2013
- Joint Declaration of Data Citation Principles
- Puzzling Measurement of "Big G" Gravitational Constant Ignites Debate
- International vocabulary of metrology – Basic and general concepts and associated terms (VIM)
- White House takes notice of reproducibility in science, and wants your opinion
- Problems during performance benchmarking:
- [https://homes.cs.washington.edu/~bornholt/post/performance-evaluation.html]
We also experienced many similar issues during our work on auto-tuning and machine learning: - [http://hal.inria.fr/hal-01054763]
- [http://arxiv.org/abs/1406.4020]
- [https://homes.cs.washington.edu/~bornholt/post/performance-evaluation.html]
- ACM SIGOPS Operating Systems Review - Special Issue on Repeatability and Sharing of Experimental Artifacts
- Vinton G. Cerf. "Bit Rot: Long-Term Preservation of Digital Information" [Point of View]
- About citations: less related though interesting
Journals with artifact sharing and evaluation
- IPOL Journal: Image Processing On Line
- ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE (TOMS)
- ACM SIGMOD 2015
National requirements
- UK EPSRC expectations on research data management
- University of Manchester, UK:
- Cornell University, USA: Best Practices