(→Assorted articles and presentations) |
|||
| Line 13: | Line 13: | ||
*[http://www.the-scientist.com/?articles.view/articleNo/32426/title/Predatory-Publishing Predatory publishing] | *[http://www.the-scientist.com/?articles.view/articleNo/32426/title/Predatory-Publishing Predatory publishing] | ||
*[http://michaelnielsen.org/blog/three-myths-about-scientific-peer-review Three myths about scientific peer review] | *[http://michaelnielsen.org/blog/three-myths-about-scientific-peer-review Three myths about scientific peer review] | ||
| + | *[http://spyros.zoupanos.net/papers/p39.open-repeatability.pdf The repeatability experiment of SIGMOD 2008], SIGMOD Record, vol. 37, no. 1 (March 2008), 39-45. | ||
*[http://dl.acm.org/citation.cfm?id=1536616.1536619 "Begin with an Author's response to Reviews"] - proposal to submit past reviews along with articles | *[http://dl.acm.org/citation.cfm?id=1536616.1536619 "Begin with an Author's response to Reviews"] - proposal to submit past reviews along with articles | ||
*[https://www.dropbox.com/s/67n49i9k3cb28mo/GOBLE-CW2014.ppt Presentation by Professor Carole Goble] | *[https://www.dropbox.com/s/67n49i9k3cb28mo/GOBLE-CW2014.ppt Presentation by Professor Carole Goble] | ||
*Dennis McCafferty, [http://dl.acm.org/citation.cfm?id=1831415 "Should Code be Released?"] | *Dennis McCafferty, [http://dl.acm.org/citation.cfm?id=1831415 "Should Code be Released?"] | ||
| + | *[http://www.sciencemag.org/content/334/6060/1225.full Special section on Data replication & reproducibility], Science magazine, 2 December 2011 | ||
*Chris Drummond, [http://cogprints.org/7691/7/ICMLws09.pdf "Replicability is not Reproducibility: Nor is it Good Science"] | *Chris Drummond, [http://cogprints.org/7691/7/ICMLws09.pdf "Replicability is not Reproducibility: Nor is it Good Science"] | ||
*[http://theconversation.com/science-is-in-a-reproducibility-crisis-how-do-we-resolve-it-16998 Science is in a reproducibility crisis - how do we resolve it?] | *[http://theconversation.com/science-is-in-a-reproducibility-crisis-how-do-we-resolve-it-16998 Science is in a reproducibility crisis - how do we resolve it?] | ||
Revision as of 07:49, 24 September 2015
Assorted articles and presentations
- Our experience report with encountered problems in computer systems' research and new proposal for community-driven reviewing and validation of publications [arXiv , ACM DL]
- Science's Reproducibility Problem, Bob Grant, The Scientist
- From Repeatability to Reproducibility and Corroboration, Dror G. Feitelson, SIGOPS Operating Syst. Rev. 49(1), pp. 3-11, Jan 2015
- Reviewing peer review, Jeannette M. Wing, ACM Blog
- How Should Peer Review Evolve?, Ed H. Chi, ACM Blog
- Cambridge University news about open and reproducible research
- Interesting Replicable "Badge" for journal articles, Daniel S. Katz
- Research Wranglers: Initiatives to Improve Reproducibility of Study Findings (Environmental Health Perspectives)
- Predatory publishing
- Three myths about scientific peer review
- The repeatability experiment of SIGMOD 2008, SIGMOD Record, vol. 37, no. 1 (March 2008), 39-45.
- "Begin with an Author's response to Reviews" - proposal to submit past reviews along with articles
- Presentation by Professor Carole Goble
- Dennis McCafferty, "Should Code be Released?"
- Special section on Data replication & reproducibility, Science magazine, 2 December 2011
- Chris Drummond, "Replicability is not Reproducibility: Nor is it Good Science"
- Science is in a reproducibility crisis - how do we resolve it?
- My blog article on "Automatic performance tuning and reproducibility as a side effect" for the Software Sustainability Institute
- Puzzling Measurement of "Big G" Gravitational Constant Ignites Debate
- White House takes notice of reproducibility in science, and wants your opinion
- Problems during performance benchmarking:
- [https://homes.cs.washington.edu/~bornholt/post/performance-evaluation.html]
We also experienced many similar issues during our work on auto-tuning and machine learning: - [http://hal.inria.fr/hal-01054763]
- [http://arxiv.org/abs/1406.4020]
- [https://homes.cs.washington.edu/~bornholt/post/performance-evaluation.html]
- ACM SIGOPS Operating Systems Review - Special Issue on Repeatability and Sharing of Experimental Artifacts
- Vinton G. Cerf. "Bit Rot: Long-Term Preservation of Digital Information" [Point of View]
- About citations: less related though interesting
Journals with artifact evaluation:
