Line 10: | Line 10: | ||
*capture, preserve, formalize, systematize, exchange and improve knowledge and experimental results including negative ones | *capture, preserve, formalize, systematize, exchange and improve knowledge and experimental results including negative ones | ||
− | *describe and catalog whole experimental setups with all | + | *describe and catalog whole experimental setups with all related material including algorithms, benchmarks, codelets, datasets, tools, models and any other artifact |
*validate and verify experimental results by the community | *validate and verify experimental results by the community | ||
*develop common research interfaces for existing or new tools | *develop common research interfaces for existing or new tools | ||
Line 32: | Line 32: | ||
'''<span style="font-size:large">Workshop organizers</span>''' | '''<span style="font-size:large">Workshop organizers</span>''' | ||
− | *[http://cTuning.org/lab/people/gfursin Grigori Fursin], INRIA, France ( | + | *[http://cTuning.org/lab/people/gfursin Grigori Fursin], INRIA, France (Collective Mind project) |
− | *[http://people.cs.pitt.edu/~childers Bruce Childers],[http://www.pitt.edu/~akjones Alex K.Jones] and [http://people.cs.pitt.edu/~mosse Daniel Mosse], University of Pittsburgh, USA ( | + | *[http://people.cs.pitt.edu/~childers Bruce Childers],[http://www.pitt.edu/~akjones Alex K.Jones] and [http://people.cs.pitt.edu/~mosse Daniel Mosse], University of Pittsburgh, USA (OCCAM project) |
'''<span style="font-size:large">Program committee</span>''' | '''<span style="font-size:large">Program committee</span>''' | ||
Line 41: | Line 41: | ||
'''<span style="font-size:large">Related initiatives</span>''' | '''<span style="font-size:large">Related initiatives</span>''' | ||
− | * | + | *[[c-mind.org/repo|Collective Mind technology for collaborative and reproducible computer engineering]] |
− | + | *[http://cTuning.org cTuning technology for collaborative and reproducible auto-tuning and machine learning] | |
− | + | *[http://www.occamportal.org OCCAM project for reproducible computer architecture simulation] | |
− | + | *[[splashcon.org/2013/cfp/665|Artifact evaluation at OOSPLA'13]] | |
− | + | *[http://pldi14-aec.cs.brown.edu/ Artifact evaluation at PLDI'14] | |
|} | |} |
Revision as of 12:18, 13 December 2013
TRUST 2014 1st International Workshop on Reproducible Research Methodologies and New Publication Models June 12, 2014 (afternoon), Edinburgh, UK (co-located with PLDI 2014)
It becomes excessively challenging or even impossible to capture, share and accurately reproduce experimental results in computer engineering for fair and trustable evaluation and future improvement due to ever rising complexity of the design, analysis and optimization of computer systems, increasing number of ad-hoc tools, interfaces and techniques, lack of a common experimental methodology, and lack of simple and unified mechanisms, tools and repositories to preserve and exchange knowledge apart from numerous publications where reproducibility is often not even considered. This workshop is an interdisciplinary forum for academic and industrial researchers, practitioners and developers in computer engineering to discuss ideas, experience, trustable and reproducible research methodologies, practical techniques, tools and repositories to:
Submission guidelines
Important dates
Workshop organizers
Program committee
Related initiatives |