<img _fck_mw_valid="false" _fck_mw_filename="Validated by community.png" alt="Validated by community.png" class="fck_mw_notfound" link="http://cTuning.org/reproducibility" /> Important dates: Abstract submission: March 7, 2014 (Anywhere on Earth) Paper submission: March 14, 2014 (Anywhere on Earth) Notification: April 14, 2014 Final version: May 2, 2014 Workshop: June 12, 2014 LinkedIn group [ <a href="http://www.linkedin.com/groups/Reproducible-research-experimentation-in-computer-7433414">Link</a> ] Collective Mind project: <img src="/cm/wiki/images/8/86/C-mind.org.png" _fck_mw_filename="C-mind.org.png" alt="Collective Mind" link="http://c-mind.org" /> [ <a href="http://c-mind.org/repo">Live repository</a> ], [ <a href="http://cTuning.org/tools/cm">Framework</a> ]

TRUST 2014 1st International Workshop on Reproducible Research Methodologies and New Publication Models in Computer Engineering  June 12, 2014 (afternoon), Edinburgh, UK (co-located with <a href="http://conferences.inf.ed.ac.uk/pldi2014">PLDI 2014</a>) We particularly focus on technological aspects to enable reproducible research and experimentation on program and architecture auto-tuning, machine learning, run-time adaptation and co-design Call for papers It becomes excessively challenging or even impossible to capture, share and accurately reproduce experimental results in computer engineering for fair and trustable evaluation and future improvement due to ever rising complexity of the design, analysis and optimization of computer systems, increasing number of ad-hoc tools, interfaces and techniques, lack of a common experimental methodology, and lack of simple and unified mechanisms, tools and repositories to preserve and exchange knowledge apart from numerous publications where reproducibility is often not even considered. After focusing on systematic and community-driven program and architecture auto-tuning and co-design combined with machine learning and crowdsourcing <a href="http://cTuning.org">during past 6 years</a> we faced numerous, practical challenges related to reproducible experimentation. Based on this experience and feedback from the community, we decided to organize this workshop as an interdisciplinary forum for academic and industrial researchers, practitioners and developers in computer engineering to discuss challenges, ideas, experience, trustable and reproducible research methodologies, practical techniques, tools and repositories to: capture, preserve, formalize, systematize, exchange and improve knowledge and experimental results including negative ones describe and catalog whole experimental setups with all related material including algorithms, benchmarks, codelets, datasets, tools, models and any other artifact validate and verify experimental results by the community develop common research interfaces for existing or new tools develop common experimental frameworks and repositories share rare hardware and computational resources for experimental validation deal with variability and rising amount of experimental data using statistical analysis, data mining, predictive modeling and other techniques implement previously published experimental scenarios (auto-tuning, run-time adaptation) using common infrastructure implement open access to publications and data (particularly discussing intellectual property IP and legal issues) enable interactive articles Submission guidelines Easychair submission website is <a href="https://www.easychair.org/conferences/?conf=trust20140">open</a>. We invite papers in three categories (please use these prefixes for your submission title): T1: Position papers should be at most 3 pages long (excluding bibliography). We welcome preliminary and exploratory work, presentation of related tools and repositories in development, experience reports particularly related to recent research validation initiatives at OOPSLA, PDLI and ADAPT, and any related ideas. T2: Full papers should be at most 6 pages long (excluding bibliography). Papers in this category are expected to have relatively mature content. T3: Papers validating and sharing past research on design and optimization of computer systems published in relevant conferences. These papers should be at most 6 pages long (excluding bibliography). Submissions should be in PDF formatted with double column/single-spacing using 10pt fonts and printable on US letter or A4 sized paper. All papers will be peer-reviewed. Accepted papers can be published online on the conference website that will not prevent later publication of extended papers. We currently arrange proceedings to be published in the ACM Digital Library. Important dates Abstract submission: March 7, 2014 (Anywhere on Earth) Paper submission: March 14, 2014 (Anywhere on Earth) Notification: April 14, 2014 Final version: May 2, 2014 Workshop: June 12, 2014 Workshop organizers <a href="http://cTuning.org/lab/people/gfursin">Grigori Fursin</a>, INRIA, France (Collective Mind / cTuning project) <a href="http://people.cs.pitt.edu/~childers">Bruce Childers</a>, <a href="http://www.pitt.edu/~akjones">Alex K.Jones</a> and <a href="http://people.cs.pitt.edu/~mosse">Daniel Mosse</a>, University of Pittsburgh, USA (OCCAM project) Program committee TBA Assorted related projects and initiatives  <a href="http://adapt-workshop.org/program.htm">ADAPT panel on reproducible research methodologies and new publication models</a> (January 2014) <a href="http://www.hipeac.net/thematic-session/making-computer-engineering-science">HiPEAC thematic session on making computer engineering a science</a> <a href="http://c-mind.org/repo">Collective Mind technology for collaborative, systematic and reproducible computer engineering</a> <a href="http://hal.inria.fr/inria-00436029">cTuning technology to crowdsource auto-tuning and combine with machine learning</a> (2006-2011) <a href="http://www.occamportal.org">OCCAM project for reproducible computer architecture simulation</a> <a href="http://Splashcon.org/2013/cfp/665">Artifact evaluation at OOSPLA'13</a> <a href="http://pldi14-aec.cs.brown.edu/">Artifact evaluation at PLDI'14</a> <a href="http://hal.inria.fr/inria-00436029/">GCC Summit'09 discussion</a> <a href="http://reproducible.io">CARE tool from STMicroelectronics (Comprehensive Archiver for Reproducible Execution)</a>