Difference between revisions of "Events:TRUST2014"

Revision as of 13:17, 26 April 2014

Important dates:

~~Submission: March 19, 2014~~
~~Notification: April 14, 2014~~
Final version: May 2, 2014
Early registration: May 7, 2014
Workshop: June 12, 2014

LinkedIn group

[ Link ]

Collective Mind project:

[ Live repository ], [ Framework ], [Discussions]

OCCAM project

[ Link ]

Special journal issue

IEEE TETC

[ Link ]

Artifact evaluation for software conferences

[ Link ]

Sponsors

ACM SIGPLAN

If your company or institution is interested to become our sponsor, please don't hesitate to contact us !

TRUST 2014

Registration for TRUST and other PLDI events is now open!

1st ACM SIGPLAN Workshop on Reproducible Research Methodologies
and New Publication Models in Computer Engineering

co-located with ACM PLDI 2014

June 12, 2014 (afternoon), Edinburgh, UK

We particularly focus on technological aspects to enable reproducible research and experimentation on program and architecture empirical analysis, optimization, simulation, co-design and run-time adaptation.

Panel on conference artifact evaluation experience

Jan Vitek (Purdue University, USA), Shriram Krishnamurthi (Brown University, USA) - presenting and discussing the outcome of the Artifact Evaluation at PLDI'14 and other software conferences
Grigori Fursin (INRIA, France), Christophe Dubach (University of Edinburgh, UK) - presenting their experience with the ADAPT'14 experiment validation and discussing possible technical solutions

Please, do not forget to register at the TRUST workshophere(early registration deadline is 7th of May)!

Preliminary program

1:30 - 1:35	Workshop introduction Grigori Fursin, INRIA, France
1:35 - 2:10	OCCAM project Bruce Chillders, University of Pittsburgh, USA
2:10 - 2:45	Software in reproducible research: advice and best practice collected from experiences at the Collaborations Workshop. Mario Antonioletti, Neil Chue Hong, Stephen Crouch, Alexander Hay, Simon Hettrick, Devasena Inupakutika, Mike Jackson, Aleksandra Pawlik, Giacomo Peru, John Robinson, Shoaib Sufi, Les Carr, David De Roure, Carole Goble, and Mark Parsons.
2:45 - 3:15	Coffee break (synchronized with all PLDI workshops)
3:15 - 3:40	Falsifiability of network security research: the Good, the Bad, and the Ugly Dennis Gamayunov, Lomonosov Moscow State University, Russia
3:40 - 4:05	Academia 2.0: removing the publisher middle-man while retaining impact Raphael Poss¹, Sebastian Altmeyer¹,Mark Thompson², Rob Jelier³ ¹ University of Amsterdam, Netherlands ² L.U.M.C., Netherlands ³ KU Leuven, Belgium
4:05 - 4:30	CARE, the Comprehensive Archiver for Reproducible Execution Yves Janin, Cedric Vincent and Remi Duraffort STMicroelectronics, France
4:30 - 6:00	Panel on conference artifact evaluation experience Jan Vitek¹ , Shriram Krishnamurthi² , Christophe Dubach³ , Grigori Fursin⁴ ¹ Purdue University, USA ² Brown University, USA ³ University of Edinburgh, UK ⁴ INRIA, France

Call for papers

It becomes excessively challenging or even impossible to capture, share and accurately reproduce experimental results in computer engineering for fair and trustable evaluation and future improvement. This is often due to ever rising complexity of the design, analysis and optimization of computer systems, increasing number of ad-hoc tools, interfaces and techniques, lack of a common experimental methodology, and lack of simple and unified mechanisms, tools and repositories to preserve and exchange knowledge apart from numerous publications where reproducibility is often not even considered. This ACM SIGPLAN workshop is intended to become an interdisciplinary forum for academic and industrial researchers, practitioners and developers in computer engineering to discuss challenges, ideas, experience, trustable and reproducible research methodologies, practical techniques, tools and repositories to:

capture, preserve, formalize, systematize, exchange and improve knowledge and experimental results including negative ones
describe and catalog whole experimental setups with all related material including algorithms, benchmarks, codelets, datasets, tools, models and any other artifact
validate and verify experimental results by the community
develop common research interfaces for existing or new tools
develop common experimental frameworks and repositories
share rare hardware and computational resources for experimental validation
deal with variability and rising amount of experimental data using statistical analysis, data mining, predictive modeling and other techniques
implement previously published experimental scenarios (auto-tuning, run-time adaptation) using common infrastructure
implement open access to publications and data (particularly discussing intellectual property IP and legal issues)
improve reviewing and evaluation process for publications and shared artifacts
enable interactive articles

Submission guidelines

Easychair submission website is now closed.

We invite papers in three categories (please use these prefixes for your submission title):

T1: Position papers should be at most 3 pages long (excluding bibliography). We welcome preliminary and exploratory work, presentation of related tools and repositories in development, experience reports particularly related to recent research validation initiatives at OOPSLA, PDLI and ADAPT, and any related ideas.
T2: Full papers should be at most 6 pages long (excluding bibliography). Papers in this category are expected to have relatively mature content.
T3: Papers validating and sharing past research on design and optimization of computer systems published in relevant conferences. These papers should be at most 6 pages long (excluding bibliography).

Submissions should be in PDF formatted with double column/single-spacing using 10pt fonts and printable on US letter or A4 sized paper. All papers will be peer-reviewed. Accepted papers can be published online on the conference website that will not prevent later publication of extended papers. We currently arrange proceedings to be published in the ACM Digital Library.

Important dates

~~Paper submission: March 19, 2014 (Anywhere on Earth)~~
~~Notification: April 14, 2014~~
Final version: May 2, 2014
Early registration: May 7, 2014 (link)
Workshop: June 12, 2014

Workshop organizers

Grigori Fursin (INRIA, France)
Bruce Childers, Alex K.Jones and Daniel Mosse (University of Pittsburgh, USA)

Program committee

Jose Nelson Amaral (University of Alberta, Canada)
Calin Cascaval (Qualcomm, USA)
Jack Davidson (University of Virginia, USA)
Evelyn Duesterwald (IBM, USA)
Lieven Eeckhout (Ghent University, Belgium)
Eric Eide (University of Utah, USA)
Sebastian Fischmeister (University of Waterloo, Canada)
Michael Gerndt (TU Munich, Germany)
Christophe Guillon (STMicroelectronics, France)
Shriram Krishnamurthi (Brown University, USA)
Hugh Leather (University of Edinburgh, UK)
Anton Lokhmotov (ARM, UK)
Mikel Lujan (University of Manchester, UK)
David Padua (University of Illinois at Urbana-Champaign, USA)
Christoph Reichenbach (Johann-Wolfgang Goethe Universitat Frankfurt, Germany)
Arun Rodrigues (Sandia National Laboratories, USA)
Reiji Suda (University of Tokyo, Japan)
Sid Touat i (INRIA, France)
Jesper Larsson Traff (Vienna University of Technology, Austria)
Petr Tuma (Charles University, Czech Republic)
Jan Vitek (Purdue University, USA)
Vladimir Voevodin (Moscow State University, Russia)
Vittorio Zaccaria (Politecnico di Milano, Italy)
Xiaoyun Zhu (VMware, USA)

Assorted related projects, initiatives and tools

Assorted tools

CARE tool from STMicroelectronics (Comprehensive Archiver for Reproducible Execution)
CDE tool (automatically create portable Linux applications with all dependencies)
Docker tool (pack, ship and run applications as a lightweight container)
IPython Notebook (a web-based interactive computational environment where you can combine code execution, text, mathematics, plots and rich media into a single document)
cTuning technology (crowdsource auto-tuning and combine with machine learning) (2006-cur.)
Collective Mind technology (towards collaborative, systematic and reproducible computer engineering) (2011-cur.)

@@ Line 19: / Line 19: @@
 *[https://www.cs.purdue.edu/homes/jv Jan Vitek] (Purdue University, USA), [http://cs.brown.edu/~sk/ Shriram Krishnamurthi ](Brown University, USA) - presenting and discussing the outcome of the&nbsp;<span style="font-size:small">[http://www.artifact-eval.org Artifact Evaluation at PLDI]</span><span style="font-size:small">[http://www.artifact-eval.org '14 and other software conferences]</span>
 *<span style="font-size:small">[http://cTuning.org/lab/people/gfursin Grigori Fursin ](INRIA, France), [http://homepages.inf.ed.ac.uk/cdubach Christophe Dubach]</span> (University of Edinburgh, UK) - presenting their experience with the [http://adapt-workshop.org/2014/program.htm ADAPT'14 experiment validation] and discussing possible technical solutions
+<p style="text-align: center"><span style="color:#b22222">''Please, do not forget to register at the TRUST workshop''</span>''[https://regmaster4.com/2014conf/PLDI14/register.php here]''<span style="color:#b22222">''(early registration deadline is 7th of May)!''</span></p>
+<span style="font-size:small">'''<span style="font-size:large">Preliminary program</span>'''</span>
-<span style="color:#b22222">''Please, do not forget to register at the TRUST workshop''</span>''[https://regmaster4.com/2014conf/PLDI14/register.php here]''<span style="color:#b22222">''(early registration deadline is 7th of May)!''</span>
+{| cellpadding="1" cellspacing="1" border="1" height="123" width="794"
+|-
+| 1:30 - 1:35<br/>
+|
+'''Workshop introduction'''
-<span style="font-size:small">'''<span style="font-size:large">Program</span>'''</span>
+''Grigori Fursin, INRIA, France''
-''Under preparation''
+|-
+| 1:35 - 2:10<br/>
+|
+'''OCCAM project'''
+''Bruce Chillders, University of Pittsburgh'', USA
+|-
+| 2:10 - 2:45<br/>
+|
+'''Software in reproducible research: advice and best practice collected from experiences at the Collaborations Workshop.'''
+''Mario Antonioletti, Neil Chue Hong, Stephen Crouch, Alexander Hay, Simon Hettrick, Devasena Inupakutika, Mike Jackson, Aleksandra Pawlik, Giacomo Peru, John Robinson, Shoaib Sufi, Les Carr, David De Roure, Carole Goble, and Mark Parsons.''
+|-
+| 2:45 - 3:15<br/>
+| Coffee break (synchronized with all PLDI workshops)<br/>
+|-
+| 3:15 - 3:40<br/>
+|
+'''Falsifiability of network security research: the Good, the Bad, and the Ugly'''
+''Dennis Gamayunov, Lomonosov Moscow State University, Russia''
+|-
+| 3:40 - 4:05<br/>
+|
+'''Academia 2.0: removing the publisher middle-man while retaining impact'''
+''Raphael Poss<sup>1</sup>, Sebastian Altmeyer<sup>1</sup>,Mark Thompson<sup>2</sup>, Rob Jelier<sup>3</sup>''<br/><sup>1</sup> University of Amsterdam, Netherlands<br/><sup>2</sup> L.U.M.C., Netherlands<br/><sup>3</sup> KU Leuven, Belgium<br/>
+|-
+| 4:05 - 4:30<br/>
+|
+'''CARE, the Comprehensive Archiver for Reproducible Execution'''
+''Yves Janin, Cedric Vincent and Remi Duraffort''<br/>STMicroelectronics, France
+|-
+| 4:30 - 6:00<br/>
+|
+'''Panel on conference artifact evaluation experience'''
+[https://www.cs.purdue.edu/homes/jv Jan Vitek]<sup>1</sup> , [http://cs.brown.edu/%7Esk/ Shriram Krishnamurthi]<sup>2</sup> ,&nbsp; Christophe Dubach<sup>3</sup> , Grigori Fursin<sup>4</sup>
+<sup>1</sup> Purdue University, USA
+<sup>2</sup> Brown University, USA
+<sup><span style="font-size:small"></span>3</sup> University of Edinburgh, UK
+<span style="font-size:small"><sup>4</sup> INRIA, France</span>
+|}
 <span style="font-size:small">'''<span style="font-size:large">Call for papers</span>'''</span>
@@ Line 96: / Line 153: @@
 <span style="font-size:small">'''<span style="font-size:large">Assorted related projects, initiatives and tools</span>'''&nbsp;</span>
-*<span style="font-size:small">[http://www.artifact-eval.org Artifact Evaluation for software conferences]</span> ; [http://www.artifact-eval.org/guidelines.html Guidelines for packaging artifacts for submissions]
+*<span style="font-size:small">[http://www.artifact-eval.org Artifact Evaluation for software conferences]</span>&nbsp;; [http://www.artifact-eval.org/guidelines.html Guidelines for packaging artifacts for submissions]
 *<span style="font-size:small">[http://adapt-workshop.org/program.htm ADAPT panel on reproducible research methodologies and new publication models] (January 2014)</span>
 *<span style="font-size:small">[http://hal.inria.fr/inria-00436029/ GCC Summit'09 discussion]</span>