Difference between revisions of "Reproducibility:AE:PPoPP2016"

Revision as of 02:29, 21 April 2015

Artifact Evaluation for PPoPP'16

[ Back to PPoPP'16 conference website ]

Important dates

Paper decision: 9 Nov 2015
Artifact submission: 18 Nov 2015
Technical clarification: 14-20 Dec 2015
Decision announced: 22 Dec 2015
Public discussion: 14 March 2016

Packaging guidelines

AE for CGO/PPoPP'15 used the following guidelines for artifacts . We are preparing a revised version.

How to submit

Please read the guidelines on what to submit. Please upload your submission to EasyChair (join CGO/PPoPP submission).

Review process

The review process is described in detail here. We are preparing a revised version.

Artifact Evaluation Committee (AEC)

Chairs:

Grigori Fursin, cTuning foundation, France
Bruce R. Childers, University of Pittsburgh, USA

Committee (joint with CGO'16):

TBA

Prior Artifact Evaluation

Last year, PPoPP 2015 successfully ran artifact evaluation process for the first time. PPoPP 2016 continues this experiment.

Artifacts have been already evaluated at several other conferences and workshops including recent CGO 2015, PLDI 2014, OOPSLA 2014 and ADAPT 2014. Our eventual goal is to develop common evaluation methodology gradually and collaboratively.

Discussions

We consider AE as a continuous learning curve. If you have questions or comments and suggestions on how to improve packaging and reviewing process, please get in touch!

Our presenation about Artifact Evaluation Experience at CGO/PPoPP'15 is available online here.

@@ Line 3: / Line 3: @@
 |-
 | style="text-align: right width: 200px" | [[File:Ae-stamp-ppopp2015.png]]<br/>
-| <p style="text-align: center"><span style="font-size:xx-large">'''<span style="font-family: tahoma,geneva,sans-serif">Artifact Evaluation for PPoPP'16</span>'''</span></p><p style="text-align: center"><span style="font-size:small">[ [http://ppopp15.soe.ucsc.edu Back to PPoPP'16 conference website] ]</span></p><p style="text-align: center"><span style="font-size:xx-large">'''<span style="font-family: tahoma,geneva,sans-serif"></span>'''</span></p><p style="text-align: center"></p><p style="text-align: center"></p>
+| <p style="text-align: center"><span style="font-size:xx-large">'''<span style="font-family: tahoma,geneva,sans-serif">Artifact Evaluation for PPoPP'16</span>'''</span></p><p style="text-align: center"><span style="font-size:small">[ [http://ppopp15.soe.ucsc.edu Back to PPoPP'16 conference website] ]</span></p><p style="text-align: center"></p><p style="text-align: center"></p><p style="text-align: center"></p>
 |}
@@ Line 13: / Line 13: @@
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Important dates</span>'''</span>
-*Paper decision: '''TBA'''
+*Paper decision: '''9 Nov 2015'''
-*Artifact submission: '''TBA'''
+*Artifact submission: '''18 Nov 2015'''
-*Technical clarification: '''TBA'''
+*Technical clarification: '''14-20 Dec 2015'''
-*Decision announced: '''TBA'''
+*Decision announced: '''22 Dec 2015'''
-*Public discussion: '''TBA'''
+*Public discussion: '''14 March 2016'''
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Packaging guidelines</span>'''</span>
@@ Line 42: / Line 42: @@
 *'''TBA'''
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Prior Artifact Evaluation</span>'''</span>
 Last year, PPoPP 2015 successfully ran [[Reproducibility:AE:PPoPP2015|artifact evaluation process]] for the first time. PPoPP 2016 continues this experiment.
-Artifacts have been already evaluated at several other conferences and workshops including recent [http://cTuning.org/event/ae-cgo2015 CGO 2015], [http://pldi14-aec.cs.brown.edu PLDI 2014], [http://2014.splashcon.org/track/splash2014-artifacts OOPSLA 2014] and [http://adapt-workshop.org/2014 ADAPT 2014]. Our eventual goal is to develop common evaluation methodology gradually and collaboratively. See [http://cknowledge.org/reproducibility cknowledge.org/reproducibility], [http://artifact-eval.org artifact-eval.org] and [https://groups.google.com/forum/#%21forum/collective-mind mailing list] for more details.
+Artifacts have been already evaluated at several other conferences and workshops including recent [http://cTuning.org/event/ae-cgo2015 CGO 2015], [http://pldi14-aec.cs.brown.edu PLDI 2014], [http://2014.splashcon.org/track/splash2014-artifacts OOPSLA 2014] and [http://adapt-workshop.org/2014 ADAPT 2014]. Our eventual goal is to develop common evaluation methodology gradually and collaboratively.
 | style="width: 37%" valign="top" |
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Discussions</span>'''</span>
-We consider AE as a continuous learning curve. If you have questions or comments and suggestions on how to improve packaging and reviewing process, please get in touch or use our public [https://groups.google.com/forum/#%21forum/collective-mind Google] or [http://www.linkedin.com/groups/Reproducible-research-experimentation-in-computer-7433414 LinkedIn] groups.
+We consider AE as a continuous learning curve. If you have questions or comments and suggestions on how to improve packaging and reviewing process, please get in touch!
 Our presenation about Artifact Evaluation Experience at CGO/PPoPP'15 is available online [http://www.slideshare.net/GrigoriFursin/presentation-fursin-aecgoppopp2015 here].