Reproducibility:AE:PPoPP2016 - Revision history

Gfursin at 09:38, 27 October 2015

2015-10-27T09:38:55Z

Gfursin at 10:36, 21 April 2015

2015-04-21T10:36:02Z

Gfursin at 10:15, 21 April 2015

2015-04-21T10:15:13Z

Gfursin at 09:34, 21 April 2015

2015-04-21T09:34:43Z

Gfursin at 09:29, 21 April 2015

2015-04-21T09:29:33Z

Gfursin at 09:24, 21 April 2015

2015-04-21T09:24:13Z

Gfursin at 09:21, 21 April 2015

2015-04-21T09:21:48Z

Gfursin: Created page with " {| border="0" cellpadding="15" cellspacing="1" |- | style="text-align: right width: 200px" | File:Ae-stamp-ppopp2015.png
|

2015-04-21T09:19:48Z

Created page with "<center> {| border="0" cellpadding="15" cellspacing="1" |- | style="text-align: right width: 200px" | File:Ae-stamp-ppopp2015.png | <spa..."

New page
<center>
{| border="0" cellpadding="15" cellspacing="1"
|-
| style="text-align: right width: 200px" | [[File:Ae-stamp-ppopp2015.png]] 
| '''Artifact Evaluation for PPoPP'16'''
|}

----

{| style="width: 97%" border="0" cellpadding="20" cellspacing="1"
|-
| style="width: 25%" valign="top" | <div class="span4">
'''Important dates'''

Paper decision: '''TBA'''
Artifact submission: '''TBA'''
Technical clarification: '''TBA'''
Decision announced: '''TBA'''
Public discussion: '''TBA'''

'''Packaging guidelines'''

AE for CGO/PPoPP'15 used the following [http://www.artifact-eval.org/guidelines.html guidelines for artifacts]We are preparing a revised version.

'''How to submit'''

Please read the [http://www.artifact-eval.org/guidelines.html guidelines] on what to submit. Please upload your submission to [https://easychair.org/conferences/?conf=aecgoppopp2016 EasyChair] (join CGO/PPoPP submission).

'''Review process'''

The review process is described in detail [http://www.artifact-eval.org/review-process.html here]. We are preparing a revised version.
</div>
| style="width: 35%" valign="top" |
'''Artifact Evaluation Committee (AEC)'''

'''Chairs:'''

[http://cTuning.org/lab/people/gfursin Grigori Fursin], cTuning foundation, France
[http://people.cs.pitt.edu/%7Echilders Bruce R. Childers], University of Pittsburgh, USA

'''Committee:'''

'''TBA'''

'''Prior Artifact Evaluation'''

Last year, PPoPP 2015 successfully ran [[Reproducibility:AE:PPoPP2016|artifact evaluation process]] for the first time. PPoPP 2016 continues this experiment. Artifacts have been already evaluated at several other conferences and workshops including recent [http://cTuning.org/event/ae-cgo2015 CGO 2015], [http://cTuning.org/event/ae-ppopp2015 PPoPP 2015], [http://pldi14-aec.cs.brown.edu PLDI 2014], [http://2014.splashcon.org/track/splash2014-artifacts OOPSLA 2014] and [http://adapt-workshop.org/2014 ADAPT 2014]. Our eventual goal is to develop common evaluation methodology gradually and collaboratively. See [http://cknowledge.org/reproducibility cknowledge.org/reproducibility], [http://artifact-eval.org artifact-eval.org] and [https://groups.google.com/forum/#%21forum/collective-mind mailing list] for more details.

| style="width: 37%" valign="top" |
'''Discussions'''

We consider AE as a continuous learning curve. If you have questions or comments and suggestions on how to improve packaging and reviewing process, please get in touch or use our public [https://groups.google.com/forum/#%21forum/collective-mind Google] or [http://www.linkedin.com/groups/Reproducible-research-experimentation-in-computer-7433414 LinkedIn] groups.

Our presenation about Artifact Evaluation Experience at CGO/PPoPP'15 is available online [http://www.slideshare.net/GrigoriFursin/presentation-fursin-aecgoppopp2015 here].

|}
</center>

← Older revision		Revision as of 09:38, 27 October 2015
Line 1:		Line 1:
		+	{{#externalredirect: http://cTuning.org/ae/ppopp2016.html}}
		+
	<center>		<center>
	{\| border="0" cellpadding="15" cellspacing="1"		{\| border="0" cellpadding="15" cellspacing="1"

@@ Line 25: / Line 25: @@
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">How to submit</span>'''</span>
-Please read the [http://www.artifact-eval.org/guidelines.html guidelines] on what to submit. Please upload your submission to [https://easychair.org/conferences/?conf=aecgoppopp2016 EasyChair] (join CGO/PPoPP submission).
+Please read the [http://www.artifact-eval.org/guidelines.html guidelines] on what to submit. Please upload your submission to [https://easychair.org/conferences/?conf=aecgoppopp2016 EasyChair] (joint CGO/PPoPP submission).
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Review process</span>'''</span>

@@ Line 3: / Line 3: @@
 |-
 | style="text-align: right width: 200px" | [[File:Ae-stamp-ppopp2015.png]]<br/>
-| <p style="text-align: center"><span style="font-size:xx-large">'''<span style="font-family: tahoma,geneva,sans-serif">Artifact Evaluation for PPoPP'16</span>'''</span></p><p style="text-align: center"><span style="font-size:small">[ [http://ppopp15.soe.ucsc.edu Back to PPoPP'16 conference website] ]</span></p><p style="text-align: center"></p><p style="text-align: center"></p><p style="text-align: center"></p>
+| <p style="text-align: center"><span style="font-size:xx-large">'''<span style="font-family: tahoma,geneva,sans-serif">Artifact Evaluation for PPoPP'16</span>'''</span></p><p style="text-align: center"><span style="font-size:small">[ [http://conf.researchr.org/home/PPoPP-2016 Back to PPoPP'16 conference website] ]</span></p><p style="text-align: center"></p><p style="text-align: center"></p><p style="text-align: center"></p>
 |}

@@ Line 10: / Line 10: @@
 {| style="width: 97%" border="0" cellpadding="20" cellspacing="1"
 |-
-| style="width: 25%" valign="top" | <div class="span4">
+| style="width: 32%" valign="top" | <div class="span4">
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Important dates</span>'''</span>
 *Paper decision: '''9 Nov 2015'''
-*Artifact submission: '''18 Nov 2015'''
+*Artifact submission: '''20 Nov 2015 AoE'''
 *Technical clarification: '''14-20 Dec 2015'''
 *Decision announced: '''22 Dec 2015'''
@@ Line 31: / Line 31: @@
 The review process is described in detail [http://www.artifact-eval.org/review-process.html here]. We are preparing a revised version.
 </div>
-| style="width: 35%" valign="top" |
+| style="width: 33%" valign="top" |
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Artifact Evaluation Committee (AEC)</span>'''</span>
@@ Line 49: / Line 49: @@
 Artifacts have been already evaluated at several other conferences and workshops including recent [http://cTuning.org/event/ae-cgo2015 CGO 2015], [http://pldi14-aec.cs.brown.edu PLDI 2014], [http://2014.splashcon.org/track/splash2014-artifacts OOPSLA 2014] and [http://adapt-workshop.org/2014 ADAPT 2014]. Our eventual goal is to develop common evaluation methodology gradually and collaboratively.
-| style="width: 37%" valign="top" |
+| style="width: 32%" valign="top" |
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Discussions</span>'''</span>

@@ Line 3: / Line 3: @@
 |-
 | style="text-align: right width: 200px" | [[File:Ae-stamp-ppopp2015.png]]<br/>
-| <p style="text-align: center"><span style="font-size:xx-large">'''<span style="font-family: tahoma,geneva,sans-serif">Artifact Evaluation for PPoPP'16</span>'''</span></p><p style="text-align: center"><span style="font-size:small">[ [http://ppopp15.soe.ucsc.edu Back to PPoPP'16 conference website] ]</span></p><p style="text-align: center"><span style="font-size:xx-large">'''<span style="font-family: tahoma,geneva,sans-serif"></span>'''</span></p><p style="text-align: center"></p><p style="text-align: center"></p>
+| <p style="text-align: center"><span style="font-size:xx-large">'''<span style="font-family: tahoma,geneva,sans-serif">Artifact Evaluation for PPoPP'16</span>'''</span></p><p style="text-align: center"><span style="font-size:small">[ [http://ppopp15.soe.ucsc.edu Back to PPoPP'16 conference website] ]</span></p><p style="text-align: center"></p><p style="text-align: center"></p><p style="text-align: center"></p>
 |}
@@ Line 13: / Line 13: @@
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Important dates</span>'''</span>
-*Paper decision: '''TBA'''
+*Paper decision: '''9 Nov 2015'''
-*Artifact submission: '''TBA'''
+*Artifact submission: '''18 Nov 2015'''
-*Technical clarification: '''TBA'''
+*Technical clarification: '''14-20 Dec 2015'''
-*Decision announced: '''TBA'''
+*Decision announced: '''22 Dec 2015'''
-*Public discussion: '''TBA'''
+*Public discussion: '''14 March 2016'''
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Packaging guidelines</span>'''</span>
@@ Line 42: / Line 42: @@
 *'''TBA'''
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Prior Artifact Evaluation</span>'''</span>
 Last year, PPoPP 2015 successfully ran [[Reproducibility:AE:PPoPP2015|artifact evaluation process]] for the first time. PPoPP 2016 continues this experiment.
-Artifacts have been already evaluated at several other conferences and workshops including recent [http://cTuning.org/event/ae-cgo2015 CGO 2015], [http://pldi14-aec.cs.brown.edu PLDI 2014], [http://2014.splashcon.org/track/splash2014-artifacts OOPSLA 2014] and [http://adapt-workshop.org/2014 ADAPT 2014]. Our eventual goal is to develop common evaluation methodology gradually and collaboratively. See [http://cknowledge.org/reproducibility cknowledge.org/reproducibility], [http://artifact-eval.org artifact-eval.org] and [https://groups.google.com/forum/#%21forum/collective-mind mailing list] for more details.
+Artifacts have been already evaluated at several other conferences and workshops including recent [http://cTuning.org/event/ae-cgo2015 CGO 2015], [http://pldi14-aec.cs.brown.edu PLDI 2014], [http://2014.splashcon.org/track/splash2014-artifacts OOPSLA 2014] and [http://adapt-workshop.org/2014 ADAPT 2014]. Our eventual goal is to develop common evaluation methodology gradually and collaboratively.
 | style="width: 37%" valign="top" |
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Discussions</span>'''</span>
-We consider AE as a continuous learning curve. If you have questions or comments and suggestions on how to improve packaging and reviewing process, please get in touch or use our public [https://groups.google.com/forum/#%21forum/collective-mind Google] or [http://www.linkedin.com/groups/Reproducible-research-experimentation-in-computer-7433414 LinkedIn] groups.
+We consider AE as a continuous learning curve. If you have questions or comments and suggestions on how to improve packaging and reviewing process, please get in touch!
 Our presenation about Artifact Evaluation Experience at CGO/PPoPP'15 is available online [http://www.slideshare.net/GrigoriFursin/presentation-fursin-aecgoppopp2015 here].

@@ Line 3: / Line 3: @@
 |-
 | style="text-align: right width: 200px" | [[File:Ae-stamp-ppopp2015.png]]<br/>
-| <p style="text-align: center"><span style="font-size:xx-large">'''<span style="font-family: tahoma,geneva,sans-serif">Artifact Evaluation for PPoPP'16</span>'''</span></p><p style="text-align: center"></p>
+| <p style="text-align: center"><span style="font-size:xx-large">'''<span style="font-family: tahoma,geneva,sans-serif">Artifact Evaluation for PPoPP'16</span>'''</span></p><p style="text-align: center"><span style="font-size:xx-large">'''<span style="font-family: tahoma,geneva,sans-serif"></span>'''</span></p><p style="text-align: center"></p>
 |}
@@ Line 21: / Line 21: @@
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Packaging guidelines</span>'''</span>
-AE for CGO/PPoPP'15 used the following [http://www.artifact-eval.org/guidelines.html guidelines for artifacts]We are preparing a revised version.
+AE for CGO/PPoPP'15 used the following [http://www.artifact-eval.org/guidelines.html guidelines for artifacts] . We are preparing a revised version.
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">How to submit</span>'''</span>
@@ Line 47: / Line 47: @@
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Prior Artifact Evaluation</span>'''</span>
-Last year, PPoPP 2015 successfully ran [[Reproducibility:AE:PPoPP2016|artifact evaluation process]] for the first time. PPoPP 2016 continues this experiment. Artifacts have been already evaluated at several other conferences and workshops including recent [http://cTuning.org/event/ae-cgo2015 CGO 2015], [http://cTuning.org/event/ae-ppopp2015 PPoPP 2015], [http://pldi14-aec.cs.brown.edu PLDI 2014], [http://2014.splashcon.org/track/splash2014-artifacts OOPSLA 2014] and [http://adapt-workshop.org/2014 ADAPT 2014]. Our eventual goal is to develop common evaluation methodology gradually and collaboratively. See [http://cknowledge.org/reproducibility cknowledge.org/reproducibility], [http://artifact-eval.org artifact-eval.org] and [https://groups.google.com/forum/#%21forum/collective-mind mailing list] for more details.
+Last year, PPoPP 2015 successfully ran [[Reproducibility:AE:PPoPP2016|artifact evaluation process]] for the first time. PPoPP 2016 continues this experiment. Artifacts have been already evaluated at several other conferences and workshops including recent [http://cTuning.org/event/ae-cgo2015 CGO 2015], [http://pldi14-aec.cs.brown.edu PLDI 2014], [http://2014.splashcon.org/track/splash2014-artifacts OOPSLA 2014] and [http://adapt-workshop.org/2014 ADAPT 2014]. Our eventual goal is to develop common evaluation methodology gradually and collaboratively. See [http://cknowledge.org/reproducibility cknowledge.org/reproducibility], [http://artifact-eval.org artifact-eval.org] and [https://groups.google.com/forum/#%21forum/collective-mind mailing list] for more details.
 | style="width: 37%" valign="top" |