Difference between revisions of "Reproducibility:AE:CGO2015"

Revision as of 21:53, 28 July 2014

Artifact Evaluation for CGO'15

[ Back to CGO'15 conference website ] [ Back to reproducibility wiki ]

Important dates

CGO paper decision notification: November 3, 2014
Arfiact submission deadline: November 14, 2014

Decision announced: December 15, 2014

Packaging guidelines

We use the following guidelines for artifacts. Because we want to encourage as many of you as possible to submit, these are only guidelines, not hard rules. Of course, if the material you want us to evaluate is fairly standard, following these suggestions will greatly simplify our lives. After all, remember: You want us to be able to evaluate your artifact, don't you?

How to submit

Please read the guidelines on what to submit. Please upload your submission to EasyChair.

Process

The review process is described in detail here.

Artifact Evaluation Committee (AEC)

Chairs:

Grigori Fursin, INRIA / cTuning foundation, France
Bruce R. Childers, University of Pittsburgh, USA

Advisory board:

Shriram Krishnamurthi, Brown University, USA

Committee members:

Will be nominated by CGO PC members

Prior Artifact Evaluation

Artifacts have been already evaluated at several conferences and workshops including recent PLDI 2014, OOPSLA 2014 and ADAPT 2014. See artifact-eval.org and c-mind.org/reproducibility for more details.

Above threshold

Here will be a list of papers with artifacts above threshold. We are currently arranging a prize for a distinguished artifact!

Sponsors and supporters

@@ Line 12: / Line 12: @@
 | style="width: 40%" valign="top" | <div class="span4">
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Important dates</span>'''</span>
+*CGO paper decision notification: '''November 3, 2014'''
+*Arfiact submission deadline: '''November 14, 2014'''
+Decision announced: '''December 15, 2014'''
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Packaging guidelines</span>'''</span>
@@ Line 21: / Line 25: @@
 Please read the [http://www.artifact-eval.org/guidelines.html guidelines] on ''what'' to submit. Please upload your submission to [https://easychair.org/conferences/?conf=aecgo2015 EasyChair].
+<span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Process</span>'''</span>
+The review process is described in detail [http://www.artifact-eval.org/review-process.html here].
+</div>
+| style="width: 40%" valign="top" |
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Artifact Evaluation Committee (AEC)</span>'''</span>
@@ Line 26: / Line 35: @@
 *[http://cTuning.org/lab/people/gfursin Grigori Fursin], INRIA / cTuning foundation, France
-*[http://people.cs.pitt.edu/~childers Bruce Childers], University of Pittsburgh, USA
+*[http://people.cs.pitt.edu/%7Echilders Bruce R. Childers], University of Pittsburgh, USA
 '''Advisory board:'''
@@ Line 32: / Line 41: @@
 *&nbsp;[http://www.cs.brown.edu/%7Esk/ Shriram Krishnamurthi], Brown University, USA
-Committee members will be nominated by CGO PC members and will be listed here.
+'''Committee members:'''
+*Will be nominated by CGO PC members
+*&nbsp;
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Prior Artifact Evaluation</span>'''</span>
-Here's a [http://cs.brown.edu/%7Esk/Memos/Conference-Artifact-Evaluation/ report] on the AEC process for ESEC/FSE 2011. You can also see the AEC sites for [http://ecoop13-aec.cs.brown.edu/ ECOOP 2013] and [http://splashcon.org/2013/cfp/665 OOPSLA 2013].<br/></div>
-| style="width: 40%" valign="top" |
-<span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Process</span>'''</span>
-Artifact evaluation is open ''only'' to accepted papers. This is intentional: it ensures that the AEC cannot influence whether or not a paper is accepted. This measure was put in place to reassure authors who felt this would be too radical a change to the process of evaluating conference paper submissions.
-Of course, this doesn't mean you can't start getting ready! We have published the packaging guidelines, so you can begin to prepare your artifacts for submission. Even if your paper doesn't get accepted, this should still be a useful exercise for general dissemination. In addition, we hope the guidelines will give you ideas about how your material can be disseminated, either by suggesting methods you hadn't considered or pointing you to resources you weren't aware of.
-As soon as papers are chosen for the conference, you will be invited to submit. We will then have a few weeks in which to perform the evaluation. We may contact you if we have a problem with the submission, but there is no formal “response” period.
-Thus, even though there is nothing formally to do now, you would do well to have your artifact packaged and ready to go. The moment you receive the good news, you should be ready to upload!
+Artifacts have been already evaluated at several conferences and workshops including recent [http://pldi14-aec.cs.brown.edu PLDI 2014], [http://2014.splashcon.org/track/splash2014-artifacts OOPSLA 2014] and [http://adapt-workshop.org/2014 ADAPT 2014].
+See [http://artifact-eval.org artifact-eval.org] and [http://c-mind.org/reproducibility c-mind.org/reproducibility] for more details.<br/>
 | style="width: 20%" valign="top" |
 <span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Above threshold</span>'''</span>