Artifact Evaluation for Computer Systems' Research
We work with the community and ACM to improve methodology and tools for reproducible experimentation, artifact submission / reviewing and open challenges!
About Artifacts Committee Submission Reviewing FAQ Prior AE
Supporters

Important dates:
Paper decision: May 24, 2017
Check two new options to help authors prepare artifacts for submission
Artifact submission: June 14, 2017
Technical clarification: July 5-12, 2017
Decision announced: July 14, 2017
Final paper: July 19, 2017

PACT AE Chairs:
Grigori Fursin (dividiti / cTuning)
Bruce Childers (U. of Pittsburgh)

Artifact Evaluation for PACT 2017

[ Back to PACT 2017 conference website ]



Artifact evaluation is finished - see accepted artifacts here !


Authors of accepted PACT 2017 papers are invited to formally submit their supporting materials for Artifact Evaluation. The Artifact Evaluation process is run by a separate committee whose task is to assess if artifacts supporting the work described in the papers are available and functional, and (some of) experimental results are reproducible.

We introduced two new options for PACT'17 AE:

If you would like to take advantage of these options, please contact AE chairs soon after your paper is accepted!

Papers that successfully go through the Artifact Evaluation process will receive a seal of approval printed on the papers themselves. Authors of such papers will have an option to include their Artifact Appendix to the final paper (up to 2 pages). Authors are also encouraged (though not obliged) to make their artifacts publicly available upon publication of the proceedings, for example using Code Ocean platform (official partner of IEEE Digital Library).

If you have any questions, please check AE FAQs and do not hesitate to contact AE chairs!

How to submit

You should prepare your artifacts for submission using the following guide. Then, register your submission at the EasyChair - you will be asked to submit your paper title, author list, artifact abstract with a special checklist (to help select appropriate evaluators), PDF of your paper with an appendix describing how to access and validate your artifacts, and describe possible conflicts of interests.

Reviewing process

Your artifacts will be reviewed according to the following guidelines. Artifacts receiving "met expectations" or above score will pass evaluation and will receive a stamp of approval.

Feedback

We consider Artifact Evaluation as a continuous learning curve - our eventual goal is to develop a common methodology for experiment sharing and evaluation in computer system's research. Therefore, if you have questions, comments and suggestions on how to improve artifact submission, reviewing, customization and reuse, please do not hesitate to get in touch with the AE steering committee!






















Maintained by
cTuning foundation (non-profit R&D organization)
and volunteers!
          
Powered by Collective Knowledge
                     
  
  
  
           Locations of visitors to this page