Artifact Evaluation for MICRO 2024

[ Back to the IEEE/ACM MICRO 2024 conference website ]

Important dates

Artifact submission deadline: August 11, 2024 AoE
Artifact decision: September 8, 2024
Camera-ready paper deadline: September 12, 2024
Conference: November 2 - November 6, 2024 (Austin, Texas, USA)

Artifact evaluation chairs

Contact AE chairs

Artifact Evaluation Committee

TBA - please use this form to nominate yourself or other colleagues with relevant AE experience.

Artifact submission

Artifact evaluation promotes reproducibility of experimental results and encourages code and data sharing. The authors will need to fill the unified Artifact Appendix to describe the minimal software, hardware and data set requirements, and explaining how to prepare, run and reproduce key experiments. The Artifact Appendix should be appended to the accepted paper and submitted for evaluation via MICRO'24 AE HotCRP website.

This Artifact Appendix was introduced to unify the description of experimental setups and results across different conferences. Though it is relatively intuitive and based on the feedback from the community, we encourage the authors to check the Artifact Appendix guide, artifact reviewing guide, the SIGPLAN Empirical Evaluation Guidelines, the NeurIPS reproducibility checklist, AE FAQs and Artifact Appendices from MICRO'23 papers before submitting artifacts for evaluation.

This submission is voluntary and will not influence the final decision regarding the papers - our goal is to help the authors validate their experiments by an independent AE Committee in a collaborative and constructive way. Furthermore, the authors can add notes and corrections to the Artifact Appendix if some mistakes were found during artifact evaluation.

The authors will communicate with evaluators via HotCRP after the submission.

We suggest the authors to make their artifacts available for evaluation via GitHub or similar public or private service. Public artifact sharing allows the authors to quickly fix encountered issues during evaluation before submitting the final version to archival repositories. Other acceptable methods include:

  • Using zip or tar files with all related code and data, particularly when code must be rebuilt on reviewers' machines (for example to have a non-virtualized access to some specific hardware).
  • Using Docker and similar technology.
  • Arranging remote access to the authors' machine with the pre-installed software - this is an exceptional cases when rare or proprietary software and hardware is used. The authors will need to privately send the access information to the AE chairs.

The papers that successfully go through AE will receive a set of ACM badges of approval printed on the papers themselves and available as meta information in the ACM Digital Library (it is now possible to search for papers with specific badges in the ACM DL). Authors of such papers will have an option to include up to 2 pages of their Artifact Appendix to the camera-ready paper.


Artifact available General ACM guidelines - artifacts will receive the ACM "artifact available" badge only if they have been placed on any publicly accessible archival repository such as Zenodo, FigShare, and Dryad with a DOI. The authors can provide a DOI of the final artifact at the very end of the AE process.
Artifact evaluated - functional General ACM guidelines.
Results reproduced General ACM guidelines and our MICRO'24 reviewing guidelines.

Artifact evaluation process

Note that our artifact evaluation is single-blind because the paper is accepted, there no need to hide the authors, and we help the authors fix issues, improve their artifacts and pass evaluation.

Evaluators will read a paper and then go through the Artifact Appendix to evaluate artifacts and reproduce experiments based on general ACM guidelines and our MICRO'24 guidelines.

Reviewers will communicate with the authors about any encountered issue immediately (and anonymously) via the HotCRP submission website to give the authors time to resolve all problems! Note that our philosophy is not to fail problematic artifacts but to help the authors improve their public artifacts and pass the evaluation!

In the end, AE chairs will communicate with the authors and decide on a set of the standard ACM reproducibility badges to award to a given paper/artifact based on all reviews and the authors' responses.

Questions and feedback

Please check the AE FAQs and feel free to ask questions or provide your feedback and suggestions via our public AE discussion group.