Line 10: Line 10:
 
{| style="width: 97%" border="0" cellpadding="20" cellspacing="1"
 
{| style="width: 97%" border="0" cellpadding="20" cellspacing="1"
 
|-
 
|-
| style="width: 30%" valign="top" | <div class="span4">
+
| style="width: 25%" valign="top" | <div class="span4">
 
<span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Important dates</span>'''</span>
 
<span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Important dates</span>'''</span>
  
Line 16: Line 16:
 
*Artifact submission: <strike>'''18 Nov 2014 AoE'''</strike>
 
*Artifact submission: <strike>'''18 Nov 2014 AoE'''</strike>
 
*Technical clarification: <strike>'''10-12 Dec 2014'''</strike>
 
*Technical clarification: <strike>'''10-12 Dec 2014'''</strike>
*Decision announced: '''16 Dec 2014'''
+
*Decision announced: <strike>'''16 Dec 2014'''</strike>
 
*Public discussion: '''9 Feb 2015'''
 
*Public discussion: '''9 Feb 2015'''
  
Line 35: Line 35:
 
Artifacts have been already evaluated at several conferences and workshops including recent [http://pldi14-aec.cs.brown.edu PLDI 2014], [http://2014.splashcon.org/track/splash2014-artifacts OOPSLA 2014] and [http://adapt-workshop.org/2014 ADAPT 2014]. Our eventual goal is to develop the common evaluation methodology gradually and collaboratively. See [http://artifact-eval.org artifact-eval.org] and [http://c-mind.org/reproducibility c-mind.org/reproducibility] for more details.
 
Artifacts have been already evaluated at several conferences and workshops including recent [http://pldi14-aec.cs.brown.edu PLDI 2014], [http://2014.splashcon.org/track/splash2014-artifacts OOPSLA 2014] and [http://adapt-workshop.org/2014 ADAPT 2014]. Our eventual goal is to develop the common evaluation methodology gradually and collaboratively. See [http://artifact-eval.org artifact-eval.org] and [http://c-mind.org/reproducibility c-mind.org/reproducibility] for more details.
 
</div>
 
</div>
| style="width: 37%" valign="top" |  
+
| style="width: 35%" valign="top" |  
 
<span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Artifact Evaluation Committee (AEC)</span>'''</span>
 
<span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Artifact Evaluation Committee (AEC)</span>'''</span>
  
Line 71: Line 71:
 
*Michael Laurenzano, UMich, USA
 
*Michael Laurenzano, UMich, USA
  
| style="width: 30%" valign="top" |  
+
| style="width: 37%" valign="top" |  
 
<span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Above threshold</span>'''</span>
 
<span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Above threshold</span>'''</span>
  
Here will be a list of papers with artifacts above threshold.
+
List of papers with artifacts above threshold:
<p style="text-align: center">'''''[http://cTuning.org cTuning foundation] provided a cash prize of 500$ for a distinguished artifact from CGO or PPoPP.'''''</p>
+
 
 +
*'''''NUMA-aware Graph-structured Analytics'''''<br/>Kaiyuan Zhang, Rong Chen and Haibo Chen<br/>
 +
*'''''Predicate RCU: An RCU for Scalable Concurrent Updates'''''<br/>Maya Arbel and Adam Morrison<br/>
 +
*'''''Scalable and Efficient Implementation of 3D Unstructured Meshes Computation: A Case Study on Matrix Assembly'''''<br/>Loïc Thébault, Eric Petit and Quang Dinh<br/>
 +
*'''''VirtCL: A Framework for OpenCL Device Abstraction and Management''<br/>'''Yi-Ping You, Hen-Jung Wu, Yeh-Ning Tsai and Yen-Ting Chao'''<br/>'''
 +
*'''''Dynamic deadlock verification for general barrier synchronisation<br/>'''''Tiago Cogumbreiro, Raymond Hu, Francisco Martins and Nobuko Yoshida'''<br/>'''
 +
*'''''Low-Overhead Software Transactional Memory with Progress Guarantees and Strong Semantics<br/>'''''Minjia Zhang, Jipeng Huang, Man Cao and Michael Bond'''''<br/>'''''
 +
*'''''The SprayList: A Scalable Relaxed Priority Queue<br/>'''''Justin Kopinsky, Dan Alistarh, Jerry Li and Nir Shavit<br/>
 +
*'''''Performance Implications of Dynamic Memory Allocators on Transactional Memory Systems'''''<br/>Alexandro Baldassin, Edson Borin and Guido Araujo<br/>
 +
*'''''More than You Ever Wanted to Know about Synchronization'''''<br/>Vincent Gramoli<br/>
 +
*'''''Cache-Oblivious Wavefront: Improving Parallelism of Recursive DP Algorithms without Losing Cache-efficiency'''''<br/>Yuan Tang, Ronghui You, Haibin Kan, Jesmin Tithi, Pramod Ganapathi and Rezaul Chowdhury<br/>
 +
<p style="text-align: center">'''''[http://cTuning.org cTuning foundation] provided a prize of ~500$ for a distinguished artifact from CGO or PPoPP (will be announced at the conference).'''''</p>
 
<span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Discussions</span>'''</span>
 
<span style="font-size:large">'''<span style="font-family: tahoma,geneva,sans-serif">Discussions</span>'''</span>
  

Revision as of 14:38, 16 December 2014

Ae-stamp-ppopp2015.png

Artifact Evaluation for PPoPP'15

[ Back to PPoPP'15 conference website ]


Important dates

  • PPoPP paper decision: 10 Nov 2014
  • Artifact submission: 18 Nov 2014 AoE
  • Technical clarification: 10-12 Dec 2014
  • Decision announced: 16 Dec 2014
  • Public discussion: 9 Feb 2015

Packaging guidelines

We use the following guidelines for artifacts. Because we want to encourage as many of you as possible to submit, these are only guidelines, not hard rules. Of course, if the material you want us to evaluate is fairly standard, following these suggestions will greatly simplify our lives. After all, remember: You want us to be able to evaluate your artifact, don't you?

How to submit

Please read the guidelines on what to submit. Please upload your submission to EasyChair (common with CGO).

Review process

The review process is described in detail here.

Prior Artifact Evaluation

Artifacts have been already evaluated at several conferences and workshops including recent PLDI 2014, OOPSLA 2014 and ADAPT 2014. Our eventual goal is to develop the common evaluation methodology gradually and collaboratively. See artifact-eval.org and c-mind.org/reproducibility for more details.

Artifact Evaluation Committee (AEC)

Chairs:

Advisory board:

Committee members:

  • David Boehme, LLNL, USA
  • Santiago Bock, University of Pittsburgh, USA
  • Lingda Li, Rutgers University, USA
  • Lin Ma, Huawei America Research Lab, USA
  • Yiannis Nikolakopulos, Chalmers University, Sweden
  • Jeeva Paudel, University of Alberta, Canada
  • Paul Thomson, Imperial College London, UK
  • Peter Libic, Charles University in Prague, Czech Republic
  • Dave Wilkinson, University of Pittsburgh, USA
  • Weiwei Chen, Qualcomm, USA
  • Riyadh Baghdadi, ENS and University Pierre et Marie Curie, Paris, France
  • Na Meng, University of Texas Austin, USA
  • Arun Raman, Qualcomm, USA
  • Bapi Chatterjee, Chalmers University, Sweden
  • Martin Maas, University of California Berkeley, USA
  • Vojtech Horky, Charles University in Prague, Czech Republic
  • Vasileios Trigonakis, EPFL, Switzerland
  • Mahdi Eslamimehr, SAP Labs, USA
  • Yuhao Zhu, University of Texas Austin, USA
  • Melanie Kambadur, Columbia University, USA
  • Michael Laurenzano, UMich, USA

Above threshold

List of papers with artifacts above threshold:

  • NUMA-aware Graph-structured Analytics
    Kaiyuan Zhang, Rong Chen and Haibo Chen
  • Predicate RCU: An RCU for Scalable Concurrent Updates
    Maya Arbel and Adam Morrison
  • Scalable and Efficient Implementation of 3D Unstructured Meshes Computation: A Case Study on Matrix Assembly
    Loïc Thébault, Eric Petit and Quang Dinh
  • VirtCL: A Framework for OpenCL Device Abstraction and Management
    Yi-Ping You, Hen-Jung Wu, Yeh-Ning Tsai and Yen-Ting Chao
  • Dynamic deadlock verification for general barrier synchronisation
    Tiago Cogumbreiro, Raymond Hu, Francisco Martins and Nobuko Yoshida
  • Low-Overhead Software Transactional Memory with Progress Guarantees and Strong Semantics
    Minjia Zhang, Jipeng Huang, Man Cao and Michael Bond
  • The SprayList: A Scalable Relaxed Priority Queue
    Justin Kopinsky, Dan Alistarh, Jerry Li and Nir Shavit
  • Performance Implications of Dynamic Memory Allocators on Transactional Memory Systems
    Alexandro Baldassin, Edson Borin and Guido Araujo
  • More than You Ever Wanted to Know about Synchronization
    Vincent Gramoli
  • Cache-Oblivious Wavefront: Improving Parallelism of Recursive DP Algorithms without Losing Cache-efficiency
    Yuan Tang, Ronghui You, Haibin Kan, Jesmin Tithi, Pramod Ganapathi and Rezaul Chowdhury

cTuning foundation provided a prize of ~500$ for a distinguished artifact from CGO or PPoPP (will be announced at the conference).

Discussions

We consider AE as a continuous learning curve. If you have questions or comments and suggestions on how to improve packaging and reviewing process, please get in touch or use our public Google or LinkedIn groups. We will hold a joint public CGO/PPoPP AE discussion session on December 9th, 2015.



Sponsors and supporters

CTuning foundation logo1.png



(C) 2011-2014 cTuning foundation