Welcome to the Artifact Evaluation Process for PLDI 2014! We hope you will submit to take advantage of this opportunity.

Learn more »


Paper decision notification:
Feb 5, 2014
Artifacts due:
Feb 10, 2014
Decisions announced:
approx. Mar 15, 2014
Camera-ready due:
Mar 20, 2014

Packaging Guidelines

We have written guidelines for artifacts. Because we want to encourage as many of you as possible to submit, these are only guidelines, not hard rules. Of course, if the material you want us to evaluate is fairly standard, following these suggestions will greatly simplify our lives. After all, remember: You want us to be able to evaluate your artifact, don't you?

How to Submit

Please read the guidelines on what to submit. Please upload your submission to EasyChair.

The Committee

The committee consists of several up-and-coming researchers with Eric Eide, Shriram Krishnamurthi, and Jan Vitek heading the process.

See the committee members!

Prior AECs

Here's a report on the AEC process for ESEC/FSE 2011. You can also see the AEC sites for ECOOP 2013 and OOPSLA 2013.


PLDI accepted 52 papers. Of these, 20 submitted transcripts. Of these, 12 were found to be above threshold.


Edward Z. Yang kindly transcribed a discussion we had about the process at PLDI 2014. Please see his transcript! (Note: this transcript has not been verified for accuracy.)


Artifact evaluation is open only to accepted papers. This is intentional: it ensures that the AEC cannot influence whether or not a paper is accepted. This measure was put in place to reassure authors who felt this would be too radical a change to the process of evaluating conference paper submissions.

Of course, this doesn't mean you can't start getting ready! We have published the packaging guidelines, so you can begin to prepare your artifacts for submission. Even if your paper doesn't get accepted, this should still be a useful exercise for general dissemination. In addition, we hope the guidelines will give you ideas about how your material can be disseminated, either by suggesting methods you hadn't considered or pointing you to resources you weren't aware of.

As soon as papers are chosen for the conference, you will be invited to submit. We will then have a few weeks in which to perform the evaluation. We may contact you if we have a problem with the submission, but there is no formal “response” period.

Thus, even though there is nothing formally to do now, you would do well to have your artifact packaged and ready to go. The moment you receive the good news, you should be ready to upload!

Above Threshold

  • John Vilk and Emery Berger. Doppio: Breaking the Browser Language Barrier (Distinguished Artifact!)
  • Yufei Cai, Paolo G. Giarrusso, Tillmann Rendel and Klaus Ostermann. A Theory of Changes for Higher-Order Languages — Incrementalizing λ-Calculi by Static Differentiation
  • Edward Yang and David Mazieres. Resource Limits for Haskell
  • Steven Arzt, Siegfried Rasthofer, Christian Fritz, Eric Bodden, Alexandre Bartel, Jacques Klein, Yves Le Traon, Damien Octeau and Patrick McDaniel. FlowDroid: Precise Context, Flow, Field, Object-sensitive and Lifecycle-aware Taint Analysis for Android Apps
  • Adrian Sampson, Pavel Panchekha, Todd Mytkowicz, Kathryn McKinley, Dan Grossman and Luis Ceze. Expressing and Verifying Probabilistic Assertions
  • Quentin Carbonneaux, Jan Hoffmann, Tahina Ramananandro and Zhong Shao. End-to-End Verification of Stack-Space Bounds for C Programs
  • Lindsey Kuper, Aaron Todd, Sam Tobin-Hochstadt and Ryan Newton. Taming the Parallel Effect Zoo: Extensible Deterministic Parallelism with LVish
  • David Greenaway, Japheth Lim, June Andronick and Gerwin Klein. Don't Sweat the Small Stuff: Formal Verification of C code without the Pain
  • Yannis Smaragdakis, George Balatsouras and George Kastrinis. Introspective Analysis: Context-Sensitivity, Across the Board
  • Rishi Surendran, Raghavan Raman, Swarat Chaudhuri, John Mellor-Crummey and Vivek Sarkar. Test-Driven Repair of Data Races in Structured Parallel Programs
  • Matthew Hammer, Yit Khoo, Michael Hicks and Jeffrey Foster. Adapton: Composable, Demand-driven Incremental Computation
  • Swarnendu Biswas, Jipeng Huang, Aritra Sengupta and Michael Bond. DoubleChecker: Efficient Sound and Precise Atomicity Checking