July 17, 2020

Paris-based Postdoc on Large-scale Reproducibility in Software Engineering

Inria and Microsoft Research, in the context of the Software Heritage project, are seeking a postdoctoral researcher on the topic of Large-scale Reproducibility and Replicability in Empirical Software Engineering. Read on if you are interested in the position.

What you will do

  • Identify, via a systematic literature review, major results in the field of empirical software engineering that can be replicated in a reasonable amount of time at the scale of the Software Heritage archive. The archive, the largest of its kind, contains 8 billion unique source code files and almost 2 billion unique commits, retrieved from more than 130 million software projects.

    Particular care will be devoted to selecting past studies related to developer productivity, but any major study in the field of empirical software engineering will be a candidate for further replicability assessment.

  • Reproduce or replicate (to be determined on a case-by-case basis) the selected studies on the largest possible subset of the Software Heritage archive. This step will require identifying the needed artifacts to reproduce/replicate previous findings and possibly develop dedicated analysis techniques that can scale up to the size of the target archive.
  • Document the results of each replication experiment, either a confirmation or a refutation of the original findings, in a dedicated scientific paper to be submitted to dedicated tracks of major software engineering conferences (e.g., “RENE” tracks, for REplication and NEgative results) and journals (e.g., special issues on the topic of reproducibility).
  • Present work and results at scientific meetings.

Who will you work with

What is required

  • PhD degree in computer science, computer engineering, applied mathematics, or a related technical field.
  • Proven experience in conducting large experiments in empirical software engineering, mining software repositories, or related sub-fields in software engineering.
  • Proven experience with one or more state-of-the-art, large-scale, distributed, grid-, or cloud-based computing platform.
  • Proven consensus builder in a highly collaborative environment.
  • Excellent written and oral communication skills.

Will be considered a plus

  • Experience with the analysis of the large graphs (e.g., webgraph or social network graphs) and related compression techniques.
  • Experience with machine learning and big code analysis.
  • Technical participation in popular Free/Open Sources Software projects.

Workplace and salary

Work place is Inria’s Paris headquarters.

The job is a full-time, 18 months, postdoctoral appointment with the possibility of extending the period to 24 months.

The salary will be commensurate with experience and qualifications. Candidates with a strong research track record in the field might be eligible for a Inria Starting Research Position contract for this postdoc position, which comes with significant benefits over a standard postdoc contract.

Application instructions

Applications must be submitted via email to The email must contain the subject line “Postdoctoral researcher”. A complete application should include:

  • resume,
  • cover letter, and
  • links to any previous related publications, software, and/or datasets.

All materials must be in a free format (such as plain text, PDF, or OpenDocument, and not Microsoft Word). Email submissions that do not follow these instructions could be desk rejected.

The preferred starting date for the position is January 2021.

The posting shall remain open until the position is filled.

Inria is an equal opportunity employer and will not discriminate against any employee or application for employment on the basis of race, color, marital status, religion, age, sex, sexual orientation, national origin, handicap, or any other legally protected status. We value diversity in our workplace.

July 17, 2020