This is the artifact for the CC 2024 paper:

Accurate Coverage Metrics for Compiler-Generated Debugging Information

by J. Ryan Stinnett and Stephen Kell.

The data directory includes various scripts and notebooks used to produce the figures included in the paper.

The figures directory contains the figures as shown in the published paper.

The basic pipeline to reproduce a figure for a given program under analysis (e.g. Git which is used in most figures) is:

1. Check out project source at commit in the table below
2. Run prepare.sh in the project source directory
3. Run build.sh in the project source directory
4. Run check-quality.sh in the data/[project] directory of this repo
5. Use the notebook in data/[project]

Some scripts currently use system-specific paths to locate compilers and other tools, so some modifications may be needed. Review vars.sh and adjust path values as needed.

Source code for each project under analysis will be needed. For the paper, the following projects and commits were used:

Most published figures focus on the Git codebase, so consider starting there.

In addition, some other tools are invoked by scripts here:

The following compiler versions are used:

• Clang 12.0.0
• Clang 13.0.0
• Clang 14.0.0
• Clang 15.0.0
• Clang 16.0.0
• Clang 17.0.1
• GCC 10.5.0
• GCC 11.4.0
• GCC 12.3.0
• GCC 13.1.0

Our results were collected on macOS 13.6 for the x86-64 architecture. Other platforms may give different results, as some compilers may enable different debug info features by default for each target platform.