Methodology

The following pages explain how we collect, process, and analyze artifact evaluation data, including detailed calculation formulas for all metrics displayed on this site. ReproDB also includes automatically discovered artifact links from ArtiFinder, documented on the dedicated ArtiFinder page below.

• Data Collection
• Pipeline
• Author Metrics
• Institution Metrics
• Repository Statistics
• Search Keywords
• ArtiFinder Discovery

Overview

	AE-evaluated	ArtiFinder-discovered
Data Schema Version	0.3.0	—
Artifacts / discovered links	3118	3570
Conferences	15 (ACSAC, ATC, CAIS, CHES, EUROSYS, FAST, NDSS, OSDI, PETS, SC, SOSP, SP, SYSTEX, USENIXSEC, WOOT)	4 (CCS, NDSS, SP, USENIXSEC)
Years Covered	2017-2026	2017–2025
Authors	9099	8766
AE Committee Members	4818 (2666 unique)	—
Badges / scores	Yes	No (unverified)
Last Updated	2026-08-02 13:58:53 UTC	2026-07-09

Conferences Covered

Data is collected from conferences tracked by sysartifacts and secartifacts:

• Systems: ATC, CAIS, EUROSYS, FAST, OSDI, SC, SOSP
• Security: ACSAC, CHES, NDSS, PETS, SP, SYSTEX, USENIXSEC, WOOT

---

API Access

The full artifact dataset is available as a public JSON endpoint for programmatic access:

GET https://reprodb.github.io/assets/data/search_data.json

Returns an array of all 3118 artifacts with title, authors, affiliations, conference, year, badges, and repository/artifact URLs. No authentication required.

Example using curl:

# Get all artifacts
curl -s https://reprodb.github.io/assets/data/search_data.json | python3 -c "
import sys, json
data = json.load(sys.stdin)
# Filter: fuzzing papers from 2024
results = [a for a in data if 'fuzz' in a['title'].lower() and a['year'] == 2024]
print(json.dumps(results, indent=2))
"