AE Committee Statistics
A cross-community analysis of Artifact Evaluation Committee composition, retention, and geographic diversity — comparing systems and security conferences tracked in ReproDB.
Overview
Committee Sizes by Conference
Darker cells indicate larger committees. Cells below 5 members (likely incomplete data) are omitted.
Committee Growth
Total committee assignments per year, split by area. Growth reflects both new conferences adopting AE processes and existing committees scaling up.
Service Frequency
How many terms do evaluators serve? Most serve once, but a growing cohort returns repeatedly — building institutional knowledge.
Retention Trends
Year-over-year retention: what fraction of each year’s committee served the previous year? The “overall” line tracks retention across area boundaries (e.g., a security evaluator who switches to systems counts as retained).
AE Committee Flow
How do AE committee members flow between conferences? This Sankey diagram shows shared members between conference AECs in consecutive years — revealing which conferences share evaluator pools and how members move across venues.
Geographic Diversity
Top Countries — Systems vs Security
North America dominates both areas, but geographic profiles differ: Europe has a larger share in security committees.
Top Institutions by Area
Cross-Community Overlap
Only a small fraction of evaluators serve in both systems and security — the two communities have largely separate AE member pools.