When testing meets code review
Has this study been replicated?
The atlas records 1 replication of this study. Recorded outcomes: 1 mixed. The earliest on record is from 2026.
Replications
- Test Code Review in the Era of GitHub Actions: A Replication Study, Sun et al. (2026). arXiv. Outcome recorded: mixed.
Our replication reveals structural differences in how reviewers discuss test code: on GitHub, reviewers focus more on superficial code improvements (35% to 55%), while devoting less attention to defect detection and comprehension than on Gerrit. Notably, after the adoption of GHA, discussions on both test improvement and defect detection topics further declined, suggesting a shift of reviewer attention away from the quality of test code. • Our analysis of PRs that change…
Outcome read from the introduction. View paper
Cite this record
Spadini, D., Aniche, M., Storey, M.-A., Bruntink, M., & Bacchelli, A. (2018). When testing meets code review. Proceedings of the 40th International Conference on Software Engineering, 677–687. https://doi.org/10.1145/3180155.3180192
Other studies in the atlas
Failed replications · Successful replications · All browse pages