header people with mask

Do the Test Smells Assertion Roulette and Eager Test Impact Students’ Troubleshooting and Debugging Capabilities?

Authors: Wajdi Aljedaani, Mohamed Wiem Mkaouer, Anthony Peruma, Stephanie Ludi

Year 2023

PDF Cite DOI

Abstract. To ensure the quality of a software system, devel- opers perform an activity known as unit testing, where they write code (known as test cases) that verifies the individual software units that make up the system. Like production code, test cases are subject to bad programming practices, known as test smells, that hurt maintenance activities. An essential part of most maintenance activities is program comprehension which involves developers reading the code to understand its behavior to fix issues or update features. In this study, we conduct a controlled experiment with 96 undergraduate computer science students to investigate the impact of two common types of test smells, namely Assertion Roulette and Eager Test, on a student's ability to debug and troubleshoot test case failures. Our findings show that students take longer to correct errors in production code when smells are present in their associated test cases, especially Assertion Roulette. We envision our findings supporting academia in better equipping students with the knowledge and resources in writing and maintaining high-quality test cases.

Research Question: To what extent do Assertion Roulette and Eager Test impact the time spent by students in debugging failing test cases?

Research Question fiqure
Research Question fiqure Research Question fiqure Research Question fiqure

Experimental Material


Source Code Files


Tutorial Artifacts

Tutorial for Windows OS

Tutorial for Mac OS


Tutorial Documentation