ICST 2021
Mon 12 - Fri 16 April 2021
Tue 13 Apr 2021 16:00 - 16:30 at Boa Viagem - Journal First I Chair(s): Heike Wehrheim

Traditionally, given a test-suite and the underlying system-under-test, existing test-case prioritization heuristics report a permutation of the original test-suite that is seemingly best according to their criteria. However, we observe that a single heuristic does not perform optimally in all possible scenarios, given the diverse nature of software and its changes. Hence, multiple individual heuristics exhibit effectiveness differently. Interestingly, together, the heuristics bear the potential of improving the overall regression test selection across scenarios. In this paper, we pose the test-case prioritization as a rank aggregation problem from social choice theory. Our solution approach, named Hansie, is two-flavored: one involving priority-aware hybridization, and the other involving priority-blind computation of a consensus ordering from individual prioritizations. To speed-up test-execution, Hansie executes the aggregated test-case orderings in a parallel multi-processed manner leveraging regular windows in the absence of ties, and irregular windows in the presence of ties. We show the benefit of test-execution after prioritization and introduce a cost-cognizant metric (EPL) for quantifying overall timeline latency due to load-imbalance arising from uniform or non-uniform parallelization windows. We evaluate Hansie on 20 open-source subjects totaling 287,530 lines of source code, 69,305 test-cases, and with parallelization support of up to 40 logical CPUs.

25 min. presentation (slides) (hansie_icst_2021.pdf)2.33MiB

Tue 13 Apr

Displayed time zone: Brasilia, Distrito Federal, Brazil change

15:00 - 16:30
Journal First IJournal-First Papers at Boa Viagem
Chair(s): Heike Wehrheim Paderborn University
Adaptive metamorphic testing with contextual bandits
Journal-First Papers
Helge Spieker Simula Research Laboratory, Norway, Arnaud Gotlieb Simula Research Laboratory
Link to publication DOI Pre-print
Classifying generated white-box tests: an exploratory study
Journal-First Papers
Dávid Honfi , Zoltán Micskei Budapest University of Technology and Economics
Link to publication DOI File Attached
Hansie: Hybrid and Consensus Regression Test Prioritization
Journal-First Papers
Shouvick Mondal Federal University of Pernambuco, Brazil, Rupesh Nasre IIT Madras, India
Link to publication DOI Media Attached File Attached