ICST 2021
Mon 12 - Fri 16 April 2021
Tue 13 Apr 2021 15:00 - 15:30 at Boa Viagem - Journal First I Chair(s): Heike Wehrheim

Metamorphic Testing is a software testing paradigm which aims at using necessary properties of a system-under-test, called metamorphic relations, to either check its expected outputs, or to generate new test cases. Metamorphic Testing has been successful to test programs for which a full oracle is not available or to test programs for which there are uncertainties on expected outputs such as learning systems. In this article, we propose Adaptive Metamorphic Testing as a generalization of a simple yet powerful reinforcement learning technique, namely contextual bandits, to select one of the multiple metamorphic relations available for a program. By using contextual bandits, Adaptive Metamorphic Testing learns which metamorphic relations are likely to transform a source test case, such that it has higher chance to discover faults. We present experimental results over two major case studies in machine learning, namely image classification and object detection, and identify weaknesses and robustness boundaries. Adaptive Metamorphic Testing efficiently identifies weaknesses of the tested systems in context of the source test case.

Tue 13 Apr
Times are displayed in time zone: Brasilia, Distrito Federal, Brazil change

15:00 - 16:30
Journal First IJournal-First Papers at Boa Viagem
Chair(s): Heike WehrheimPaderborn University
Adaptive metamorphic testing with contextual bandits
Journal-First Papers
Helge SpiekerSimula Research Laboratory, Norway, Arnaud GotliebSimula Research Laboratory
Link to publication DOI Pre-print
Classifying generated white-box tests: an exploratory study
Journal-First Papers
Dávid Honfi, Zoltán MicskeiBudapest University of Technology and Economics
Link to publication DOI File Attached
Hansie: Hybrid and Consensus Regression Test Prioritization
Journal-First Papers
Shouvick MondalFederal University of Pernambuco, Brazil, Rupesh NasreIIT Madras, India
Link to publication DOI Media Attached File Attached