Abstract.Machine learning (ML) systems typically involve complex decision making mechanisms while lack clear and concise specifications. Demonstrating the quality of ML systems therefore is a challenging task. We propose an approach combining formal methods and metamorphic testing for improving the quality of ML systems. In particular, our framework enables the possibility of developing policing functions for runtime monitoring ML systems based on metamorphic relations.
Keywords. Policing function; Metamorphic Testing; Formal Methods; Machine Learning Systems;