Flaky Test Experience
About
My project (GitHub Link) consisted of three main tasks:
- Reading and analyzing papers treating software engineering for machine learning.
- Developing an extensible framework for approximate assertion detection in large libraries
- Creating software for automated logging and seeding of assertions across different types of assertions and randomness generators
Accomplishing these tasks involved critical thinking, Python, Abstract Syntax Trees (AST Library), and argparse for command-line interfacing.
Demo
Example of automated seeding and logging (images can be read more clearly if opened in a new tab):
![](/images/flaky-initial.png)
![](/images/flaky-final.png)
Motivation
This project was initially assigned as a research assessment, and I took it beyond the initial project parameters.