Microsoft
One of the greatest costs associated with test automation is the cost to analyze failures. Even a small number of test cases can generate an arbitrary number of failures when executed across languages, platforms, SKUs, and other environmental variations.
Automated Failure Analysis is the method of determining if a given failure has previously been observed. It applies a minimum standard of failure analysis to each test failure and prevents any problem tests from being mentally swept under the rug as being unreliable or untrustworthy. Discussed will be the performance of one AFA solution over the past two years in a production environment, and the lessons learned from the experience.