Enhanced Reporting
Enhanced reporting is orchestration of various components that were developed and integrated to reduce the validation effort and have a quick turnaround to identify blockers for data releases. Rule based engine to find ship blockers in the KOF Failures. Judgement portal for test team to judge and provide reason for ignorable vs ship blocker failures
Business Problem
For each data release analyzing the KOF failures within a specified time period is challenging and at the time we should not miss any ship blockers which will lead to bad quality of data. Also, there is no easy or quick way to compare the failures against previous releases. History of failures are not maintained anywhere, so that known failures can be skipped.
Solution
- Turnaround time is reduced to find the ship-blockers.
- All reports are at one single location instead of over emails.
- Comparison between the build failures is available immediately after the CD pipeline ends.
- Sample failures are picked for easier debugging so that developer does not have to go through the entire failure set
- History of failures is maintained at a single location
Why is the solution unique
It reduces lot of manual effort by providing single UI portal with all required data at one place. It saves ~$260K cost per year by saving 1560 hours of dev time. The rules are created in xml and are threshold based and value comparison based rules and existing rules can be configured in xml hence no change is required in binaries for adjusting the rules. Email notification about ship blockers to act on them quickly. Shows the KOF failure comparison with the LKG and last 10 builds which will help in identifying the frequent failures and to fix them permanently.
Features/BP diagram of the solution
- Entity Type and Market wise results – Added entity type and market dimensions to validation results to easily identify data issues.
- ER portal – UI developed to display various enhanced reports.
- It displays the KOF test failure reports.
- Displays Rule engine results.
- Gives an option to override rule engine results and add user comments.
