Data Quality content. Test reporting

1.

Data Quality
Test reporting

2.

Agenda
Test result report
Test result report sections

3.

TEST RESULT REPORT

4.

Test lifecycle overview

5.

Test Result Report
Test Result Report
(TRR)
summarize the results
– “where we are”
document which contains a summary of all test activities and final test
results of a testing project.
plan next activities –
“where we go”

6.

Test Result Report recipients
Stakeholders &
Customers
get information on
progress
Managers
make managerial
decisions
Development
Team Lead
Test Team Lead
get another
point of view
summarize
results

7.

TEST RESULT REPORT SECTIONS

8.

Test result report sections
Summary
Test team
Testing process description
Timetable
New defect statistics
New defect list
Overall defect statistics
Recommendations
Attachments

9.

TRR sections: Summary
Summary – brief and meaningful description of the main results,
achievements, problems.
For main stakeholders it should be enough to read Summary and get the
key information.

10.

TRR sections: Test team
Test team – list of people involved in testing during the reporting time.
Name
Olga Sidorova
Ivan Petrov
Maryia Ivanova
Role
Senior developer
Developer
Tester
Responsibility
Participation in requirements testing and code-review
Code-review, participation in scripts for automated testing creation
Requirements testing, documentation creation, test cases creation,
test cases execution

11.

TRR sections: Test process description
Test process description – description of what and how the test team
was doing.
what environment was used
what type of testing was used

12.

TRR sections: Timetable
Timetable – description of test activities divided by date.
Name
Olga Sidorova
Maryia Ivanova
Maryia Ivanova
Ivan Petrov
Date
05.10-06.10
05.10-06.10
07.10-09.10
07.10-09.10
Activity
Requirements testing, code-review
Requirements testing
Test cases creation
Scripts for automated testing creation
Duration, hours
2
5
22
5

13.

TRR sections: New defects statistics
New defects statistics – numbers of defects found/fixed/etc during the
reporting time.
preferable if this is an automatic export from a bug-tracking system
Status
Submitted
Fixed
Verified
Reopened
Declined
Quantity
11
13
20
4
0
Minor
3
7
9
0
0
Severity
Major
3
4
7
4
0
Critical
0
2
4
0
0

14.

TRR sections: New defects list
New defects list – list of defects found during the reporting time.
ID
UPSQA-6
UPSQA-12
UPSQA-13
Severity
Major
Major
Major
Summary
Required formats are recognized as Duplicates files in output
DuplicatesOnly Mode output data is missing
Original files are recognized as duplicates in data output

15.

TRR sections: Overall defects statistics
Overall defects statistics – numbers of all defects found/fixed/etc from
the beginning of the project.
preferable if this is an automatic export from a bug-tracking system
Status
Submitted
Fixed
Verified
Reopened
Declined
Quantity
56
113
94
15
4
Minor
30
72
48
2
2
Severity
Major
16
24
37
5
1
Critical
10
17
9
8
1

16.

Test metrics
What is a question?
Number of open bugs
Bugs per module
Bugs posted per week / sprint
Bugs rejected / accepted
Bug Growth
Defect Containment
Defect Density
Defect Leakage
Invalid Defects
Open Bugs Over Time by Priority
Quality Debt
Reopened Defects
Resolution Time for Production Defects
Time Spent on Bug Fixing
Top Priority Defects Age Alert
https://delivery.epam.com/perf/help/Quality_717764948.html

17.

TRR sections: Recommendations
Recommendations – suggested actions based upon an evaluation of the
test results and key measures of the test.

18.

TRR sections: Attachments/appendixes
Attachments/appendixes – section containing any useful data
(documents, logs, charts, drawings, schemas, etc.) of the test results or
key measures of the test.

19.

Q&A