How does the Quality is being tracked?

The quality is being tracked on the convergence of meeting the release criteria such as a number of tests executed/passed/open P1/P2/P3 bugs, Stress/Longevity criteria, Performance targets, code coverage, etc.

To track the quality, below are some of the measurements done on each build or sprint or weekly basis.

  • Test Execution metrics: track the dev code changes and testing progress since the last build or tracking period.
  • Bug Metrics/Defect Tracking: the number of open bugs and closed bugs since last build or tracking period.
  • Code Coverage: %class, %method, %line coverage since the last build or tracking period.
  • Performance Numbers: throughput numbers since the last build or tracking period.
  • Bugs metrics containing incoming and fixing of bugs would be plotted as graphs and tracked on a weekly basis. A bell curve is what expected for the period of product testing cycle. That means initially, incoming or new bugs would be low and later in high and then later goes down again as fixing bugs. If deviated from this bell curve, then there might be the possibility of low quality as bugs keep coming, and convergence of release is not meeting the criteria.
  • The quality is assessed and projected at different levels than in absolute numbers. These are –
    • High quality
    • Medium quality
    • Low quality

The high-quality product should be the target of any good product and of course, it would cost more compared to a low-quality product.


[Visit , India]

Author: Jagadesh Babu Munta

Jagadesh Babu Munta is working as a Consulting Member of Technical Staff with Oracle America Inc. He has been with Oracle and Sun Microsystems together for over 16 years (since June 2000) in USA. Jagadesh has overall 20+ years of Software development and quality/testing experience. Jagadesh's experience has been filled recently with Cloud PaaS services, Multi-Tenancy, Security and Penetration testing. In the past, he extensively worked on Java EE servers like SailFin/GlassFish/Sun Java System/iPlanet/Netscape Application Servers. Jagadesh has gained extensive expertise in software automation, designing frameworks, writing tools, scripts, creating tests, writing specs/plans, etc. Jagadesh is interested in developing and testing complex software useful to up-level the humanity. Jagadesh Munta holds M.S. in Software Engineering from San Jose State University, California, USA; B.Tech. in Computer Science and Engineering from J.N.T.U., Hyderabad, India; Special Diploma in Electronics with Specialization in Computer Engineering, G.I.O.E, Secunderabad, India. Jagadesh Munta was born in Nellore, AP., India and lives with family in Fremont, California, USA.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: