Accendo Reliability

Your Reliability Engineering Professional Development Site

  • Home
  • About
    • Contributors
  • Reliability.fm
    • Speaking Of Reliability
    • Rooted in Reliability: The Plant Performance Podcast
    • Quality during Design
    • Way of the Quality Warrior
    • Critical Talks
    • Dare to Know
    • Maintenance Disrupted
    • Metal Conversations
    • The Leadership Connection
    • Practical Reliability Podcast
    • Reliability Matters
    • Reliability it Matters
    • Maintenance Mavericks Podcast
    • Women in Maintenance
    • Accendo Reliability Webinar Series
  • Articles
    • CRE Preparation Notes
    • on Leadership & Career
      • Advanced Engineering Culture
      • Engineering Leadership
      • Managing in the 2000s
      • Product Development and Process Improvement
    • on Maintenance Reliability
      • Aasan Asset Management
      • AI & Predictive Maintenance
      • Asset Management in the Mining Industry
      • CMMS and Reliability
      • Conscious Asset
      • EAM & CMMS
      • Everyday RCM
      • History of Maintenance Management
      • Life Cycle Asset Management
      • Maintenance and Reliability
      • Maintenance Management
      • Plant Maintenance
      • Process Plant Reliability Engineering
      • ReliabilityXperience
      • RCM Blitz®
      • Rob’s Reliability Project
      • The Intelligent Transformer Blog
      • The People Side of Maintenance
      • The Reliability Mindset
    • on Product Reliability
      • Accelerated Reliability
      • Achieving the Benefits of Reliability
      • Apex Ridge
      • Metals Engineering and Product Reliability
      • Musings on Reliability and Maintenance Topics
      • Product Validation
      • Reliability Engineering Insights
      • Reliability in Emerging Technology
    • on Risk & Safety
      • CERM® Risk Insights
      • Equipment Risk and Reliability in Downhole Applications
      • Operational Risk Process Safety
    • on Systems Thinking
      • Communicating with FINESSE
      • The RCA
    • on Tools & Techniques
      • Big Data & Analytics
      • Experimental Design for NPD
      • Innovative Thinking in Reliability and Durability
      • Inside and Beyond HALT
      • Inside FMEA
      • Integral Concepts
      • Learning from Failures
      • Progress in Field Reliability?
      • R for Engineering
      • Reliability Engineering Using Python
      • Reliability Reflections
      • Testing 1 2 3
      • The Manufacturing Academy
  • eBooks
  • Resources
    • Accendo Authors
    • FMEA Resources
    • Feed Forward Publications
    • Openings
    • Books
    • Webinars
    • Journals
    • Higher Education
    • Podcasts
  • Courses
    • 14 Ways to Acquire Reliability Engineering Knowledge
    • Reliability Analysis Methods online course
    • Measurement System Assessment
    • SPC-Process Capability Course
    • Design of Experiments
    • Foundations of RCM online course
    • Quality during Design Journey
    • Reliability Engineering Statistics
    • Quality Engineering Statistics
    • An Introduction to Reliability Engineering
    • Reliability Engineering for Heavy Industry
    • An Introduction to Quality Engineering
    • Process Capability Analysis course
    • Root Cause Analysis and the 8D Corrective Action Process course
    • Return on Investment online course
    • CRE Preparation Online Course
    • Quondam Courses
  • Webinars
    • Upcoming Live Events
  • Calendar
    • Call for Papers Listing
    • Upcoming Webinars
    • Webinar Calendar
  • Login
    • Member Home

by Ray Harkins Leave a Comment

Measuring Quality Control Effectiveness

Measuring Quality Control Effectiveness

Aside from meeting specific requirements within quality standards such as ISO 9001 and ISO 13485, well-designed quality system metrics can also serve as meaningful indicators of the strengths and weaknesses of your organization’s processes. As a quality manager, I often consider how precisely our quality system objectives and other metrics describe the effectiveness of our quality processes. Certain metrics such as customer-reported DPPM and customer survey results usually serve to indicate your customers’ satisfaction related to quality. As metrics such as these are tracked over time, managers get a general sense of improvement or decline. Composite measures such as these, however, do not discriminate between quality assurance (preventive) and quality control activities.

Recently, I was considering the effectiveness of my company’s quality system in shielding our customers from our production processes’ failings. In other words, we know that our manufacturing processes aren’t perfect, and that they do create defects. Therefore, we have several quality control systems in place designed to cull these defects from the material we ship to our customers. These systems include various automated inspections, manual sorting, rework, auditing, etc. And so the question is: How effective is the sum of these quality control efforts?

Most organizations measure their internal rejects by part number, process, or some other logical grouping. Similarly, organizations also typically measure their customer-reported defects by percent defective or DPPM. By combining these metrics, an organization can determine the effectiveness of their quality control processes.

Consider the data table of internally and externally reported defects and their associated DPPM values by year shown in Figure 1. Columns C, E, and G show the actual number of reported defects internally, externally, and in total, respectively. Columns D, F, and H use the values from column B (PCS Shipped) and the reported defects to calculate Internal, Customer, and Total DPPM, respectively. See the formula for DPPM below:

In this case, we see year-over-year improvement in both Internal and Customer-Reported Defects and DPPM. This suggests that certain factors such as continual improvement activities and product mix are leading to fewer total defects in the product stream. This is welcomed news for any organization, but the typical product quality metrics stop at this point.

The Quality Control Effectiveness (QCE) metric shown in the far-right column of Figure 1 assumes that the total number of defects in the population is the sum of the internally reported and customer-reported reported defects. The formula for this metric is then:

Using this formula, we can see that in 2014 this organization prevented 89.8 percent of the total defects produced from getting to their customers. We can also see that although the total defects and DPPM trended favorably year over year, the QCE did not. A lower QCE indicates that a lower percentage of the total defects were captured prior to shipment.

QCE is essentially a measure of the effectiveness of your defect detection processes. An upward trending QCE could indicate improving defect detection systems, while a downward trending QCE could indicate degrading defect detection systems or a product mix that contains defects that are difficult to detect. If I were consulting for a company with these quality metrics, I would suggest that they examine their quality control systems. It may be that their inspection methods are not keeping pace with their customers’ increasing quality expectations.

Two notes of caution while applying this metric: First, QCE does not account for the severity of the defects produced. Therefore, an organization’s QCE may be trending upward while their customer’s satisfaction is trending downward if their processes are allowing fewer but more severe defects to escape. Secondly, QCE may be a biased estimator since customer defect data tends to be under-reported, and supplier defect data tends to be over-reported relative to the true number of defects in the population.

While this example uses the QCE metric to compare one year to the next, a quality professional can also use it to make comparisons of part families, manufacturing facilities, or any other logical grouping. Developing metrics that distinguish between defect prevention and defect detection may unlock your organization’s next level of quality improvement.

To rachet up your manufacturing skill set at an affordable price, check out the variety of quality, manufacturing and business-finance related online courses Ray Harkins teaches on Udemy.com:

 

Filed Under: Articles, on Tools & Techniques, The Manufacturing Academy

About Ray Harkins

Ray Harkins is a senior manufacturing professional with over 25 years of experience in manufacturing engineering, quality management, and business analysis.

During his career, he has toured hundreds of manufacturing facilities and worked with leading industry professionals throughout North America and Japan.

« Inherent Reliability Explained
Uptime – Essentials: You need these »

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Logo for The Manufacturing Acadamey headshot of RayArticle by Ray Harkins
in the The Manufacturing Academy article series

Join Accendo

Receive information and updates about articles and many other resources offered by Accendo Reliability by becoming a member.

It’s free and only takes a minute.

Join Today

Recent Posts

  • test
  • test
  • test
  • Your Most Important Business Equation
  • Your Suppliers Can Be a Risk to Your Project

© 2025 FMS Reliability · Privacy Policy · Terms of Service · Cookies Policy