Accendo Reliability

Your Reliability Engineering Professional Development Site

  • Home
  • About
    • Contributors
  • Reliability.fm
    • Speaking Of Reliability
    • Rooted in Reliability: The Plant Performance Podcast
    • Quality during Design
    • Way of the Quality Warrior
    • Critical Talks
    • Dare to Know
    • Maintenance Disrupted
    • Metal Conversations
    • The Leadership Connection
    • Practical Reliability Podcast
    • Reliability Matters
    • Reliability it Matters
    • Maintenance Mavericks Podcast
    • Women in Maintenance
    • Accendo Reliability Webinar Series
  • Articles
    • CRE Preparation Notes
    • on Leadership & Career
      • Advanced Engineering Culture
      • Engineering Leadership
      • Managing in the 2000s
      • Product Development and Process Improvement
    • on Maintenance Reliability
      • Aasan Asset Management
      • AI & Predictive Maintenance
      • Asset Management in the Mining Industry
      • CMMS and Reliability
      • Conscious Asset
      • EAM & CMMS
      • Everyday RCM
      • History of Maintenance Management
      • Life Cycle Asset Management
      • Maintenance and Reliability
      • Maintenance Management
      • Plant Maintenance
      • Process Plant Reliability Engineering
      • ReliabilityXperience
      • RCM Blitz®
      • Rob’s Reliability Project
      • The Intelligent Transformer Blog
      • The People Side of Maintenance
      • The Reliability Mindset
    • on Product Reliability
      • Accelerated Reliability
      • Achieving the Benefits of Reliability
      • Apex Ridge
      • Metals Engineering and Product Reliability
      • Musings on Reliability and Maintenance Topics
      • Product Validation
      • Reliability Engineering Insights
      • Reliability in Emerging Technology
    • on Risk & Safety
      • CERM® Risk Insights
      • Equipment Risk and Reliability in Downhole Applications
      • Operational Risk Process Safety
    • on Systems Thinking
      • Communicating with FINESSE
      • The RCA
    • on Tools & Techniques
      • Big Data & Analytics
      • Experimental Design for NPD
      • Innovative Thinking in Reliability and Durability
      • Inside and Beyond HALT
      • Inside FMEA
      • Integral Concepts
      • Learning from Failures
      • Progress in Field Reliability?
      • R for Engineering
      • Reliability Engineering Using Python
      • Reliability Reflections
      • Testing 1 2 3
      • The Manufacturing Academy
  • eBooks
  • Resources
    • Accendo Authors
    • FMEA Resources
    • Feed Forward Publications
    • Openings
    • Books
    • Webinars
    • Journals
    • Higher Education
    • Podcasts
  • Courses
    • 14 Ways to Acquire Reliability Engineering Knowledge
    • Reliability Analysis Methods online course
    • Measurement System Assessment
    • SPC-Process Capability Course
    • Design of Experiments
    • Foundations of RCM online course
    • Quality during Design Journey
    • Reliability Engineering Statistics
    • Quality Engineering Statistics
    • An Introduction to Reliability Engineering
    • Reliability Engineering for Heavy Industry
    • An Introduction to Quality Engineering
    • Process Capability Analysis course
    • Root Cause Analysis and the 8D Corrective Action Process course
    • Return on Investment online course
    • CRE Preparation Online Course
    • Quondam Courses
  • Webinars
    • Upcoming Live Events
  • Calendar
    • Call for Papers Listing
    • Upcoming Webinars
    • Webinar Calendar
  • Login
    • Member Home

by Fred Schenkelberg Leave a Comment

Central Limit Theorem

Central Limit Theorem

There are two basic ways to consider the central limit theorem. First consider a random variable, X, which has a mean, μ, and variance σ2. If we take a random sample from f(X) of size n and calculate the sample mean, X̄, then as n increases the distribution of the sample means, X̄’s approaches a normal distribution with mean, μ, and variance σ2/√n̄. The original data, X, may have any distribution and when n is suitably large the distribution of the averages will approach a normal distribution.

CLT2NormalAnnotatedA second way to consider the central limit theorem is often used to describe the physical phenomenon behind items that exhibit a normal distribution. Consider the length of a box nail, the final manufactured length depends on the material, cutting and shaping tools, equipment alignment and at a finer level, the material composition, the hardness, and angle of attach of the cutting and shaping tools. With a little effort, one could list many small sources of variation.

When the small perturbations are independent of each other, the sum of those variations tends to approach a normal distribution. Some call this the ‘fuzzy’ central limit theorem.

Fundamental Theorem of Probability

The central limit theorem is one the fundamental theorems of probability. It provides a foundation for most what we study under probability and statistics. In particular, the behavior of even small sample means is the reason X̄ and R control charts work. The averages are normal enough that the calculation of control limits provides meaningful insight into the process stability.

Another fundamental theorem is the law of large numbers which we’ll discuss in another article.

Standard Error of the Mean

Notice that the distribution of the sample means (blue) has less spread then the original data (orange), as apparent in the figure above. Specially the standard deviation of the sample means, σX̄ is

$$ \large\displaystyle {{\sigma }_{{\bar{X}}}}=\frac{{{\sigma }_{X}}}{\sqrt{n}}$$

This of course is estimated by

$$ \large\displaystyle {{s}_{{\bar{X}}}}=\frac{{{s}_{X}}}{\sqrt{n}}$$

The sX̄ and sX sample standard deviations.

The standard error of the mean is used in X̄ and R control charts to determine the control limits, which are plus or minus 3 standard deviation about the mean — that is ± 3 standard errors of the mean.

One final note: The Khan Academy has a sequence of excellent tutorials on this theorem.


Related:

Lognormal Distribution (article)

The Normal Distribution (article)

Laplace’s Trend Test (article)

 

Filed Under: Articles, CRE Preparation Notes, Probability and Statistics for Reliability Tagged With: Statistical Terms

About Fred Schenkelberg

I am the reliability expert at FMS Reliability, a reliability engineering and management consulting firm I founded in 2004. I left Hewlett Packard (HP)’s Reliability Team, where I helped create a culture of reliability across the corporation, to assist other organizations.

« Reliability and Monte Carlo Determined Tolerances
Why Doesn’t Product Testing Catch Everything? »

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

CRE Preparation Notes

Article by Fred Schenkelberg

Join Accendo

Join our members-only community for full access to exclusive eBooks, webinars, training, and more.

It’s free and only takes a minute.

Get Full Site Access

Not ready to join?
Stay current on new articles, podcasts, webinars, courses and more added to the Accendo Reliability website each week.
No membership required to subscribe.

[popup type="" link_text="Get Weekly Email Updates" link_class="button" ]

[/popup]

  • CRE Preparation Notes
  • CRE Prep
  • Reliability Management
  • Probability and Statistics for Reliability
  • Reliability in Design and Development
  • Reliability Modeling and Predictions
  • Reliability Testing
  • Maintainability and Availability
  • Data Collection and Use

© 2025 FMS Reliability · Privacy Policy · Terms of Service · Cookies Policy