Accendo Reliability

Your Reliability Engineering Professional Development Site

  • Home
  • About
    • Contributors
  • Reliability.fm
    • Speaking Of Reliability
    • Rooted in Reliability: The Plant Performance Podcast
    • Quality during Design
    • Way of the Quality Warrior
    • Critical Talks
    • Dare to Know
    • Maintenance Disrupted
    • Metal Conversations
    • The Leadership Connection
    • Practical Reliability Podcast
    • Reliability Matters
    • Reliability it Matters
    • Maintenance Mavericks Podcast
    • Women in Maintenance
    • Accendo Reliability Webinar Series
  • Articles
    • CRE Preparation Notes
    • on Leadership & Career
      • Advanced Engineering Culture
      • Engineering Leadership
      • Managing in the 2000s
      • Product Development and Process Improvement
    • on Maintenance Reliability
      • Aasan Asset Management
      • AI & Predictive Maintenance
      • Asset Management in the Mining Industry
      • CMMS and Reliability
      • Conscious Asset
      • EAM & CMMS
      • Everyday RCM
      • History of Maintenance Management
      • Life Cycle Asset Management
      • Maintenance and Reliability
      • Maintenance Management
      • Plant Maintenance
      • Process Plant Reliability Engineering
      • ReliabilityXperience
      • RCM Blitz®
      • Rob’s Reliability Project
      • The Intelligent Transformer Blog
      • The People Side of Maintenance
      • The Reliability Mindset
    • on Product Reliability
      • Accelerated Reliability
      • Achieving the Benefits of Reliability
      • Apex Ridge
      • Metals Engineering and Product Reliability
      • Musings on Reliability and Maintenance Topics
      • Product Validation
      • Reliability Engineering Insights
      • Reliability in Emerging Technology
    • on Risk & Safety
      • CERM® Risk Insights
      • Equipment Risk and Reliability in Downhole Applications
      • Operational Risk Process Safety
    • on Systems Thinking
      • Communicating with FINESSE
      • The RCA
    • on Tools & Techniques
      • Big Data & Analytics
      • Experimental Design for NPD
      • Innovative Thinking in Reliability and Durability
      • Inside and Beyond HALT
      • Inside FMEA
      • Integral Concepts
      • Learning from Failures
      • Progress in Field Reliability?
      • R for Engineering
      • Reliability Engineering Using Python
      • Reliability Reflections
      • Testing 1 2 3
      • The Manufacturing Academy
  • eBooks
  • Resources
    • Accendo Authors
    • FMEA Resources
    • Feed Forward Publications
    • Openings
    • Books
    • Webinars
    • Journals
    • Higher Education
    • Podcasts
  • Courses
    • 14 Ways to Acquire Reliability Engineering Knowledge
    • Reliability Analysis Methods online course
    • Measurement System Assessment
    • SPC-Process Capability Course
    • Design of Experiments
    • Foundations of RCM online course
    • Quality during Design Journey
    • Reliability Engineering Statistics
    • Quality Engineering Statistics
    • An Introduction to Reliability Engineering
    • Reliability Engineering for Heavy Industry
    • An Introduction to Quality Engineering
    • Process Capability Analysis course
    • Root Cause Analysis and the 8D Corrective Action Process course
    • Return on Investment online course
    • CRE Preparation Online Course
    • Quondam Courses
  • Webinars
    • Upcoming Live Events
  • Calendar
    • Call for Papers Listing
    • Upcoming Webinars
    • Webinar Calendar
  • Login
    • Member Home

by André-Michel Ferrari 1 Comment

How Conservative and Prudent can a Risk Decision be? – Practical uses of Confidence Boundaries

How Conservative and Prudent can a Risk Decision be? – Practical uses of Confidence Boundaries

Introducing confidence boundaries

Confidence boundaries can be confusing to reliability engineering practitioners and their audience. Yet, they can play an important role in the risk-based decision-making process. When building statistical models, there is always uncertainty around the model because it is usually based on a smaller sample of the studied population. The confidence interval is the range of values you expect your model to fall between a certain percentage of the time if you run your experiment again or re-sample the population similarly. For example, using a 90% confidence boundary, one would expect 90% of the records to fall between the upper and lower confidence boundaries. As a rule of thumb, the more data you have, the more precise the model and the narrower the confidence boundaries.  In essence, if we have an infinite amount of data, we will end up with a perfect model. However, this is never the case. Confidence boundaries help establish the accuracy of the model and also provide some information on the validity of the data.

Example of confidence boundaries

As an example, 2 data sets from the same population are provided below. The time to failure best fit model (blue line) is established using the Rank Regression method. Also plotted are the 90% confidence upper and lower boundaries (red lines). The 90% boundary implies that 90% of the records should fall between both boundaries. It is therefore acceptable that 10% fall outside of those boundaries.  The data set on the left (Model 1) is in the early stages of the operation where only 3 records are available. Later on, with more records, we end up with the graph on the right (Model 2). The models evolve over time; the Weibull distribution parameters beta and eta change.  Model 2 is still acceptable even if one point falls out of the confidence boundary. This is because “90% within the boundary” rule is still maintained.

Model 1 and 2 Probability Plots (with most conservative value plotted in Model 1)
Model 1 and 2 Probability Plots (with most conservative value plotted in Model 1)

The graph on the left (Model 1) with the lowest number of points, has the wider confidence boundaries. With more points, Model 2 is deemed more precise and the information it will provide will be more accurate. Therefore, it has narrower confidence boundaries. However sometimes we do not have a choice when dealing with records; we end up with very little data and have to make the best decision.

Using Confidence Boundaries for conservative Risk decisions

Let us assume that the operator has to make a decision based on very small number of records; i.e., 3 as in Model 1.  That decision could be something like; what is the unreliability or the probability that the equipment fails at or before 10 days following a repair? Using the Model 1 probability plot above, we obtain the following:

  • The best fit model (blue line) tells us that the probability of failure (F) at or before 10 days is 18%.  Conversely, Reliability at 1-F equals 82%.
  • The most conversative or less optimistic value based on the lower confidence value is 44%. Conversely Reliability at 1-F equals 56% – see above graph.
  • The least conversative or more optimistic value based on the upper confidence value is 0%.   The upper confidence boundary does not intersect the 10-day value on the time axis so this implies that the asset cannot fail at or before the 10-day mark.

Being overly optimistic is not a recommended strategy in risk management. Even though we do “hope” for the best, we have to “plan for the worst” case. However, by worst-case, we mean the worst “realistic” case rather than the “world is falling apart” case. Therefore, knowing that the 3-point statistical model is not optimal yet having no alternative, a prudent operator would lean toward the lower confidence boundary. In this case, the probability of failure at or before 10 days of would be 48%.  Risk is a product of probability and consequence so the risk-based decision will be made using this value.

Looking at Model 2 when we have more data, the probability of failure at or before 10 days is will have increased to 25% for the best fit model but reduced to 42% for the lower confidence boundary. Those values are not very far from the Model 1 values so in essence Model 1 was not so inaccurate after all. Note that this similarity is based on this data set only and should not be taken as a general case.

In reliability engineering terms, “a little data is better than no data at all”. As shown in this example, using the limited amount of data we have, and using confidence boundaries, it is possible to define a conservative approach to risk management.

Filed Under: Articles, on Maintenance Reliability, The Reliability Mindset

About André-Michel Ferrari

André-Michel Ferrari is a Reliability Engineer who specializes in Reliability Analytics and Modeling which are fundamental to improving asset performance and output in industrial operations.

André-Michel has approximately 30 years of industrial experience mainly in Reliability Engineering, Maintenance Engineering, and Quality Systems Implementation. His experience includes world-class companies in the Brewing, Semiconductor, and Oil & Gas industries in Africa, Europe and North America.

« Airline Security And Lithium Battery Fires
1884 – Depreciation and Maintenance Cannot be Separated »

Comments

  1. Damilola says

    September 8, 2023 at 8:43 AM

    Thanks Andre, great analysis. for most applications and testing, I usually take the more conservative approach by recommending the lower boundary values when performing failure data analysis.

    Question?
    In application, How would you differentiate between the single and double sided confidence level?

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

The Reliability Mindset logo Photo of André-Michel FerrariArticles by André-Michel Ferrari
in the The Reliability Mindset: Practical Applications in Industry article series

Join Accendo

Receive information and updates about articles and many other resources offered by Accendo Reliability by becoming a member.

It’s free and only takes a minute.

Join Today

Recent Posts

  • test
  • test
  • test
  • Your Most Important Business Equation
  • Your Suppliers Can Be a Risk to Your Project

© 2025 FMS Reliability · Privacy Policy · Terms of Service · Cookies Policy