Accendo Reliability

Your Reliability Engineering Professional Development Site

  • Home
  • About
    • Contributors
  • Reliability.fm
    • Speaking Of Reliability
    • Rooted in Reliability: The Plant Performance Podcast
    • Quality during Design
    • Way of the Quality Warrior
    • Critical Talks
    • Dare to Know
    • Maintenance Disrupted
    • Metal Conversations
    • The Leadership Connection
    • Practical Reliability Podcast
    • Reliability Matters
    • Reliability it Matters
    • Maintenance Mavericks Podcast
    • Women in Maintenance
    • Accendo Reliability Webinar Series
  • Articles
    • CRE Preparation Notes
    • on Leadership & Career
      • Advanced Engineering Culture
      • Engineering Leadership
      • Managing in the 2000s
      • Product Development and Process Improvement
    • on Maintenance Reliability
      • Aasan Asset Management
      • AI & Predictive Maintenance
      • Asset Management in the Mining Industry
      • CMMS and Reliability
      • Conscious Asset
      • EAM & CMMS
      • Everyday RCM
      • History of Maintenance Management
      • Life Cycle Asset Management
      • Maintenance and Reliability
      • Maintenance Management
      • Plant Maintenance
      • Process Plant Reliability Engineering
      • ReliabilityXperience
      • RCM Blitz®
      • Rob’s Reliability Project
      • The Intelligent Transformer Blog
      • The People Side of Maintenance
      • The Reliability Mindset
    • on Product Reliability
      • Accelerated Reliability
      • Achieving the Benefits of Reliability
      • Apex Ridge
      • Metals Engineering and Product Reliability
      • Musings on Reliability and Maintenance Topics
      • Product Validation
      • Reliability Engineering Insights
      • Reliability in Emerging Technology
    • on Risk & Safety
      • CERM® Risk Insights
      • Equipment Risk and Reliability in Downhole Applications
      • Operational Risk Process Safety
    • on Systems Thinking
      • Communicating with FINESSE
      • The RCA
    • on Tools & Techniques
      • Big Data & Analytics
      • Experimental Design for NPD
      • Innovative Thinking in Reliability and Durability
      • Inside and Beyond HALT
      • Inside FMEA
      • Integral Concepts
      • Learning from Failures
      • Progress in Field Reliability?
      • R for Engineering
      • Reliability Engineering Using Python
      • Reliability Reflections
      • Testing 1 2 3
      • The Manufacturing Academy
  • eBooks
  • Resources
    • Accendo Authors
    • FMEA Resources
    • Feed Forward Publications
    • Openings
    • Books
    • Webinars
    • Journals
    • Higher Education
    • Podcasts
  • Courses
    • 14 Ways to Acquire Reliability Engineering Knowledge
    • Reliability Analysis Methods online course
    • Measurement System Assessment
    • SPC-Process Capability Course
    • Design of Experiments
    • Foundations of RCM online course
    • Quality during Design Journey
    • Reliability Engineering Statistics
    • Quality Engineering Statistics
    • An Introduction to Reliability Engineering
    • Reliability Engineering for Heavy Industry
    • An Introduction to Quality Engineering
    • Process Capability Analysis course
    • Root Cause Analysis and the 8D Corrective Action Process course
    • Return on Investment online course
    • CRE Preparation Online Course
    • Quondam Courses
  • Webinars
    • Upcoming Live Events
  • Calendar
    • Call for Papers Listing
    • Upcoming Webinars
    • Webinar Calendar
  • Login
    • Member Home

by Andrew Kelleher 2 Comments

Why “Big Data” is NOT the Holy Grail for Process Plant Reliability Engineering

Why “Big Data” is NOT the Holy Grail for Process Plant Reliability Engineering

Data is good.  Quality data is better.  “Big data” is even fashionable.  But it won’t help you solve a “small data” problem.

Let me guess.  The quality of your CMMS data is not great, but if it was, you could really do something with it.  Since decades, in fact.  Just need to re-tweak those failure codes!

And recently, you were very tempted by a consultant’s new “data-driven” approach that promised to deliver staggering results.  And why not?

Because it’s not a “big data” problem.

Some problems are not to be solved by “big data”

The truth is that the complex stochastic behavior of your production system cannot be tamed by a single algorithm.  Nor can its behavior be known via the collection of “unstructured” data.  Figure 1 shows an example of the unstructured data contained within your CMMS.

pastedGraphic.png
Figure 1: An example of the “unstructured data” contained within your CMMS.

Not convinced?  Take a look at the OREDA handbook; an amazing collection of 39000 failure and 73000 maintenance records for 17000 equipment.  All the high-quality data the heart desires.  But can you do anything useful with it?

“Significance and structure” are more important than “quality and quantity”

Don’t get me wrong; data is still good.  But the focus on data “quality” and “quantity” is, in this case, misplaced.  The analysis of a complex stochastic system requires more focus to be placed on data “significance” and “structure”.  Figure 2 illustrates the derivation of “significant” data from the CMMS data shown at Figure 1.

pastedGraphic_1.png
Figure 2: The generation of “significant” data, e.g. Weibull distribution parameters.

“Significant” data, when appropriately structured, will describe the behavior of the production system and thereby enable its optimization.  Data “structure” is understood to be the rules and relationships that define how an individual data value impacts the system behavior.

Data may be structured, for example, by placing it within the context of a model that simulates the production system behavior.  Refer, for example, Figure 3.  The original CMMS data (refer Figure 1) has been turned into significant data (refer Figure 2) and is given “structure” at Figure 3.

pastedGraphic_2.png
Figure 3: Using a model to “structure” the “significant” plant data for Pumps A and B.

The “small data” problem and its implications

Parameters describing a pump’s stochastic behavior are estimated at Figure 2.  The confidence intervals are broad, owing to the quantity of available data.  This reflects the “standard” situation within the context of a process plant environment.

The uncertainty is NOT a problem.  It is THE problem.  It is THE NATURE of the process plant reliability engineering problem.  A small data problem.

The small data problem implies that mitigating measures need to be stochastically robust to compensate for the inherent uncertainty.  For example, the installation of a redundant pump is a stochastically robust mitigating measure.

At Figure 3, a simple system is modeled.  The simple model may be placed within a larger model, and so on, until eventually the entire production system is modeled.  Hundreds of small data problems.

Do not despair!  Just apply the principles of systems reliability engineering!

So, what have we learned?  Let me summarize:

  • Your CMMS is full of insignificant, unstructured data.
  • You have not started collecting the “significant” data that describes your production system.
  • You have no way of structuring your “significant” data.
  • You have no time to solve the hundreds of small data problems.

But there is no need to despair.  The CMMS contains valuable data that can be used to generate significant data.  Your team has a heap of knowledge, experience and intuition that can be used to generate significant data, e.g. via expert interview.  And the principles of systems reliability engineering will help you prioritize where to start and the level of detail required; not all subsystems are worth optimizing!

RAMS Mentat GmbH has developed an innovate technical and systems engineering approach – and supporting tools – that enables the reliability and safety performance of an entire production system to be optimized with consideration of capital investment, operational and maintenance cost constraints.

Filed Under: Articles, on Maintenance Reliability, Process Plant Reliability Engineering

About Andrew Kelleher

Andrew Kelleher is a Materials and Systems Reliability Engineer with many years of industrial experience (1999 to 2021) in diverse fields of safety and reliability engineering at renowned companies in Australia, England, and Germany, including: The Welding Institute, ExxonMobil, QinetiQ Aerostructures, Bayer and Covestro.

« Effective Communication Is The #1 Thing That Changes Your Life
How Can v Why: What’s the Difference? »

Comments

  1. JD Solomon says

    January 20, 2022 at 4:40 AM

    The secret sauce is in what you do with the small data. Good article.

    Reply
  2. Oleg Ivanov says

    January 24, 2022 at 9:12 AM

    I remembered the fairy tale Stone Soup. If we have a special tool (Stone), then any additive (meat, potatoes, carrots, onions, tomatoes) can be useful. I am talking about data.

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Headshot of Andrew KelleherArticles by Andrew Kelleher
in the Process Plant Reliability Engineering article series

Join Accendo

Receive information and updates about articles and many other resources offered by Accendo Reliability by becoming a member.

It’s free and only takes a minute.

Join Today

Recent Posts

  • test
  • test
  • test
  • Your Most Important Business Equation
  • Your Suppliers Can Be a Risk to Your Project

© 2025 FMS Reliability · Privacy Policy · Terms of Service · Cookies Policy