Accendo Reliability

Your Reliability Engineering Professional Development Site

  • Home
  • About
    • Contributors
  • Reliability.fm
    • Speaking Of Reliability
    • Rooted in Reliability: The Plant Performance Podcast
    • Quality during Design
    • Way of the Quality Warrior
    • Critical Talks
    • Dare to Know
    • Maintenance Disrupted
    • Metal Conversations
    • The Leadership Connection
    • Practical Reliability Podcast
    • Reliability Matters
    • Reliability it Matters
    • Maintenance Mavericks Podcast
    • Women in Maintenance
    • Accendo Reliability Webinar Series
  • Articles
    • CRE Preparation Notes
    • on Leadership & Career
      • Advanced Engineering Culture
      • Engineering Leadership
      • Managing in the 2000s
      • Product Development and Process Improvement
    • on Maintenance Reliability
      • Aasan Asset Management
      • AI & Predictive Maintenance
      • Asset Management in the Mining Industry
      • CMMS and Reliability
      • Conscious Asset
      • EAM & CMMS
      • Everyday RCM
      • History of Maintenance Management
      • Life Cycle Asset Management
      • Maintenance and Reliability
      • Maintenance Management
      • Plant Maintenance
      • Process Plant Reliability Engineering
      • ReliabilityXperience
      • RCM Blitz®
      • Rob’s Reliability Project
      • The Intelligent Transformer Blog
      • The People Side of Maintenance
      • The Reliability Mindset
    • on Product Reliability
      • Accelerated Reliability
      • Achieving the Benefits of Reliability
      • Apex Ridge
      • Metals Engineering and Product Reliability
      • Musings on Reliability and Maintenance Topics
      • Product Validation
      • Reliability Engineering Insights
      • Reliability in Emerging Technology
    • on Risk & Safety
      • CERM® Risk Insights
      • Equipment Risk and Reliability in Downhole Applications
      • Operational Risk Process Safety
    • on Systems Thinking
      • Communicating with FINESSE
      • The RCA
    • on Tools & Techniques
      • Big Data & Analytics
      • Experimental Design for NPD
      • Innovative Thinking in Reliability and Durability
      • Inside and Beyond HALT
      • Inside FMEA
      • Integral Concepts
      • Learning from Failures
      • Progress in Field Reliability?
      • R for Engineering
      • Reliability Engineering Using Python
      • Reliability Reflections
      • Testing 1 2 3
      • The Manufacturing Academy
  • eBooks
  • Resources
    • Accendo Authors
    • FMEA Resources
    • Feed Forward Publications
    • Openings
    • Books
    • Webinars
    • Journals
    • Higher Education
    • Podcasts
  • Courses
    • 14 Ways to Acquire Reliability Engineering Knowledge
    • Reliability Analysis Methods online course
    • Measurement System Assessment
    • SPC-Process Capability Course
    • Design of Experiments
    • Foundations of RCM online course
    • Quality during Design Journey
    • Reliability Engineering Statistics
    • Quality Engineering Statistics
    • An Introduction to Reliability Engineering
    • Reliability Engineering for Heavy Industry
    • An Introduction to Quality Engineering
    • Process Capability Analysis course
    • Root Cause Analysis and the 8D Corrective Action Process course
    • Return on Investment online course
    • CRE Preparation Online Course
    • Quondam Courses
  • Webinars
    • Upcoming Live Events
  • Calendar
    • Call for Papers Listing
    • Upcoming Webinars
    • Webinar Calendar
  • Login
    • Member Home

by Dianna Deeney 2 Comments

QDD 104 The Fundamental Thing to Know from Statistics for Design Engineering

The Fundamental Thing to Know from Statistics for Design Engineering

A quiz:

What statistical concept is used in these design activities?

  • DOE (design of experiments)
  • Sampling
  • Test results analysis
  • Gage R&R studies
  • Test method validations
  • SPC (with some rules in monitoring changes in a process)

 

View the Episode Transcript

 


If you answered, “Hypothesis Testing”, you’re right on!

Even if you’re not really into statistics, there’s still basics that we should learn and understand, especially in design engineering.

One of those basics is hypothesis testing. So much of our decisions about whether a design is good or not good (or good enough) is based on this concept. It will fundamentally change how you look at design activities – so much so, it’s a responsibility to understand it.

Even if we’re working with others who are doing the calculations, we still need to understand the calculations and the assumptions made from it for ourselves. Sometimes we need a reminder or a refresher.


This short video is an introduction to hypothesis testing. This is the first video in a series about hypothesis testing and is a good introduction to the concept of it.

This longer video covers many concepts in statistics. If nothing else, watch the last chapter about p-hacking/data dredging/data snooping.


Other Quality during Design podcast episodes you might like:

Variable Relationships: Correlation and Causation


Episode Transcript

As a product development engineer, what is one of the fundamental things you need to know from statistics? I’ll tell you after the brief introduction.

Hello and welcome to Quality During Design, the place to use quality thinking to create products, others love for less. Each week we talk about ways to use quality during design, engineering, and product development. My name is Dianna Deeney. I’m a senior level quality professional and engineer with over 20 years of experience in manufacturing and design. Listen in and then join us. Visit quality during design.com.

Do you know what 12 things you should have before a design concept makes it to the engineering drawing board where you’re setting specifications. I’ve got a free checklist for you and you can do some assessments of your own. Where do you stack up with the checklist? You can log into a learning portal to access the checklist and an introduction to more information about how to get those 12 things. To get this free information, just sign up@qualityduringdesign.com. On the homepage, there’s a link in the middle of the page. Just click it and say, I want it.

When I was an engineering youngling…really what I mean by that is that it was early on in my career in uh, well process design, process development…my employer worked with one of the local universities to develop a course for their employees to go through to further their education, to implement some new things within the company. The topic was design of experiments. So I want to say I remember about 30 people in the class and our experiences ranged from ‘we’ve been working for a long time’ to maybe ‘newly graduated/one to two years into our engineering career’. And this was a very formal class. We actually went to the university classroom. We had a professor, we had a textbook. On the first day of class, the teacher started teaching us design of experiments, some of the basics. And then he started backtracking a little bit from what he was talking about after he got some blank stares. And he kept having to backtrack little by little until he stopped and he said, wait, you guys know all about hypothesis testing, right?

To which none of us really volunteered a whole lot that we did. Even if we did, I’m sure it was the case that we had all had it in school at some point. We were using it, but not really thinking it was a hypothesis test. So we were using it, we were exposed to it, but we weren’t willing to raise our hand and say, “Yeah! We know all about hypothesis testing!” To which he was shocked and stammered, “I’m going to have to revise our syllabus because this is the baseline of design of experiments. If you don’t know hypothesis testing, then I’m not sure how to teach you the rest of this course.” And so that’s what we did. And this course was a semester long. It was one or two days a week after work, or maybe we were allowed to leave work a little bit early, like at four instead of five o’clock in order to attend this class.

And he taught us all about hypothesis testing and then moved into design of experiments. It was a really awesome class and it was very neat to be able to go with the people that I worked with. We were all learning it at the same time and implementing things as we were learning it in our engineering work. I later moved from process engineering to quality engineering, which involved a lot more statistics and a lot more to do with hypothesis tests. So I kind of took what I learned in those classes and ran with it.

So the fundamental thing to know from statistics for product design engineering is hypothesis testing. It’s used in so much of what we do in engineering.

It’s used in design of experiments like for our class.

It’s also used for sampling. How many do we need to test? Well, that depends on what we wanna know and what we’re testing!

It involves test results analysis. Is what we’re doing, good, bad, or good enough, and with how far with what confidence? It all has to do with hypothesis testing.

Gauge R&R studies and test method validations are based on hypothesis testing.

And even some SPC statistical process control) that can use hypothesis testing for some rules in monitoring changes in a process.

I’m not going to review the basics of hypothesis testing in a podcast. I will however, link to someone else that does an excellent job at presenting this. His name is Justin Zeltzer and he publishes videos on YouTube under Zed Statistics. I’ll link to two of his videos.

In preparing for this podcast, I was searching for a good resource to refer you to, and part of that was actually watching some of the videos. So I will link to two of his videos.

One is a short video that’s an introduction to hypothesis testing. This is his first video in his series about the topic, and it’s a good introduction to the concepts of it.

The second one that I’ll link to is one that’s a bit longer, but covers many concepts in statistics. If you’re new to it or haven’t used it in a while and you want a refresher, this is a good one to watch. The other reason I’m linking to this one is because of its last section, or chapter, which talks about p-hacking (or other ways to say it is data dredging and data snooping – these are all terms for the same thing). This is where instead of planning and conducting a test to learn something, to test out our hypothesis, we’re instead data mining from a huge database to try to learn…something. We want to try to tie a result of one thing to a variable of another. There are some bad things that can happen when we do this wrong or we’re not careful about doing this. In that Zed Statistics episode, Justin does a good job at showing how this relates with statistical theory.

We also talked about this in a previous episode of the Quality During Design podcast in October of 2022. It’s titled “Variable Relationships, Correlation and Causation”, and we talk about the ways that we can verify that we really have a causal relationship and we’re not just looking for correlations.

What’s today’s insight to action? Even if you’re really not into statistics, it’s not your thing, there’s still basics that we should learn and understand, especially in design engineering. One of those basics is hypothesis testing. So much of our decisions about whether a design is good or not good or good enough is based on this concept. Even if we’re working with others who are doing the calculations, we still need to understand the calculations and the assumptions made from it for ourselves. It will fundamentally change how you look at design activities. So much so, it’s a type of responsibility to understand it. Sometimes we need a reminder or a refresher. There are lots of good and free refresher videos out there, or you can do what I did early in my career and sign up for a class to get into it more in-depth.

If you like this topic or the content in this episode, there’s much more on our website, including information about how to join our signature coaching program, the Quality during Design Journey. Consistency is important, so subscribe to the Weekly newsletter. This has been a production of Deeney Enterprises. Thanks for listening!

Filed Under: Quality during Design

About Dianna Deeney

Dianna is a senior-level Quality Professional and an experienced engineer. She has worked over 20 years in product manufacturing and design and is active in learning about the latest techniques in business.

Dianna promotes strategic use of quality tools and techniques throughout the design process.

Comments

  1. Larry George says

    April 17, 2023 at 9:59 PM

    Thanks for “, others love for less” That got my attention. Reminds me of Apple. Macintosh speaker cost $0.25.
    Thanks also for the lesson about hypothesis testing and DoE. I had the same experience teaching the DoE course, without appreciating relation to reliability statistics.
    Would you consider a lecture or podcast in using field reliability in Design? On my job interview, a Sun Computer designer asked, “What do we need a reliability engineer for? We design reliability into our computers.” I wondered if he knew what happened to reliability in test, process, production, shipping, and user environments. At Apple, we cared. At Abbott Diagnostics Division, I argued with the design engineers that the field determined reliability. Everything before that only deteriorated what they thought the designed reliability was. (sorry for the circumlocution)

    Reply
  2. Dianna Deeney says

    June 6, 2023 at 11:58 AM

    Thanks for your note! I agree that “Using Field Reliability in Design” is a good topic to explore further. Stay tuned!

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Quality during Design podcast logo

Tips for using quality tools and methods to help you design products others love, for less.


by Dianna Deeney
Quality during Design,
Hosted on Buzzsprout.com
Subscribe and enjoy every episode
Google
Apple
Spotify

Recent Episodes

QDD 128 Leveraging Proven Frameworks or Concept Development

QDD 127 Understanding Cross-Functional Collaboration

QDD 126 Exploring the Problem Space: A Key Principle for Robust Product Design and Project Success

QDD 125 Exploring Product Development and AI Through Literature

QDD 124 Design for User Tasks using an Urgent/Important Matrix

QDD 123 Information Development in Design, with Scott Abel – Part 2 (A Chat with Cross-Functional Experts)

QDD 122 Information Development in Design, with Scott Abel – Part 1 (A Chat with Cross-Functional Experts)

QDD 121 Crafting Effective Technical Documents for the Engineering Field

QDD 120 How to use FMEA for Complaint Investigation

QDD 119 Results-Driven Decisions, Faster: Accelerated Stress Testing as a Reliability Life Test

QDD 118 Journey from Production to Consumption: Enhancing Product Reliability

QDD 117 QDD Redux: Choose Reliability Goals for Modules

QDD 116 Reliability Engineering during Design, with Adam Bahret (A Chat with Cross-Functional Experts)

QDD 115 QDD Redux: 5 Options to Manage Risks during Product Engineering

QDD 114 The Instant Glory of Projects

QDD 113 What to do about Virtual Meetings

QDD 112 QDD Redux: How to self-advocate for more customer face time (and why it’s important)

QDD 111 Engineering with Receptivity, with Sol Rosenbaum (A Chat with Cross-Functional Experts)

QDD 110 Don’t Wish for Cross-Functional Buy-in on Product Designs – Plan to Get It!

QDD 109 Before You Start Engineering Solutions, Do This

QDD 108 QDD Redux Ep. 4: Statistical vs. Practical Significance

QDD 107 QDD Redux Ep. 3: When it’s Not Normal: How to Choose from a Library of Distributions

QDD 106 QDD Redux Ep. 2: How to Handle Competing Failure Modes

QDD 105 QDD Redux Ep. 1: How Many Do We Need to Test?

QDD 104 The Fundamental Thing to Know from Statistics for Design Engineering

QDD 103 What to do for Effective and Efficient Working Meetings

QDD 102 Get Design Inputs with Flowcharts

QDD 101 Quality Tools are Legos of Development (and Their 7 Uses)

QDD 100 Lessons Learned from Coffee Pod Stories

QDD 099 Crucial Conversations in Engineering, with Shere Tuckey (A Chat with Cross-Functional Experts)

QDD 098 Challenges Getting Team Input in Concept Development

QDD 097 Brainstorming within Design Sprints

QDD 096 After the ‘Storm: Compare and Prioritize Ideas

QDD 095 After the ‘Storm: Pareto Voting and Screening Methods

QDD 094 After the ‘Storm: Group and Explore Ideas

QDD 093 Product Design with Brainstorming, with Emily Haidemenos (A Chat with Cross Functional Experts)

QDD 092 Ways to Gather Ideas with a Team

QDD 091 The Spirits of Technical Writing Past, Present, and Future

QDD 090 The Gifts Others Bring

QDD 089 Next Steps after Surprising Test Results

QDD 088 Choose Reliability Goals for Modules

QDD 087 Start a System Architecture Diagram Early

QDD 086 Why Yield Quality in the Front-End of Product Development

QDD 085 Book Cast

QDD 084 Engineering in the Color Economy

QDD 083 Getting to Great Designs

QDD 082 Get Clarity on Goals with a Continuum

QDD 081 Variable Relationships: Correlation and Causation

QDD 080 Use Meetings to Add Productivity

QDD 079 Ways to Partner with Test Engineers

QDD 078 What do We do with FMEA Early in Design Concept?

QDD 077 A Severity Scale based on Quality Dimensions

QDD 076 Use Force Field Analysis to Understand Nuances

QDD 075 Getting Use Information without a Prototype

QDD 074 Finite Element Analysis (FEA) Supplements Test

QDD 073 2 Lessons about Remote Work for Design Engineers

QDD 072 Always Plot the Data

QDD 071 Supplier Control Plans and Design Specs

QDD 070 Use FMEA to Design for In-Process Testing

QDD 069 Use FMEA to Choose Critical Design Features

QDD 068 Get Unstuck: Expand and Contract Our Problem

QDD 067 Get Unstuck: Reframe our Problem

QDD 066 5 Options to Manage Risks during Product Engineering

QDD 065 Prioritizing Technical Requirements with a House of Quality

QDD 064 Gemba for Product Design Engineering

QDD 063 Product Design from a Data Professional Viewpoint, with Gabor Szabo (A Chat with Cross Functional Experts)

QDD 062 How Does Reliability Engineering Affect (Not Just Assess) Design?

QDD 061 How to use FMEA for Complaint Investigation

QDD 060 3 Tips for Planning Design Reviews

QDD 059 Product Design from a Marketing Viewpoint, with Laura Krick (A Chat with Cross Functional Experts)

QDD 058 UFMEA vs. DFMEA

QDD 057 Design Input & Specs vs. Test & Measure Capability

QDD 056 ALT vs. HALT

QDD 055 Quality as a Strategic Asset vs. Quality as a Control

QDD 054 Design Specs vs. Process Control, Capability, and SPC

QDD 053 Internal Customers vs. External Customers

QDD 052 Discrete Data vs. Continuous Data

QDD 051 Prevention Controls vs. Detection Controls

QDD 050 Try this Method to Help with Complex Decisions (DMRCS)

QDD 049 Overlapping Ideas: Quality, Reliability, and Safety

QDD 048 Using SIPOC to Get Started

QDD 047 Risk Barriers as Swiss Cheese?

QDD 046 Environmental Stress Testing for Robust Designs

QDD 045 Choosing a Confidence Level for Test using FMEA

QDD 044 Getting Started with FMEA – It All Begins with a Plan

QDD 043 How can 8D help Solve my Recurring Problem?

QDD 042 Mistake-Proofing – The Poka-Yoke of Usability

QDD 041 Getting Comfortable with using Reliability Results

QDD 040 How to Self-Advocate for More Customer Face Time (and why it’s important)

QDD 039 Choosing Quality Tools (Mind Map vs. Flowchart vs. Spaghetti Diagram)

QDD 038 The DFE Part of DFX (Design For Environment and eXcellence)

QDD 037 Results-Driven Decisions, Faster: Accelerated Stress Testing as a Reliability Life Test

QDD 036 When to use DOE (Design of Experiments)?

QDD 035 Design for User Tasks using an Urgent/Important Matrix

QDD 034 Statistical vs. Practical Significance

QDD 033 How Many Do We Need To Test?

QDD 032 Life Cycle Costing for Product Design Choices

QDD 031 5 Aspects of Good Reliability Goals and Requirements

QDD 030 Using Failure Rate Functions to Drive Early Design Decisions

QDD 029 Types of Design Analyses possible with User Process Flowcharts

QDD 028 Design Tolerances Based on Economics (Using the Taguchi Loss Function)

QDD 027 How Many Controls do we Need to Reduce Risk?

QDD 026 Solving Symptoms Instead of Causes?

QDD 025 Do you have SMART ACORN objectives?

QDD 024 Why Look to Standards

QDD 023 Getting the Voice of the Customer

QDD 022 The Way We Test Matters

QDD 021 Designing Specs for QA

QDD 020 Every Failure is a Gift

QDD 019 Understanding the Purposes behind Kaizen

QDD 018 Fishbone Diagram: A Supertool to Understand Problems, Potential Solutions, and Goals

QDD 017 What is ‘Production Equivalent’ and Why Does it Matter?

QDD 016 About Visual Quality Standards

QDD 015 Using the Pareto Principle and Avoiding Common Pitfalls

QDD 014 The Who’s Who of your Quality Team

QDD 013 When it’s Not Normal: How to Choose from a Library of Distributions

QDD 012 What are TQM, QFD, Six Sigma, and Lean?

QDD 011 The Designer’s Important Influence on Monitoring After Launch

QDD 010 How to Handle Competing Failure Modes

QDD 009 About Using Slide Decks for Technical Design Reviews

QDD 008 Remaking Risk-Based Decisions: Allowing Ourselves to Change our Minds.

QDD 007 Need to innovate? Stop brainstorming and try a systematic approach.

QDD 006 HALT! Watch out for that weakest link

QDD 005 The Designer’s Risk Analysis affects Business, Projects, and Suppliers

QDD 004 A big failure and too many causes? Try this analysis.

QDD 003 Why Your Design Inputs Need to Include Quality & Reliability

QDD 002 My product works. Why don’t they want it?

QDD 001 How to Choose the Right Improvement Model

Join Accendo

Receive information and updates about articles and many other resources offered by Accendo Reliability by becoming a member.

It’s free and only takes a minute.

Join Today

© 2025 FMS Reliability · Privacy Policy · Terms of Service · Cookies Policy