Who we are

Babcock Training Academy

We deliver world-class training in complex systems to AUS/NZ defence, government and high tech markets

Office Address

Babcock Training Academy
Level 10 70 Franklin Street Adelaide  SA  5000

Contact Details

Training Project Support
T:   +61 (0)8 8440 9507
F:   +61 (0)8 8312 3227
This email address is being protected from spambots. You need JavaScript enabled to view it.


Operational Design of Experiments

Course Description

This five-day course delivered by Dr Mark Kiemele provides staff working in test-related fields with the skills to apply a range of powerful tools and methods to maximise the return on investment from their test program.

Design Of Experiments (DOE) is the most effective and efficient means to conduct testing of complex systems (including operator and environmental factors). DOE techniques allow the user to either achieve their existing test objectives with a greatly reduced test scope, or conversely allow the user to achieve so much more, within the original schedule and budget.

The course covers the activities that must precede a DOE, including the first line of defence against variation and Measurement System Analysis (MSA). Testing strategies, such as screening, modelling, and confirmation are discussed along with how they fit into an integrated developmental and operational test strategy. Simple Rules of Thumb are provided for sample size and design selection, along with determining significance and power.

The 12-step approach to experimental design is presented to provide a framework for adequately considering all aspects of the test. Basic graphical and statistical analysis of test data is also covered. The concept of, and the need for looking for variance shifting factors are presented, along with screening designs.

Interpreting regression output and the coding of factors and their levels, along with residual analysis, will facilitate the analysis of data not collected under a DOE strategy and provide a means of analysing data coming from multiple test scenarios. Significantly, the High Throughput Testing (HTT) method is taught which is extremely useful in operational testing when both qualitative and quantitative factors, each at potentially a different number of levels, are assessed.

This course provides many examples from the world of test and evaluation and provides students with practical experience in test design and analysing test results.

It provides the practitioner with the ability and rationale to make good decisions when conducting developmental, acceptance and operational tests under a wide variety of circumstances.

DOE is shown to be the science of data collection as it applies to testing and that it must be in the toolkit of anyone who has something to do with a test and evaluation process—from planning to execution and evaluation.

The course is highly suited to those working in the field of verification and validation for complex systems and can be used for Green Belt Accreditation in Design for Six Sigma through Air Academy Associates.

Target Audience

Test Engineers, Test Operators, Scientists and Managers involved in the verification and validation of complex systems.

Course Outline

Introduction to Test Analysis Strategies and Techniques

Basic statistics review and introduction to hypothesis testing
Introduction to Design of Experiments (DOE) and its terminology 3 major DOE strategies or objectives

Preparing for the Test

Classifying variables and the first line of defense against variation Measurement System Analysis
The 12-Step Approach to experimental design

Design of Experiments (DOE): A Modern Method of Testing

What is different about DOE Key DOE concepts (orthogonality, coding, etc.)
Graphical and statistical analysis of data—manually and by software Introduction to regression analysis

Two-Level Designs

Screening designs: Plackett-Burman and Taguchi designs
Modeling designs: Full and Fractional Factorial designs
Planning, designing, conducting, and analyzing a modeling DOE

Three-Level Designs

Screening designs: L18 Response surface designs: Box Behnken and Central Composite Designs
Demonstrating non-linear effects with a response surface design

DOE Rules of Thumb

Rules of Thumb for sample size, significance, design selection, and orthogonality
Quick tests for shifts in average and standard deviation Practice choosing the correct design

Regression Diagnostics and Historical Data Analysis

Residual analysis Analysis of data not collected under a DOE strategy

All Pairs Testing – High Throughput Testing

All Pairs testing versus All Possible Combinations testing Mixed Factor/Mixed Level designs
Using rdExpert Lite software to design tests and export them to DOE PRO for analysis

Representative Sampling and Higher Dimension Testing

Latin Hypercube Sampling and Descriptive Sampling
Nearly Orthogonal Latin Hypercube Designs (NOLHDs) for screening
Higher-Order Modeling (Box Behnken and Central Composite Designs)

Modeling and Simulation

Low fidelity versus high fidelity modeling
Integration of DOE Tools into Modeling Simulation and the Design Process
Summary of Designs Covered in this Course

Materials and Text Books

Materials provided with the course:

Student participant guide (workbook) Textbooks: Understanding Industrial Designed Experiments
Design for Six Sigma: The Tool Guide for Practitioners

Software included with the course:

SPC XL, DOE Pro, rd Expert Lite, HD Tools

Attendees are required to bring a laptop with them to this course.

Course Details

Course start 12/11/2018
Course end 16/11/2018
Individual price
Extra Information Refer to Current Courses tab for schedule information
Course location Adelaide
Please register your interest in this course by contacting Babcock on +61 (0)8 8440 1498

Register Here!

Registering for one of our courses is easy! Simply fill out one of the below Course Registration Forms and return via email to training@babcock.com.au

Course Registration Form - Individual Registration Form

Course Registration Form - Group Registration Form

Babcock Terms and Conditions


Want to attend a course?

If you would like to register your interest in a course that is not currently being run, please contact us.

GST Terms

All prices shown are Exclusive of GST. GST of 10% will be added to all invoices