HOME
EMail Signup
Current Schedule
Onsite Courses
Register Online
Request Brochure
Free On-Site Price Quote
Download Catalog
Distance Learning
ATI — Who We Are
Contact ATI Courses
Search Site
Attendees Testimonials
The ATI FAQ Sheet
Suggestions/Wait List
New Courses for 2009
Become an ATI Instructor
Acoustics & Sonar
Rockets & Space
ATI Blog
ATI Space News
ATI Site Map
ATI Staff Tutorials
ATI Sampler Page
 

Getting the Right Results from a Test Requires Effective Test Design

ATI's Test Design and Analysis course

Summary:

    Systems are growing more complex and are developed at high stakes. With unprecedented complexity, effective test engineering plays an essential role in development. Student groups participate in a detailed practical exercise designed to demonstrate the application of testing tools and methods for system evaluation..

    This three-day course is designed for military and commercial program managers, systems engineers, test project managers, test engineers, and test analysts. The focus of the course is giving individuals practical insights into how to acquire and use data to make sound management and technical decisions in support of a development program. Numerous examples of test design or analysis "traps or pitfalls" are highlighted in class. Many design methods and analytic tools are introduced.

Instructor:

    Dr. Scott Workinger has led projects in Manufacturing, Eng. & Construction, and Info. Tech. for 30 years. His projects have made contributions ranging from increasing optical fiber bandwidth to creating new CAD technology. He currently teaches courses on management and engineering and consults on strategic issues in management and technology. He holds a Ph.D. in Engineering from Stanford.

What You Will Learn:

  • Concepts of test design and analysis
  • Understanding the requirements
  • How to know what criteria to use
  • Designing effective use of statistics in data gathering
  • How to conduct the test to get the right results.
  • Evaluating the results vs. expected.
  • The Nine Best Practices of T&E

Course Outline:

  1. Testing and Evaluation. Basic concepts for test and evaluation. Why do we test? Verification and validation concepts. Common T&E objectives. Types of Test and Evaluation (DT&E, OT&E, concurrent T&E)

  2. T&E Context. Context and relationships between T&E and systems engineering. Phases of T&E. Evolutionary acquisition in DoD within the context of DOD-5000. T&E support to acquisition, design reviews, configuration management. The Test and Evaluation Master Plan (TEMP)

  3. Needs and Requirements. Identifying the need for a test. The requirements envelope and how the edge of the envelope defines testing. Understanding the design structure. Stakeholders, system, boundaries, motivation for a test. Design structure and how it affects the test.

  4. Issues, Criteria and Measures. Identifying the issues for a test. Evaluation planning techniques. Other sources of data. The Requirements Verification Matrix. Developing evaluation criteria: Measures of Effectiveness (MOE), Measures of Performance (MOP). Test planning analysis: Operational analysis, engineering analysis, Matrix analysis, Dendritic analysis. Modeling and simulation for test planning

  5. Designing Evaluations & Tests. Specific methods to design a test. Relationships of different units. Input/output analysis - where test variable come from, choosing what to measure, types of variables. Review of statistics and probability distributions. Statistical design of tests - basic types of statistical techniques, choosing the techniques, variability, assumptions and pitfalls. Sequencing test events - the low level tactics of planning the test procedure

  6. Conducting Tests. Preparation for a test. Writing the report first to get the analysis methods in place. How to work with failure. Test preparation. Forms of the test report. Evaluating the test design. Determining when failure occurs.

  7. Evaluation. Analyzing test results. Comparing results to the criteria. Test results and their indications of performance. Types of test problems and how to solve them. Test failure analysis - analytic techniques to find fault. Test program documents. Pressed Funnels Case Study - How evaluation shows the path ahead.

  8. Special Types and Best Practices of T&E. Survey of special techniques and best practices. Special types: Software testing, Design for testability, Combined testing, Evolutionary development, Human factors, Reliability testing, Environmental issues, Safety, Live fire testing, Interoperability. The Nine Best Practices of T&E

Tuition:

    Tuition for this three-day course is $1490 per person at one of our scheduled public courses. Onsite pricing is available. Please call us at 410-956-8805 or send an email to ati@ATIcourses.com.