HOME
EMail Signup
Current Schedule
Onsite Courses
Register Online
Request Brochure
Free On-Site Price Quote
Download Catalog
Distance Learning
ATI — Who We Are
Contact ATI Courses
Search Site
Attendees Testimonials
The ATI FAQ Sheet
Suggestions/Wait List
New Courses for 2009
Become an ATI Instructor
Acoustics & Sonar
Rockets & Space
ATI Blog
ATI Space News
ATI Site Map
ATI Staff Tutorials
ATI Sampler Page
 

Getting the Right Results from a Test Requires Effective Test Design

ATI's Test Design and Analysis course

Summary:

    Systems are growing more complex and aredeveloped at high stakes. With unprecedentedcomplexity, effective test engineering plays anessential role in development. Student groupsparticipate in a detailed practical exercise designedto demonstrate the application of testing tools andmethods for system evaluation.

    This three-day course is designed for military andcommercial program managers, systems engineers,test project managers, test engineers, and testanalysts. The focus of the course is givingindividuals practical insights into how to acquire anduse data to make sound management and technicaldecisions in support of a development program.Numerous examples of test design or analysis “trapsor pitfalls” are highlighted in class. Many designmethods and analytic tools are introduced.

Instructor:

    Dr. Scott Workinger has led projects in Manufacturing, Eng. & Construction, and Info. Tech. for 30 years. His projects have made contributions ranging from increasing optical fiber bandwidth to creating new CAD technology. He currently teaches courses on management and engineering and consults on strategic issues in management and technology. He holds a Ph.D. in Engineering from Stanford.

    Contact this instructor (please mention course name in the subject line)

What You Will Learn:

  • Concepts of test design and analysis
  • Understanding the requirements
  • How to know what criteria to use
  • Designing effective use of statistics in data gathering
  • How to conduct the test to get the right results.
  • Evaluating the results vs. expected.
  • The Nine Best Practices of T&E

Course Outline:

  1. Testing and Evaluation. Basic concepts for testingand evaluation. Verification and validation concepts.Common T&E objectives. Types of Test. Context and relationships between T&E and systems engineering. T&E support to acquisition programs. The Test and Evaluation Master Plan (TEMP).

  2. Testability. What is testability? How is it achieved? What is Built in Test? What are the types of BIT and how are they applied?

  3. A Well Structured Testing and Evaluation Program. What are the elements of a well structuredtesting and evaluation program? How do the pieces fittogether? How does testing and evaluation fit into thelifecycle? What are the levels of testing?

  4. Needs and Requirements. Identifying the need for a test. The requirements envelope and how the edge of the envelope defines testing. Understanding the design structure. Stake holders, system, boundaries, motivation for a test. Design structure and how it affects the test.

  5. Issues, Criteria and Measures. Identifying the issues for a test. Evaluation planning techniques. Other sources of data. The Requirements Verification Matrix. Developing evaluation criteria: Measures of Effectiveness(MOE), Measures of Performance (MOP). Test planning an alysis: Operational analysis, engineering analysis, Matrix analysis, Dendritic analysis. Modeling and simulation for test planning.

  6. Designing Evaluations & Tests. Specific methods to design a test. Relationships of different units. Input/output analysis - where test variable come from, choosing what to measure, types of variables. Review of statistics and probability distributions. Statistical design oftests - basic types of statistical techniques, choosing the techniques, variability, assumptions and pitfalls. Sequencing test events - the low level tactics of planning the test procedure.

  7. Conducting Tests. Preparation for a test. Writing the report first to get the analysis methods in place. How to work with failure. Test preparation. Forms of the test report. Evaluating the test design. Determining when failure occurs.

  8. Evaluation. Analyzing test results. Comparing results to the criteria. Test results and their indications of performance. Types of test problems and how to solve them. Test failure analysis - analytic techniques to find fault. Test program documents. Pressed Funnels Case Study - How evaluation shows the path ahead.

  9. Testing and Evaluation Environments. 12 common testing and evaluation environments in a system lifecycle, what evaluation questions are answered in each environment and how the test equipment and processes differ from environment to environment.

  10. Special Types and Best Practices of T&E. Survey of special techniques and best practices. Specialtypes: Software testing, Design for testability, Combined testing, Evolutionary development, Human factors, Reliability testing, Environmental issues, Safety, Live fire testing, Interoperability. The Nine Best Practices of T&E.

  11. Emerging Opportunities and Issues with Testing and Evaluation. The use of prognosis and sense and respond logistics. Integration between testing and simulation. Large scale systems. Complexity in tested systems. Systems of Systems.

Tuition:

    Tuition for this three-day course is $1490 per person at one of our scheduled public courses. Onsite pricing is available. Please call us at 410-956-8805 or send an email to ati@ATIcourses.com.