SE 310 GR #2
"Did you build the right system?" - ANS-Validation
"Did you build it right?" - ANS-Verify
1) Identification of all tests to be performed and items that will be tested with schedule
2) Organizational responsibilities
3) Description of the test location
4) Description of test prep prior to each test phase (type)
5) Description of actual test phase
6) Plan for retesting
7) Description of the final report - ANS-Test and Evaluation Master Plan (TEMP)
Evaluation using analytical models (CAD, CAE,CAM, CAS) -- In conceptual design phase -
ANS-Analytical Evaluation
ENGINEERING T&E
• Evaluation of engineering models, service test models, system components, breadboards,
mock-ups, and rapid prototypes
• Verify basic performance and physical design characteristics
• Design changes are still low cost
○ ECP - Engineering Change Proposal
• In Prelim Design and Destial Design & Development - ANS-Type 1 Testing
DEVELOPMENTAL T&E
• Evaluation of prototype and early production models
• Qualification of the system (temp cycling, chock and vibration testing i.e. "Shake and Bake")
• Qualification: the process of demonstrating whether or not a system (or component) is
capable of satisfying
• Ex. McKinney Climatic Laboratory (Eglin AFB, FL)
• In Detail Design & Development - ANS-Type 2 Testing
SYSTEM INTEGRATION & TEST
• Production models evaluated at designated test sites
• Testing of production representative items in an operationally representative environment
• First tests of the fully integrated system
• Objective -- verify the TPMs and customer needs are satisfied
During Production and/or Construction Phase - ANS-Type 3 Testing
OPERATIONAL T&E
, • Testing performed when system is in the operational utilization and support phase
• Objective -- assess and improve system in operational use (change maintenance policies,
support for modifications, study for repair rates, aircraft block upgrades etc.) - ANS-Type 4
Testing
Tests accomplished to verify individual system performance characteristics. - ANS-Performance
Tests
Temperature cycling, shock and vibration, humidity, wind, salt spray, dust and sand, fungus,
acoustic noise, pollution emission - ANS-Environmental qualification
Tests are conducted to determine material characteristics relative to stress, strain, fatigue,
bending, torsion - ANS-Structural tests
Tests are accomplished on one more system elements to determine MTBF, MTBM -
ANS-Reliability qualifiaction
Tests are conducted on one more system elements to assess the values for mean active
maintenance time - ANS-Maintainability demonstration
Tests are often accomplished to verify compatibility among the prime equipment, test and
support equipment, test and support equipment, and transportation and handling equipment -
ANS-Support equipment compatibility tests
Tests are often accomplished to verify the relationships between people and equipment, people
and software, the personnel quantities and kill levels required, and training needs -
ANS-Personnel test and evaluation
Verification of operational and maintenance procedures is often accomplished - ANS-Technical
data verification
Verification of operational and maintenance software is accomplished. This includes software
units (CSUs), computer software configuration items (CSCIs) - ANS-Software verification
varification of various elements of the proposed supply chain with the applicable elements of
system is accomplished. Packaging and handling methods, warehouse and storage methods, -
ANS-Supply chain element compatibility tests
identify as early as possible where incompatibility may exist and where additional design activity
may be required - ANS-Compatibility tests with other elements within the higher-level SOS
structure
The probability that a system or product will perform in a satisfactory manner for a given period
when used under specific operating conditions - ANS-RELIABILITY
"Did you build the right system?" - ANS-Validation
"Did you build it right?" - ANS-Verify
1) Identification of all tests to be performed and items that will be tested with schedule
2) Organizational responsibilities
3) Description of the test location
4) Description of test prep prior to each test phase (type)
5) Description of actual test phase
6) Plan for retesting
7) Description of the final report - ANS-Test and Evaluation Master Plan (TEMP)
Evaluation using analytical models (CAD, CAE,CAM, CAS) -- In conceptual design phase -
ANS-Analytical Evaluation
ENGINEERING T&E
• Evaluation of engineering models, service test models, system components, breadboards,
mock-ups, and rapid prototypes
• Verify basic performance and physical design characteristics
• Design changes are still low cost
○ ECP - Engineering Change Proposal
• In Prelim Design and Destial Design & Development - ANS-Type 1 Testing
DEVELOPMENTAL T&E
• Evaluation of prototype and early production models
• Qualification of the system (temp cycling, chock and vibration testing i.e. "Shake and Bake")
• Qualification: the process of demonstrating whether or not a system (or component) is
capable of satisfying
• Ex. McKinney Climatic Laboratory (Eglin AFB, FL)
• In Detail Design & Development - ANS-Type 2 Testing
SYSTEM INTEGRATION & TEST
• Production models evaluated at designated test sites
• Testing of production representative items in an operationally representative environment
• First tests of the fully integrated system
• Objective -- verify the TPMs and customer needs are satisfied
During Production and/or Construction Phase - ANS-Type 3 Testing
OPERATIONAL T&E
, • Testing performed when system is in the operational utilization and support phase
• Objective -- assess and improve system in operational use (change maintenance policies,
support for modifications, study for repair rates, aircraft block upgrades etc.) - ANS-Type 4
Testing
Tests accomplished to verify individual system performance characteristics. - ANS-Performance
Tests
Temperature cycling, shock and vibration, humidity, wind, salt spray, dust and sand, fungus,
acoustic noise, pollution emission - ANS-Environmental qualification
Tests are conducted to determine material characteristics relative to stress, strain, fatigue,
bending, torsion - ANS-Structural tests
Tests are accomplished on one more system elements to determine MTBF, MTBM -
ANS-Reliability qualifiaction
Tests are conducted on one more system elements to assess the values for mean active
maintenance time - ANS-Maintainability demonstration
Tests are often accomplished to verify compatibility among the prime equipment, test and
support equipment, test and support equipment, and transportation and handling equipment -
ANS-Support equipment compatibility tests
Tests are often accomplished to verify the relationships between people and equipment, people
and software, the personnel quantities and kill levels required, and training needs -
ANS-Personnel test and evaluation
Verification of operational and maintenance procedures is often accomplished - ANS-Technical
data verification
Verification of operational and maintenance software is accomplished. This includes software
units (CSUs), computer software configuration items (CSCIs) - ANS-Software verification
varification of various elements of the proposed supply chain with the applicable elements of
system is accomplished. Packaging and handling methods, warehouse and storage methods, -
ANS-Supply chain element compatibility tests
identify as early as possible where incompatibility may exist and where additional design activity
may be required - ANS-Compatibility tests with other elements within the higher-level SOS
structure
The probability that a system or product will perform in a satisfactory manner for a given period
when used under specific operating conditions - ANS-RELIABILITY
