Workshop Background Materials
- DoD would like an assessment of candidate systems engineering (SysE) effectiveness measures (EMs), in terms of their ability to identify strengths and weaknesses in a project's systems engineering approach and progress.
- We have iterated a list of candidate SysE EMs with the project sponsors, which are listed in the next section.
- We will be assessing these with respect to a number of criteria, but our sponsors would also like inputs from existing users or evaluators of the candidate EMs, which we are collecting through a brief survey.
- For people who complete the survey, we will keep your responses confidential, and provide you with a copy of the results.
- We would also like to conduct a short (45 minutes max) follow-up telephone interview with those respondents who have significant experience with one or more candidate EMs. Please let us know if you would be willing to do this.
List of Candidate EMs Being Evaluated
- Air Force Probability of Program Success (PoPS) Framework
- INCOSE/LMCO/MIT SE Leading Indicators Guide
- Stevens Leading Indicators of Program Success and Failure
- SISAIG Macro Risk Model; USC/NASA Macro Risk Tool
- National Research Council Pre-Milestone A and Early-Phase Systems Engineering Study, Pre-Milestone A/B Checklist
- CMU-SEI/NDIA Survey of SE Effectiveness
- USC Anchor Point Feasibility Evidence
- University of Alabama at Huntsville (UAH)-NASA Systems Engineering Benchmarking
For your reference, documents describing each of the above effectiveness measures may be found by clicking the above links.