Select Measures and Analytic Techniques

• Identify common measures from the organizational process assets that support statistical management. Product lines or other stratification criteria may categorize common measures.
• Identify additional measures that may be needed for this instance to cover critical product and process attributes of the selected subprocesses. In some cases, measures may be research oriented. Such measures should be explicitly identified.
• Identify the measures that are appropriate for statistical management. Critical criteria for selecting statistical management measures include:
  • Controllable (e.g., can a measure’s values be changed by changing how the subprocess is implemented?)
  • Adequate performance indicator (e.g., is the measure a good indicator of how well the subprocess is performing relative to the objectives of interest?)
  Examples of subprocess measures include:
  • Requirements volatility
  • Ratios of estimated to measured values of the planning parameters (e.g., size, cost, and schedule)
  • Coverage and efficiency of peer reviews
  • Test coverage and efficiency
  • Effectiveness of training (e.g., percent of planned training completed and test scores)
  • Reliability
  • Percentage of the total defects inserted or found in the different phases of the project life cycle
  • Percentage of the total effort expended in the different phases of the project life cycle
• Specify the operational definitions of the measures, their collection points in the subprocesses, and how the integrity of the measures will be determined.Operational definitions are stated in precise and unambiguous terms. They address two important criteria as:
  • Communication: What has been measured, how it was measured, what the units of measure are, and what has been included or excluded
  • Repeatability: Whether the measurement can be repeated, given the same definition, to get the same results
• Analyze the relationship of the identified measures to the organization’s and project’s objectives, and derive objectives that state specific target measures or ranges to be met for each measured attribute of each selected subprocess.
• Instrument the organizational support environment to support collection, derivation, and analysis of statistical measures. The instrumentation is based on:
  • Description of the organization's set of standard processes
  • Description of the project’s defined process
  • Capabilities of the organizational support environment
• Identify the appropriate statistical analysis techniques that are expected to be useful in statistically managing the selected subprocesses.

  The concept of “one size does not fit all” applies to statistical analysis techniques. What makes a particular technique appropriate is not just the type of measures, but more importantly, how the measures will be used and whether the situation warrants applying that technique. The appropriateness of the selection may need to be investigated from time to time.

• Revise the measures and statistical analysis techniques as necessary.