Situation
A training management system sends operator qualification status to a manufacturing execution system. A curriculum revision and interface retry occur during the same shift.
Intended Use
The system determines whether an identified operator has completed the effective curriculum and remains within the approved training period for operation OP-21. The manufacturing system uses that status to permit or prevent operation start.
Failure Scenarios
- An obsolete curriculum version remains effective.
- Expired training is treated as current.
- A role mapping excludes a required course.
- A failed or delayed interface message leaves stale qualified status.
- An override lacks authorized approval and audit history.
Existing Controls and Evidence
Role-based curriculum assignment, effectivity dates, expiry rules, interface acknowledgements, exception queues, daily reconciliation, and supervisor review exist. Supplier tests cover standard calculation logic but not the local curriculum, interface, or fail-closed behavior.
Evidence Gaps and Testing Approach
Script effective-version, completion, expiry, grace-period, role-change, and override rules with exact expected results. Challenge missing, duplicate, delayed, and out-of-order messages; interface downtime; recovery; and reconciliation. Use trained-user testing for curriculum assignment and exception resolution.
Validation Conclusion
The fictional recovery test shows a stale qualified status. Release is conditional on a fail-closed rule, aged-message alert, accountable exception ownership, and successful recovery without incorrect authorization.
Reassessment Criteria
Reassess curriculum rules, role mappings, interfaces, overrides, identity services, expiry logic, or incidents involving unqualified work.