Test Summary Report, MVP V&V, 2026-07-05¶
Closure artifact for the Phase 5 V&V cycle. Rolls up the automated run (
verification/tests/) and the manual/UAT run (2026-07-04-run-1.md). IEEE 829 / ISTQB "test summary report" shape.
1. Summary¶
The Personal Training OS MVP was verified against test-plan.md (v1.1) on the live Notion build (page
b3bcfff6…, desktop + mobile). Verification ran as an automated pytest suite (10 cases, computed
formula/rollup values via the Notion API) plus a manual + UAT run (10 cases + 7 UAT). First-pass
execution surfaced 7 defects; all were dispositioned and closed, and the affected cases re-tested green.
Verdict: PASS, recommend G5 sign-off.
Scope note (2026-07-08): this report covers the v1.0 baseline only. Increments 2a-2c (Garmin activities, Garmin daily wellness metrics, Withings weight) and Increment 3 (hockey auto-schedule) shipped later and are live, but are not covered by this run; their evidence is operational (daily sync logs and live Notion rows) and formal V&V is outstanding.
2. Results at a glance¶
| Metric | Value |
|---|---|
| Cases planned | 20 |
| Executed | 20 |
| Pass | 20 |
| Fail | 0 |
| Blocked / Skipped | 0 |
| Pass rate (of executed) | 100% |
| UAT items accepted | 7 / 7 |
Automated: TC-01/02/03/05/07/10/12/13/15/20 (10/10). Manual: TC-04/06/08/09/11/14/16/17/18/19 (10/10, incl. retests).
3. Defects¶
| ID | Sev | Description | Disposition |
|---|---|---|---|
| D-01 | Med | TC-08 scope ("Sessions/Metrics") ambiguous | Fixed (test), plan v1.1 reword |
| D-02 | Med | TC-11 wording, relation can't enforce availability | Fixed (test), plan v1.1 reword |
| D-03 | High | TC-19 export options / "restorable" undefined | Fixed (test), plan v1.1 reword |
| D-04 | High | Hockey games don't auto-schedule into Training Sessions | Deferred, accept-as-designed (ADR-0003); logged Won't-this-release (MoSCoW v1.1). (Superseded 2026-07-05: shipped as Increment 3, MoSCoW v1.3; live on the daily sync.) |
| D-05 | Low | Hand-created session Source blank, not Manual (AUTO-004) |
Fixed (product), DB template with Source=Manual |
| D-06 | High | Workout Templates missing Exercise Library / Hockey Drills relations (TMP-001) | Fixed (product), added Exercises + Drills relations; plans populated |
| D-07 | Low | Export re-import doesn't restore inline views | Accepted-with-rationale, Notion limitation; data recoverable (NFR-BKP-001 met) |
0 open defects. (5 fixed, 1 deferred-by-design, 1 accepted.)
4. Deferred / out of scope¶
Live integrations (Garmin / MyFitnessPal / Apple Health / Strava / Calendar) and RAG, Won't-this-release per Charter §5. Auto-schedule hockey games added to that list this cycle (D-04). Untested T-requirements (13) are all these deferred integrations (AUTO-005..007, CAL-002..010, REL-003).
(Update 2026-07-08: Garmin activities, Garmin daily wellness metrics, and the Withings weight sync (Increment 2), plus hockey auto-schedule (Increment 3), subsequently shipped and are live on a daily schedule. They are not covered by this baseline run; formal V&V is outstanding. MyFitnessPal, Apple Health, Strava (scaffolded, blocked on a paid subscription), Calendar, and RAG remain deferred.)
5. Requirements coverage¶
Requirement → design coverage 101/101 (build.ps1 gate). Test cases trace to 26 distinct requirements; the automated suite asserts computed formula/rollup values. No priority (MVP) requirement left unverified.
6. Recommendation to Gate G5¶
PASS. All in-scope cases Pass, all UAT Accepted, all defects closed. Recommend Primary User sign G5 in
../test-plan.md §7 and tag vv-accepted, then proceed to Phase 6 (Release).