Worked example: Report Analysis Agent conversation

Demonstration only. Synthetic flawed draft v0.3. Not an official Dorset HealthCare report or live Trust agent.

What this example shows

This is a curated worked example — not a verbatim chat transcript. It demonstrates how the Report Analysis Agent would review a flawed draft before publication: numbered findings with evidence cites, revised wording marked for human review, and refusal to approve.

The findings are grounded in the June 2026 public-data improvement pass documented in FINAL_REPORT_QA_SUMMARY.md. The flawed draft is fictional; the CSV figures, validation checks and corrected brief are real site artefacts.

Evidence chain

Agent rule and inputs

• Report Analysis and Improvement Agent rule
• Flawed draft input
• Corrected Talking Therapies brief (after improvement pass)

Evidence data

• Demo CSV — RDY Talking Therapies extract — source for M019–M022, M053, M055 figures cited below
• Trend CSV — RDY Talking Therapies time series — chronological trend data used in corrected brief

Checks and scripts

• Post-render validation script — check_tt_wait_totals, check_kfe_trend_column, check_required_sections (applied to rendered HTML briefs)
• Report render pipeline — generates corrected public-*.html briefs

Improvement pass / audit trail

• Final report QA summary — June 2026 improvement pass acceptance criteria
• Public reports method — KFE column model and validation usage

Turn 1 — Please review this draft

User:

I've drafted a Talking Therapies access brief for our directorate huddle. Please review this draft against approved public sources and tell me what needs fixing before I share it.

Attached: synthetic-draft-talking-therapies-flawed.md

Report Analysis Agent:

Review summary

• Report: IAPT six-month access brief — author draft v0.3
• Classification: public aggregate (Provider / RDY demo extract)
• Reviewed against: report-analysis-agent.md v1.0
• Demonstration only — not a live Trust agent

I reviewed the draft against demo_talking_therapies.csv and the NHS Talking Therapies publication standards referenced in the corrected site brief. Below are numbered findings with evidence. I have not approved this draft for publication.

Findings

Turn 2 — Revised wording (excerpt)

Report Analysis Agent:

M053 — Six-week access (draft KFE row)

M053 — Six-week access (finished course): 88% (Apr 2026).
Standard: ≥75% six-week access (NHS Talking Therapies monthly statistics — access standards; published April 2026; confidence: confirmed).
Trend: Falling.
Validation: Pathway / data-definition check required.
Judgement: RDY remains above the 75% six-week access standard but has fallen from 95% at the start of the selected trend window — pathway review needed before breach risk.
Human check: Talking Therapies pathway lead to confirm enter-treatment definition alignment.

DRAFT — REQUIRES HUMAN REVIEW

M019–M022 waiting bands (draft KFE row)

Latest: M019–M021: 5,870; M019–M022: 6,780 (Apr 2026).
Judgement: 910 open referrals with no activity over 120 days (M022) — key pathway risk signal.
Human check: Pathway owner to confirm how “no activity” is coded vs local waiting list.

Suggested headline (draft)

Six-week access remains above the 75% national standard at 88%, but the selected trend window shows a falling pattern. Self-referrals account for most referrals (M002: 1,370 of 1,815). Open-referral waiting-band totals need pathway-owner validation — use both M019–M021 and M019–M022 totals.

Suggested period caption

Period: Six available monthly data points: Aug 2025 – Apr 2026 (non-consecutive months in extract).

Turn 3 — Human validation register

IG / Safety handoff

Recommendation: PASS (for this public aggregate demo — no PID detected, no unpublished internal documents cited).

Escalate to IG/Safety Agent if draft is later combined with unpublished internal data or disclosive small numbers.

Turn 4 — Can I publish this now?

User:

Can I publish this to the directorate huddle now?

Report Analysis Agent:

No. I cannot approve publication.

Blocking items:

1. Critical #1 — waiting-band total error must be corrected and verified against demo_talking_therapies.csv (M019–M021 = 5,870; M019–M022 = 6,780).
2. Major #2–#7 — period wording, standards, trend/validation columns, judgement, title and validation owners need fixing.
3. Human validation register — all items remain open.

Required sign-off before any share:

• Report author (apply corrections)
• Performance Manager or Business & Performance Business Partner (review findings)
• Talking Therapies pathway lead (M053/M055 definition confirmation)
• IG / Safety Agent PASS if workflow includes unpublished material (not required for this public demo only)

Status label: Draft — pending named human sign-off.

I can help you apply the draft wording above; I cannot clear this brief for operational use.

Closing summary

Finding-to-evidence map