Synthesize usability test findings
Turns raw usability session notes into evidence-backed issues rated by severity and frequency, with task results and recommendations. Use after a round of usability sessions.
Synthesis goes wrong when the loudest participant sets the agenda, when interpretation is recorded as if it were observation ("users found it confusing"), when one root cause is reported as five separate issues, and when frequency is mistaken for severity. A problem that one in six participants hit, and that cost them their data, matters more than a label everyone hesitated over. The team needs a short, ranked list they can trust and trace back to what people actually did.
Synthesize these usability sessions.
Only if [TASKS] is given:
- Count the participants (N) and list them with any segment information in the notes.
- Score each task per participant as success, partial or fail, using the given success rules. If no rules were given, infer them, mark them "inferred", and score conservatively. If an outcome is not recorded, write "not recorded" instead of guessing.
- Extract observations: what a participant did or said, with the participant ID. Keep interpretation separate.
- Group observations into issues. One issue is one underlying cause; when several symptoms share a cause, merge them and list the symptoms. Do not merge different causes because they happened on the same screen.
- Rate each issue:
- Frequency: participants affected out of N (e.g. 4/6). Never convert to percentages when N is under 20.
- Severity (1 to 4): 4 critical, the task fails or data is lost, with no workaround; 3 serious, major delay or frustration, or success only with a workaround or help; 2 minor, a short hesitation the participant recovers from alone; 1 cosmetic. Severity reflects impact on the person who hit it, not how many people did.
- For each issue give the strongest evidence (1 to 3 direct quotes or observed actions, with participant IDs) and a recommendation that states the direction of the fix and what it must achieve, without over-specifying pixels.
- Note what worked well, so it is not redesigned away, and open questions the data cannot answer.
- Rank issues by severity, then frequency.
- Quote only what is in the notes. Never invent or polish quotes. If notes are paraphrased, label the evidence "paraphrased".
- Do not generalise beyond the sample ("users want...") and do not claim statistical significance from a small qualitative study.
- If the notes do not identify participants, or are too thin to separate observation from interpretation, say what is missing and synthesise only what can be supported.
- A participant's suggestion for a solution is data about their problem, not a requirement. Report the problem.
- Separate what you verified from what you inferred. Mark inferences as such.
- When you do not know, say "I don't know" once and state what would settle it.
Summary
The 3 to 5 most important findings, one sentence each, ranked.
Task results
| Task | P1 | P2 | ... | Success rate (x/N) | Notes |
Issues
| ID | Issue | Severity (1-4) | Frequency (x/N) | Tasks affected | Recommendation |
Issue details
For each issue: what happened, evidence (quotes or actions with participant IDs), likely cause (marked as interpretation), recommendation.
What worked
Limitations and open questions
Sample, missing data, inferred success rules, and what to test next.
1 required value still a placeholder; the assistant will ask for it.
details
- kind
- Prompt: a task you run by name to get one finished thing back
- domain
- Design
- category
- UX research
- level
- Intermediate
- made for
- UX researcher, Product / UX / UI designer, Product manager
- risk
- read-only
- version
- v1.0.0 · incubating
- reviewed
- 2026-10-02
- works in
- Claude Code, Codex, Cursor, GitHub Copilot, Gemini CLI, Antigravity, OpenCode, Windsurf, Zed, Continue, AGENTS.md, ChatGPT, claude.ai
use in
npx @hermes-hq/hodios install synthesize-usability-findings --target claude-codenpx skills add hermes-hq/hodios-dist --skill synthesize-usability-findings -a claude-codeclaude plugin marketplace add hermes-hq/hodios-distclaude plugin install hodios-design@hodiosThe plugin brings every entry in this domain at once.
pairs well with
All of UX researchWrite a usability test plan
Writes a usability test plan with scenario tasks, success metrics, participant criteria, a screener and a moderator script, tied to the research questions. Use before running a usability study.
write-usability-test-planBuild a user journey map from research
Builds an evidence-based journey map with stages, actions, thoughts, emotions, pain points and opportunities, marking every assumption. Use after interviews or studies about one segment.
build-user-journey-mapUX researcher
UX researcher who matches the method to the question, separates what people did from what it means, and protects participants. Use as a partner for planning, running and synthesising research.
ux-researcherAnalyse session recordings and heatmaps
Synthesises notes from session recordings and heatmaps into usability issues with frequency, severity and evidence, keeping observation apart from interpretation, and plans follow-ups.
analyze-session-recordingsBuild evidence-based user personas
Builds UX personas from research notes, grouping participants by behaviour, with goals, pain points and scenarios traced to evidence and assumptions marked. Use after interviews or field research.
build-user-personasDesign a diary study
Designs a diary study with research questions, daily and event prompts, recruitment, incentives, tactics to keep people logging, and an analysis plan. Use to study behaviour over weeks.
design-diary-study