hermes

Synthesize usability test findings

Turns raw usability session notes into evidence-backed issues rated by severity and frequency, with task results and recommendations. Use after a round of usability sessions.

context

Synthesis goes wrong when the loudest participant sets the agenda, when interpretation is recorded as if it were observation ("users found it confusing"), when one root cause is reported as five separate issues, and when frequency is mistaken for severity. A problem that one in six participants hit, and that cost them their data, matters more than a label everyone hesitated over. The team needs a short, ranked list they can trust and trace back to what people actually did.

task

Synthesize these usability sessions.

session notes

Only if [TASKS] is given:

tasks

  1. Count the participants (N) and list them with any segment information in the notes.
  2. Score each task per participant as success, partial or fail, using the given success rules. If no rules were given, infer them, mark them "inferred", and score conservatively. If an outcome is not recorded, write "not recorded" instead of guessing.
  3. Extract observations: what a participant did or said, with the participant ID. Keep interpretation separate.
  4. Group observations into issues. One issue is one underlying cause; when several symptoms share a cause, merge them and list the symptoms. Do not merge different causes because they happened on the same screen.
  5. Rate each issue:
  • Frequency: participants affected out of N (e.g. 4/6). Never convert to percentages when N is under 20.
  • Severity (1 to 4): 4 critical, the task fails or data is lost, with no workaround; 3 serious, major delay or frustration, or success only with a workaround or help; 2 minor, a short hesitation the participant recovers from alone; 1 cosmetic. Severity reflects impact on the person who hit it, not how many people did.
  1. For each issue give the strongest evidence (1 to 3 direct quotes or observed actions, with participant IDs) and a recommendation that states the direction of the fix and what it must achieve, without over-specifying pixels.
  2. Note what worked well, so it is not redesigned away, and open questions the data cannot answer.
  3. Rank issues by severity, then frequency.
constraints
  • Quote only what is in the notes. Never invent or polish quotes. If notes are paraphrased, label the evidence "paraphrased".
  • Do not generalise beyond the sample ("users want...") and do not claim statistical significance from a small qualitative study.
  • If the notes do not identify participants, or are too thin to separate observation from interpretation, say what is missing and synthesise only what can be supported.
  • A participant's suggestion for a solution is data about their problem, not a requirement. Report the problem.
  • Separate what you verified from what you inferred. Mark inferences as such.
  • When you do not know, say "I don't know" once and state what would settle it.
output format

Summary

The 3 to 5 most important findings, one sentence each, ranked.

Task results

| Task | P1 | P2 | ... | Success rate (x/N) | Notes |

Issues

| ID | Issue | Severity (1-4) | Frequency (x/N) | Tasks affected | Recommendation |

Issue details

For each issue: what happened, evidence (quotes or actions with participant IDs), likely cause (marked as interpretation), recommendation.

What worked

Limitations and open questions

Sample, missing data, inferred success rules, and what to test next.

1 required value still a placeholder; the assistant will ask for it.

details

kind
Prompt: a task you run by name to get one finished thing back
domain
Design
category
UX research
level
Intermediate
made for
UX researcher, Product / UX / UI designer, Product manager
risk
read-only
version
v1.0.0 · incubating
reviewed
2026-10-02
works in
Claude Code, Codex, Cursor, GitHub Copilot, Gemini CLI, Antigravity, OpenCode, Windsurf, Zed, Continue, AGENTS.md, ChatGPT, claude.ai

Edit on GitHubReport a problem

use in

Hodios CLI
npx @hermes-hq/hodios install synthesize-usability-findings --target claude-code
Agent Skills
npx skills add hermes-hq/hodios-dist --skill synthesize-usability-findings -a claude-code
Add the Hodios marketplace (once)
claude plugin marketplace add hermes-hq/hodios-dist
Install the design plugin
claude plugin install hodios-design@hodios

The plugin brings every entry in this domain at once.

pairs well with

All of UX research
PromptUX research

Write a usability test plan

Writes a usability test plan with scenario tasks, success metrics, participant criteria, a screener and a moderator script, tied to the research questions. Use before running a usability study.

write-usability-test-plan
PromptUX research

Build a user journey map from research

Builds an evidence-based journey map with stages, actions, thoughts, emotions, pain points and opportunities, marking every assumption. Use after interviews or studies about one segment.

build-user-journey-map
PersonaUX research

UX researcher

UX researcher who matches the method to the question, separates what people did from what it means, and protects participants. Use as a partner for planning, running and synthesising research.

ux-researcher
PromptUX research

Analyse session recordings and heatmaps

Synthesises notes from session recordings and heatmaps into usability issues with frequency, severity and evidence, keeping observation apart from interpretation, and plans follow-ups.

analyze-session-recordings
PromptUX research

Build evidence-based user personas

Builds UX personas from research notes, grouping participants by behaviour, with goals, pain points and scenarios traced to evidence and assumptions marked. Use after interviews or field research.

build-user-personas
PromptUX research

Design a diary study

Designs a diary study with research questions, daily and event prompts, recruitment, incentives, tactics to keep people logging, and an analysis plan. Use to study behaviour over weeks.

design-diary-study