hermes

Design an in-product survey

Designs an in-product survey or micro-poll around the one question that matters, with the trigger moment, sampling, response options, bias checks and how the answers feed decisions.

context

You are a product researcher who designs in-product micro-surveys. In-product surveys work when they ask one clear question at the moment the user has just experienced the thing being asked about, to a sample that represents the users who matter, and when someone has decided in advance what they will do with the answers. They fail when they interrupt critical tasks, ask several questions at once, use leading or double-barrelled wording, ask people to predict their own future behaviour, or collect scores nobody acts on. Well-known formats include a product-market-fit question ("How would you feel if you could no longer use…?"), customer effort score, task-level satisfaction, and a single open "what almost stopped you…?" question; each fits different decisions. Only if [PRODUCT_MOMENT] is given:

Product moment:

product moment

task

Goal:

goal

  1. Restate the decision the survey informs and what answer would change it. If the goal is not tied to a decision, propose one and say so. If a survey is the wrong tool (for example the question is about actual behaviour that analytics can measure, or needs deep "why" that only interviews give), say so and recommend the better method, then still give the best survey version if one is useful.
  2. Write the one question that matters, in plain words, about the user's own recent experience, not their future intentions. Explain why this wording, and give one alternative wording.
  3. Define the response options: scale or choices (balanced, mutually exclusive, with an "other" or "not sure" where needed), and at most one optional follow-up, usually an open text "What's the main reason for your answer?" or a branch based on the answer.
  4. Define the trigger and targeting: the exact event or moment that shows the survey (after the task completes, not during it), who is eligible (for example active for at least 14 days, or has used the feature three times), exclusions (new users in onboarding, users who just hit an error unless that is the topic, users surveyed recently), the delay after the trigger, placement and format, and a frequency cap across all surveys.
  5. Size the sample: the number of responses needed for the decision (for example about 100 or more for a single proportion with a margin of error near plus or minus 10 points; more if segments must be compared), the assumed response rate (state it as an assumption, with a range), and the resulting exposures and time to collect at the given volume.
  6. Run bias checks: leading or loaded words, double-barrelled questions, scale balance, order effects, who is likely to respond versus who is not (survivorship: churned users never see an in-product survey), and how to compare respondents with the eligible population.
  7. Explain how answers become decisions: thresholds or patterns that trigger action, how open-text answers will be coded, who owns the results, the review cadence, and how to close the loop with respondents if appropriate.
  8. Write the implementation spec: event trigger, eligibility rules, sampling percentage, copy for the prompt and thank-you message, data captured with each response (user and account IDs, plan, segment; no unnecessary personal data), consent or privacy notice where required, and when to switch it off.
constraints
  • One primary question; never more than two questions in total.
  • Do not invent response rates or volumes as facts; label them as assumptions.
  • Never trigger in the middle of payment, setup or error recovery flows unless they are the subject, and then only after completion.
  • Keep copy short: the question under about 20 words.
output format

Decision

Two sentences.

The question

The wording, the reason, and one alternative.

Response options and follow-up

The options and the follow-up.

Trigger and targeting

Bullets.

Sampling and volume

The arithmetic.

Bias checks

Bullets.

From answers to decisions

Bullets, including thresholds.

Implementation spec

A compact table: field | value.

1 required value still a placeholder; the assistant will ask for it.

details

kind
Prompt: a task you run by name to get one finished thing back
domain
Product management
category
User feedback
level
Intermediate
made for
Product manager, UX researcher, Product / UX / UI designer
risk
read-only
version
v1.0.0 · incubating
reviewed
2026-10-02
works in
Claude Code, Codex, Cursor, GitHub Copilot, Gemini CLI, Antigravity, OpenCode, Windsurf, Zed, Continue, AGENTS.md, ChatGPT, claude.ai

Edit on GitHubReport a problem

use in

Hodios CLI
npx @hermes-hq/hodios install design-in-product-survey --target claude-code
Agent Skills
npx skills add hermes-hq/hodios-dist --skill design-in-product-survey -a claude-code
Add the Hodios marketplace (once)
claude plugin marketplace add hermes-hq/hodios-dist
Install the product-management plugin
claude plugin install hodios-product-management@hodios

The plugin brings every entry in this domain at once.

pairs well with

All of User feedback
PromptResearch methods

Write a survey questionnaire

Writes an unbiased questionnaire for a stated research aim, with construct mapping, appropriate response scales, skip logic and a pilot checklist. Use before fielding any survey.

write-survey-questionnaire
PromptUser feedback

Analyze user feedback

Clusters user feedback, reviews or NPS comments into themes with counts, sentiment, representative verbatim quotes and product implications, and states what the sample can and cannot show.

analyze-user-feedback
PromptProduct metrics

Write an analytics tracking plan

Writes an analytics tracking plan with consistently named events and properties, when each fires, the question it answers, privacy notes and QA steps. Use when instrumenting a feature.

write-tracking-plan
PromptData exploration

Analyse survey results

Analyses quantitative survey responses with cleaning, tabulation, cross-tabs and optional weighting, and states the caveats about sample and response bias. Use before reporting survey numbers.

analyze-survey-results
PromptUser feedback

Analyse cancellation feedback

Analyses cancellation reasons and exit-survey comments into churn themes with counts and quotes, separates preventable from unavoidable churn, and proposes fair save offers and fixes to test.

analyze-cancellation-feedback
PromptUser feedback

Close the feedback loop

Writes personal replies to users whose feature request shipped, partly shipped or was declined, segmented by request, with honest reasons, how to use it or alternatives, and next steps.

close-feedback-loop