Do testers pick the top answer just because it is on top?

If 70 percent choose the kind answer, is your story pulling them there or is it just listed first? This entry shows how to swap the order for half of your testers and then pull the two effects apart with one small calculation.

Why this works

People are drawn to what they see first, apart from what they want. Showing the options in both orders to equal halves separates the pull of the position from the pull of the content, and averaging the two halves keeps unequal group sizes from fooling you.

When not to use it

It is not worth the effort for choices where order carries meaning, such as a list from mild to harsh, or when you have too few testers for two groups. Then use a fixed order and judge by wording.

In the full entry

• What to build, step by step
• Starting values and the reason for each
• 3 common mistakes and the fix
• 27 lines of example code with 4 checks that pass
• How your AI shows you that it works

Say this to your AI

Use the Spielerando entry "Do testers pick the top answer just because it is on top?" (read_entry first-option-bias-in-choices) in my game. Build it step by step, and show me how you checked that it works.

Or skip this and connect the MCP: your AI then finds all of this by itself.Connect the MCP