Five testers found twelve problems, so how many are still hidden?

After a playtest you have a list of problems, but no idea whether it is nearly complete or just the tip. A simple look at how many problems only one person found gives an honest guess of what is still missing, and tells you when to test again.

Why this works

If most problems were seen by only one person, many more are still hiding, and if almost all were seen by several, you are near the end. How often the same thing is found again is the best clue to how much has not been found.

When not to use it

Skip it when your testers are alike, such as friends who play the same way, or have too few people to compare, since the guess then says done when it is not. Bring in people unlike you, or watch one new player at a time.

In the full entry

• What to build, step by step
• Starting values and the reason for each
• 3 common mistakes and the fix
• 20 lines of example code with 4 checks that pass
• How your AI shows you that it works

Say this to your AI

Use the Spielerando entry "Five testers found twelve problems, so how many are still hidden?" (read_entry how-many-problems-are-left-after-testers) in my game. Build it step by step, and show me how you checked that it works.

Or skip this and connect the MCP: your AI then finds all of this by itself.Connect the MCP