Two of us labelled the scenes "scary" or not and agreed 80 percent: is that good?
When most scenes are plainly not scary, two people agree a lot even if they judge by coin toss. This entry subtracts the agreement you would get by chance and tells you whether the labels are solid enough to build decisions on.
Why this works
When most scenes are plainly one way, two people agree often even by luck. Taking away the agreement you would expect from chance alone leaves a measure of whether the labels follow a shared idea that someone else could also apply.
When not to use it
It is unreliable with only a few scenes, and useless when both people used a single label throughout. It also cannot tell you whether the label is the right question. For that, talk about the disagreements afterwards.
In the full entry
- What to build, step by step
- Starting values and the reason for each
- 4 common mistakes and the fix
- 20 lines of example code with 5 checks that pass
- How your AI shows you that it works
Say this to your AI
Use the Spielerando entry "Two of us labelled the scenes "scary" or not and agreed 80 percent: is that good?" (read_entry two-raters-label-the-same-scenes) in my game. Build it step by step, and show me how you checked that it works.Or skip this and connect the MCP: your AI then finds all of this by itself.Connect the MCP