Games Contact us
Select Page
KurumsPlay

Games / Marketing

A/B Call

Ten A/B tests from landing pages, checkouts and email campaigns. Look at the traffic, the conversions and the confidence ranges, then call it: A wins, B wins or too early to call. Big lifts on small samples are the trap. You have five hearts.

HardMarketing3 minNew

How to play A/B Call

Each round shows two variants with visitors, conversions, conversion rate and a 95% range. Choose A wins, B wins or too early to call, then press Check. The explanation shows how many standard errors separate the two.
A correct answer scores 10 XP and a perfect run adds 20 XP. A wrong answer costs one of your five hearts. Results are generated fresh, so replay to practise.

What significance means

Two versions of a page will never convert at exactly the same rate, even if they are identical. Statistical significance asks whether the gap is bigger than random noise would usually produce. The common bar is 95% confidence, which for a simple comparison of two conversion rates means a gap of roughly two standard errors.

Three traps in reading tests

  • Small samples. A 40% lift on 300 visitors per variant is usually noise. The confidence ranges overlap almost completely.
  • Peeking. Checking results every day and stopping the moment a variant looks ahead inflates false winners. Decide the sample size before the test starts.
  • Ignoring small real lifts. With tens of thousands of visitors, a 5% lift can be real and worth a lot of money over a year.

When to call it

Call a winner when the planned sample has been reached and the gap clears your threshold. If it does not, the honest answer is that the test was inconclusive. The marketing guides cover conversion optimisation and analytics. Play Metric Match next or try the calculators in Kurums Tools.

More games

Shift Planner

Five weekly rotas. Cover every day, respect contracts, leave and rest rules.

MediumHR · 4 min

Clause Builder

Ten contract clauses with words missing. Fill the blanks from the word bank.

MediumLaw · 3 min

Dilution Ladder

Three funding rounds, three term sheets each. Keep the most for the founders at exit.

HardStartup · 3 min

See all games

Marketing guides

NPS, Decoded: What It Actually Means

NPS, Decoded: What It Actually Means

, ,

NPS, or Net Promoter Score, is a customer loyalty metric based on one question: how likely are you to recommend us to a friend or colleague, from 0 to 10? People who answer 9 or 10 are promoters, 7 or 8 are passives, and 0 to 6 are detractors. NPS equals the percentage of promoters minus the percentage of detractors.

read more