Skip to content
weballin

weballin DIGIWIKI

A/B Test

An A/B test randomly assigns groups to variants and compares predefined outcomes.

weballin

Plan the hypothesis, primary metric, detectable effect, sample, and stopping rule. Repeatedly checking and stopping at significance can inflate errors; use a fixed design or an appropriate sequential procedure.

Google Optimize has closed; GA4 did not replace it with a general-purpose variant-assignment feature. Use an experiment tool or implementation. Neither a single changed element nor a minimum two-week duration is universal.

References

Frequently asked questions

Can a small sample produce a conclusion?

Assess uncertainty and detectable effects first. Avoid declaring a winner when the evidence is insufficient.