Causal inference notes, part 1: pre-register your primary metric
With twenty metrics on the dashboard, one will move by chance in almost every test. Writing down the primary metric first is the cheapest fix.
Working notes on data, models and measurement
Series