Experimentation portfolio
Factor analysis
Drivers of time-to-first-payment
18 onboarding signals reduced to 3 latent factors explaining 74% of variance in activation speed. KMO = 0.81.
Factor 1 — Technical readiness
Factor 2 — Business intent
Variance explained: F1 = 34% · F2 = 24% · F3 = 16% · KMO = 0.81
A/B experiment
Onboarding checklist vs. guided tour
Randomized experiment (n = 18,400) testing whether a step checklist or interactive guided tour drives faster activation.
Control — checklist
3.8d
median TTP
Activation: 46%
Treatment — guided tour ✓
2.9d
median TTP
Activation: 54% (+8pp)
✓ p < 0.001 · 95% CI: [−1.1d, −0.7d] · Power = 0.94
Propensity score matching
Stripe Radar adoption → retention
Matched observational study controlling for business size, vertical, and acquisition channel to isolate the causal effect of Radar on 90-day retention.
Non-Radar users
61%
90-day retention
Radar adopters ✓
79%
90-day retention
ATE: +18pp (PSM matched)
✓ ATT robust to balance checks · Std. mean diff < 0.1 post-match
Interrupted time series
Dashboard v3 redesign impact on WAU
Segmented regression on weekly active users before and after the Dashboard v3 launch (Oct 2023). Estimated level and slope shift post-intervention.
Pre-launch
Post-launch
Launch point
Level change: +12% · Slope change: +0.8% wk⁻¹ · R² = 0.91
✓ p < 0.01 for both level and slope parameters
User journey funnel
Phase 01
Awareness
124,800
top of funnel
Phase 02
Sign-up
43,680
35% cvr
Phase 03
First payment
21,403
49% cvr
Phase 04
Active use
14,982
70% cvr
Phase 05
Retained (90d)
10,487
70% cvr
End-to-end conversion
8.4%
↑ 1.2pp vs prior cohort
awareness → 90d retained
Median time to 1st payment
3.2d
↓ 0.9d vs prior cohort
post sign-up
90-day retention
70%
↑ 4pp vs prior cohort
of activated users
Avg rev / retained user
$1,840
↑ 12% vs prior cohort
cumulative 90d
Funnel drop-off by stage
Absolute users and cumulative conversion rate at each journey milestone.
90-day retention by acquisition channel
Organic and earned channels outperform paid by 16–26pp on 90-day retention.