They chose to pay higher prices for shares, divorced from actual revenue
The companies, in-turn, found non revenue metrics to show quarter over quarter
and thousands of startups copied the model
Just don’t rely on the A/B test, be aware of it, but don’t rely on it. Put the human control back into the process. Users aren't staying on your platform 5 seconds longer after you hid the escape hatch because they love it, they are frustrated and lost! The A/B test doesn't tell you why the engagement is longer, only that it is. It takes an empathic human to say “okay, B got us that result but not for the reason we want”
They chose to pay higher prices for shares, divorced from actual revenue
The companies, in-turn, found non revenue metrics to show quarter over quarter
and thousands of startups copied the model
Just don’t rely on the A/B test, be aware of it, but don’t rely on it. Put the human control back into the process. Users aren't staying on your platform 5 seconds longer after you hid the escape hatch because they love it, they are frustrated and lost! The A/B test doesn't tell you why the engagement is longer, only that it is. It takes an empathic human to say “okay, B got us that result but not for the reason we want”