LibraryScenariosWhen your test results contradict what everyone wants to believe
Scenario

When your test results contradict what everyone wants to believe

I ran an A/B test that showed our new feature actually hurt user engagement but the product team spent six months building it and everyone's acting like we should launch anyway.

Aurelius
Online
The coach is replying

More people experience this than they realize.

What we've seen

The data says the new feature hurts users, but everyone wants to ship it anyway.

Ideas that help explain it
Worth thinking about

“Where Are You with Analytics?”

If this sounds familiar, the Library can help you find the bigger picture.