How do I stop chasing metrics and actually help users?
You understand the engine now, and that is real skill. The danger is that the engine starts steering you, so that every day becomes about moving a number and the actual person using your product fades into the background. You have noticed the drift, which is the first thing. The metrics are supposed to be a measure of value delivered, not a replacement for it. When they come apart, when you find yourself gaming retention instead of earning it, the business gets fragile underneath, even if the chart looks fine. Serving the user is not the soft alternative to the numbers. Over time it is what makes the numbers real. Once a week, get close to an actual user. Watch a session, read the support tickets, talk to one person who uses the thing. Let their experience, not just the dashboard, tell you how you are doing. Keep the human in view and the metrics tend to follow.