When your ML system works in the demo but breaks at scale

I can build the machine learning system now, get it working on my machine and in a demo. But making it hold up at real scale, with real traffic and messy data, still defeats me. It runs fine until Monday morning hits, and then it falls over in a way I did not see coming.