Posts tagged: scaling

In our ongoing, joyous adventures with scaling MySQL, we hit another stumbling block this morning. We arrived to find out that one of our two MySQL slaves had stopped replicating at 6AM on Saturday morning. This meant that our reporting systems were all running on two day old data, even though we’d been diligently collecting [...]

At work, the past few days, I’ve been working on the scalability of one of our systems and, hopefully, we’re almost closing on the finishing line. For some context, the system I’m talking about is effectively a web crawler. It (all too slowly) works through a queue of URLs, downloading the pages and parsing them [...]