Its been a busy day for both Twitter & Rush Hour powered Tweetrush. Thats right, the first million barrier has been busted. Check out the Tweetrush stats for 27th August 2008.
While congrats go to Twitter for coping with the extra traffic while the DNC was on, congrats also go to Gnip, our feed provider and the Rush Hour team for desiging such a stable system considering the traffic and data we get and analyse. Its no mean thing to do, and I see the DB’s that are involved so its certainly a lot of fun.
I’m off line for a few days while I attend a family event, however I promise to respond to all RH mails when I come back. In the meantime here is a another great article on a use for Tweetrush.
So I’m doing something that relies on MySQL a lot. Last night I had to test a rebuild process that we would use if there was a failure in our systems. Worst case secnairo would be we would have lost about a weeks data and need to reinsert the whole lot.
So I wrote a quick and nasty PHP script with multiple nested foreach() loops, yeah I know what your thinking, but as I said, it was a quick and nasty script. Basically all this script done was parse a directory full off XML files and based upon the content, perform multiple SELECT, INSERT or UPDATE based on the data per element in the given XML file.
So, on my little iMac (24″, 4GB RAM, 1TB Drive) the following are the stats from the completition of the script.
Total Processing Time: 4975.59566307 seconds.
Total DB Inserts: 1,961,000
Total Selects: 12,035,743
Total Updates: 10,465,071
This all translates to;
Inserts Per Second: 394.12
Selects Per Second: 2,418.95
Updates Per Second: 2,103.28
Keep in mind, I was watching a movie at the same time and that there has been no optimisation carried out on the server at all (Although the DB is fairly well normalised). Table format was MyISAM.
Now imagine what MySQL could do on an optimised Linux server with custom optimisations to make it faster. I am quite impresed given the workstation I was working on and the complexity of the queries we are doing. Pat on head for MySQL. Well done.
If like me you use MySQL yet don’t pay for commercial support (There is nothing wrong with that!), there is another way to contribute. A MySQL developer finds himself in an bad situation and needs a little bit of help from us all. Normally I would not bother with such things, but then again, I do use MySQL a lot and I am dependant on it and this guy helped devlop it! But there is also a kid involved, if it were your kid, you’d do anything to save them. Anyhow, if you can give a donation as little or as large as you like, every little bit helps. Think about it, if every Wordpress blogger gave just $1 dollar, the medical fund would be rasied very quickly. Decision is yours, just my little nudge
. Ta
Comments