Tweebles and twables

by Dean Lunz 10. April 2010 03:35

Almost finished crawling the armory again. After having reworked my entire back end storage strategy. Was originally storing data in the database but quickly realized that the DB size was gonna blow up after a few weeks and in order to store the data in a DB I'd have to write an entire automated db creation and management system, where each weeks data crawl from the armory would get stored in it's own db. Then the problem arises how to organize the data and write the code that will properly pull the data back out of the proper db's no less. *Sigh*

So I went with a far simpler strategy and simply store the data in my own custom file format, giving me flexibility and more control, as well as making it way easier to manage and backup. So I just need to make a few more minor adjustments to my armory crawling code and I can get back to the easy and fun stuff which is taking that data and presenting interesting and informational statistics!

Keep meaning to get around to finish work on the sites look and feel but meh it is low on the priority list right now. There is still some white text over a white background here and there >.<

Tags:

Month List