Good advice slotplayer.

These days the SE's don't have the bandwidth limits they have in the past and even a page that is 200k+ will get crawled easily.

SE's also parse your navigation to cut...