As a developer at redsauce.com, I am always looking for the most efficient way of doing things, whether it be a PHP script or a database schema. Working on a truly huge site recently, it became obvious that google’s crawling was causing performance issues with the server the site was hosted on. If google doesn’t already know what pages your site contains (i.e. if its a new site), the google bot will have to go through every link on your site, possibly visiting certain pages several times.

Read the rest of this entry »

Bookmark It

Hide Sites