Robot detection

Hi! Cool code, using it all the time. One thing, some websites can detect robots and shoot a 403: Forbidden or something like that causing the dump to fail. I have verified that if you go to the website in a normal browser, it does not send that error 