Spidering New Releases

[Foone]

As part of an archival project I was looking at automatically downloading new releases, but for a lot of movies the only way to get the full URL is to go through the download.php script. This'll up the download counts needlessly because a robot is hitting them, not a user.

Is there any way to get the full URL without affecting the download counts?

Also, is it okay to do this spidering? I don't plan to do it very fast so there should be no noticeable impact on site performance. Basically just checking for new threads once a day and loading each thread's page.