Crawling Special Circumstances

I recently helped a client with a crawl configuration that turned out to be a bit trickier than I expected. The client has a page that generates "hidden" links to a library of PDF documents. The URL to this page was simple enough: http://www.docs.company.com. This page had several links on it that categorized the folders…