Crawl a website with this free ActiveX spidering component. Advanced capabilities include caching, avoid patterns, and robots.txt compliance.