crawler

Download movie clips effortlessly and quickly from web servers with this user-friendly software, which also searches all of your favorite web links for easy access. The program provides superb results within seconds.

This software offers a free, self-contained network search engine that indexes shared files on your LAN. Users can easily find desired files in seconds using this system. Simple deployment is possible with the built-in web server and database.

CrawlMapper is a versatile software that crawls websites to generate text-based sitemaps and lists of non-crawled URLs. It is available in GUI and command-line modes, making it useful for automated tasks and scripting.

Fax Spider helps in harvesting targeted fax numbers from the internet using Google and Yahoo search engines. It can find thousands of fax numbers within an hour, making it ideal for scanning vulnerabilities quickly.

Sitemap Writer is a tool for editing website XML sitemaps. It includes search engine notification for Google, Yahoo!, Ask, and MSN, as well as RSS import and HTML site map export.

This software automatically extracts a variety of file types (MP3s, movies, images, PDFs, etc.) for offline use and can also explore links and mirror sites. It is a powerful web file ripper and copier robot.