This software generates sitemaps for Google and Yahoo including text, HTML, RSS and XML formats. HTML sitemaps come with rich template support. XML sitemaps can be compressed and split. Multiple website crawl options available, along with a broken and redirected links viewer.
With Crawler, you can easily create text, HTML, RSS and XML sitemaps that will help search engines crawl and index your site more effectively. Whether you're running a portal, online store, blog or forum, this powerful software can help ensure that your site is optimized for maximum search engine visibility.
The software is packed with features, including the ability to configure the number of simultaneous connections to use, crawler filters, robots.txt, custom connection and read timeouts, removal of session IDs, scanning of Javascript and CSS files, proxy setup, website login, and more.
Crawler also allows you to alias paths during scans, making it easy to scan sites that use multiple domain names with the same content. You can also scan websites from multiple start paths, which is particularly useful for sites that are not fully crosslinked.
Whether you're scanning local websites on your hard drive or online sites on the internet, Crawler has you covered. With support for both static and dynamic websites, this software can help you optimize your site for maximum search engine visibility.
In addition to generating sitemap files, Crawler also offers rich template support for HTML sitemaps, as well as the ability to generate sitemaps for ASP.Net controls. And with the ability to split and compress XML sitemaps, you can rest assured that your site will be optimized for maximum visibility.
Other useful features include the ability to view reports on broken and redirected links, set and calculate priority, change frequency and last modified in XML sitemaps, and even ping and notify search engines of sitemap changes. And with support for command line operations, it's easy to load projects, scan websites, build sitemaps, upload files via FTP, and ping search engines with just a few simple commands.
In short, if you're looking for a comprehensive and feature-packed software package to help optimize your website for search engines, Crawler is definitely worth checking out. So why wait? Download Crawler today and start optimizing your website for maximum search engine visibility!
Version 12.0.0: Each version contains improvements in functionality.
Version 11.0.0: Each version contains improvements in functionality.