screen-scraper

If you're looking for a powerful and versatile web scraper, look no further than screen-scraper. Designed for extracting data from websites, this cross-platform tool includes both a proxy server and an engine capable of extracting information using patterns and regular expressions. You can even use the embedded scripting engine to manipulate and write data to a file or database.

One of the best things about screen-scraper is its flexibility. You can use it with .NET, ColdFusion, Java, PHP, or any COM-friendly language like Visual Basic or Active Server Pages. This makes it a great choice no matter what your preferred coding language is.

Some of the standout features of screen-scraper include a proxy server for recording web page browsing, a scraping engine for data extraction, and scripting capabilities in Interpreted Java, JScript, JavaScript, Python, and VBScript. You can write extracted data to CSV, plain text, or databases, and even export scraping sessions for later use.

Thanks to features like web page data extraction, file system data extraction, and the ability to invoke sessions from the command line, screen-scraper is perfect for a wide range of applications. From forum access to web content mining, page scraping, and web parsing, this software is capable of handling even complex data extraction tasks with ease.