An HTTP-copying and mirroring software that can be used for a wide range of purposes.
If you're looking for an all-purpose HTTP copying and mirroring tool, look no further than w3mir. Whether you want to maintain a browsable copy of a remote website or retrieve the contents of several related sites, w3mir has you covered.
To get started, you can specify various options and a single HTTP URL on the w3mir command-line. However, keep in mind that if the URL refers to a directory, it must end with a "/". Otherwise, you may end up retrieving more content than you expect.
Options are prefixed with "-" and cannot be clustered. For instance, "-r -R" is not equivalent to "-rR". You can also use the "-cfgfile" option for configuration files, which is equivalent to "--cfgfile" or even "------cfgfile".
In terms of authentication and passwords, as well as multiple site retrievals, you'll need to use a configuration file. If you're browsing from a filesystem, references ending in '/' need to be rewritten to end in '/index.html'. Additionally, if there are URLs that are redirected, they will need to be changed to make the mirror browseable.
By default, w3mir does as little as possible and is as nice as possible to the server(s) it is getting documents from. However, by exploring the options list, you can make w3mir do more complex and useful tasks. Keep in mind that most of the things w3mir can do are documented in the w3mir-HOWTO, which is available on the w3mir homepage as well as in the w3mir distribution bundle.
Overall, w3mir is a versatile and comprehensive tool for HTTP copying and mirroring.
To get started, you can specify various options and a single HTTP URL on the w3mir command-line. However, keep in mind that if the URL refers to a directory, it must end with a "/". Otherwise, you may end up retrieving more content than you expect.
Options are prefixed with "-" and cannot be clustered. For instance, "-r -R" is not equivalent to "-rR". You can also use the "-cfgfile" option for configuration files, which is equivalent to "--cfgfile" or even "------cfgfile".
In terms of authentication and passwords, as well as multiple site retrievals, you'll need to use a configuration file. If you're browsing from a filesystem, references ending in '/' need to be rewritten to end in '/index.html'. Additionally, if there are URLs that are redirected, they will need to be changed to make the mirror browseable.
By default, w3mir does as little as possible and is as nice as possible to the server(s) it is getting documents from. However, by exploring the options list, you can make w3mir do more complex and useful tasks. Keep in mind that most of the things w3mir can do are documented in the w3mir-HOWTO, which is available on the w3mir homepage as well as in the w3mir distribution bundle.
Overall, w3mir is a versatile and comprehensive tool for HTTP copying and mirroring.
What's New
Version 1.0.10: N/A