Sirobot

Category: CGI and Perl - Miscellaneous

Sirobot is a perl script for the console to make downloads faster. It can traverse into a WWW tree and download the whole page including all images and linked documents.Unlike wget, sirobot is able to download more than one file at the same time.Sirobot runs on all platforms that have Perl and the necessary libraries installed. As Sirobot was written in Perl it needs no compilation. Features: - Download webpages recursively Sirobot not only downloads all specified URLs but can also fetch all images and links listed if you wish. You may specify a particular depth and limit which files to get to prevent downloading the whole www. - Continue aborted downloads Even if you started to download the file with another program, it can finish it (if supported by the server) - Concurrent jobs This is quite useful if you have to get a lot of files because Sirobot is able to fetch several files (called jobs) at once - Convert links Sirobot can convert absolute links inside badly designed pages so you can easily browse through the files offline - Pattern matching You may specify regular expressions that control which files will be get (eg. to prevent downloading unwanted tar, mpg, ps, ... files) - Documentation Documentation is now written in POD which can be converted to other documentation formats. HTML and man are already included in the archive. - Graphical Frontend Roel has developed a Perl/GTK based frontend for Sirobot called Sirofront. It is available here. There's also a screenshot availabe. - Support for SSL (homepage Sirobot can handle homepage style schemes (eg. homepage if LWP has SSL support. You'll need an additional library, eg. Crypt-SSLeay. - Other features Of course, sirobot can use a proxy, access protected pages with a user/password combination and takes care of areas not allowed for robots. It also takes advantage of the Curses library if available to improve it's UI. Date: 10 April, 2012


Download Manager - Download Utility - Download Tool - Download - Files - Accelerator

Homepage: http://www.sirlab.de/

Developer: sirlab.de

License: Freeware

Operating System: All

Add a Comment

all are required fields

     
What do you think of this resource?

Select Your Rate:

Votes:0

 

Related Scripts Download

A small script to convert text files to HTML templates.

developer Developer: http://www.automarktregi...
license License: Freeware
operating systems Operating System: All


homemade cgi scripts :: download :: cgi-perl directorys.

developer Developer: Deschakovski Holger
license License: Freeware
operating systems Operating System: unix,linux,windows


Amiex text advertisement exchange, perl script, runs out of the box or customizable.

developer Developer: Deschakovski Holger
license License: Freeware
operating systems Operating System: Unix, Linux, Windows


Popup exchange script, runs out of the box or customizable.

developer Developer: Deschakovski Holger
license License: Freeware
operating systems Operating System: Unix, Linux, Windows


Diary2002 is a online journal or diary script.

developer Developer: Deschakovski Holger
license License: Freeware
operating systems Operating System: Unix, Linux, Windows


Count it Good or commonly refered to as "cig".

developer Developer: phpstorage.com
license License: Freeware
operating systems Operating System: any


Download Trakker masks the true address of a URL.

developer Developer: scriptsforyou.net
license License: Freeware
operating systems Operating System: All


RubyTorrent is a pure-Ruby BitTorrent peer library and toolset.

developer Developer: files.rubyforge.vm.bytemark.co.uk
license License: Freeware
operating systems Operating System: All


KLibido is a KDE usenet news grabber for Linux.

developer Developer: SourceForge.net
license License: Freeware
operating systems Operating System: All