Copied to clipboard!
zeiver
URLS
# Download
Command | Input | Description |
---|---|---|
Page Depth | Specify the maximum depth for recursive scraping. Default: 20 . More Info | |
Accept Files | Using [Regex], specify which files to accept for scraping. This option takes precedence over reject option. More Info | |
Reject Files | Using [Regex], specify which files to reject for scraping. The accept option takes precedence over this option. More Info | |
Activate Recorder | Activates the Recorder. Save the links to each file. More Info | |
Record Links Only | Activates the Recorder. After scraping, instead of downloading the files, save the links to them. More Info |
# File/Directory
Command | Input | Description |
---|---|---|
Input File | Read URLs from a local or external file. More Info | |
Save Location | Save file location. Default: ./ . More Info | |
Cut Directory(ies) | Ignores a specific number of remote directories from being created. Default: 0 . More Info | |
No Directories | Do not create a hierarchy of remote directories. More Info | |
New Rename Record File | Changes the name of the record file. This file is where the recorder will store the links. Default: URL_Records.txt . More Info |
# HTTP
Command | Input | Description |
---|---|---|
Set Headers | The default headers to use for every request. *Use the header$value format. Each header must also be separated by a comma. More Info | |
User-Agent | The User Agent header to use. Default: Zeiver/VERSION . More Info | |
Retries | Retry amount for a failed connection/request. Default: 20 . More Info | |
Wait Delay | Wait a specified number of seconds between each scraping & download request. More Info | |
Retry Delay | The wait time between each failed request. Default: 10 . More Info | |
Random Wait Delay | Wait a random amount of seconds between each request. The time between requests will vary between 0.5 * Wait Delay (inclusive) to 1.5 * Wait Delay (exclusive). More Info | |
Timeout | Adds a request timeout for a specified number of seconds. More Info | |
Redirects | Maximum redirects to follow. Default: 10 . More Info | |
Proxy | The proxy to use. More Info | |
Proxy Auth | The basic authentication needed to use the proxy. *Must use the username:password format. More Info |