Copied to clipboard!
zeiver URLS
# Download
| Command | Input | Description |
|---|---|---|
| Page Depth | Specify the maximum depth for recursive scraping. Default: 20. More Info | |
| Accept Files | Using [Regex], specify which files to accept for scraping. This option takes precedence over reject option. More Info | |
| Reject Files | Using [Regex], specify which files to reject for scraping. The accept option takes precedence over this option. More Info | |
| Activate Recorder | Activates the Recorder. Save the links to each file. More Info | |
| Record Links Only | Activates the Recorder. After scraping, instead of downloading the files, save the links to them. More Info |
# File/Directory
| Command | Input | Description |
|---|---|---|
| Input File | Read URLs from a local or external file. More Info | |
| Save Location | Save file location. Default: ./. More Info | |
| Cut Directory(ies) | Ignores a specific number of remote directories from being created. Default: 0. More Info | |
| No Directories | Do not create a hierarchy of remote directories. More Info | |
| New Rename Record File | Changes the name of the record file. This file is where the recorder will store the links. Default: URL_Records.txt. More Info |
# HTTP
| Command | Input | Description |
|---|---|---|
| Set Headers | The default headers to use for every request. *Use the header$value format. Each header must also be separated by a comma. More Info | |
| User-Agent | The User Agent header to use. Default: Zeiver/VERSION. More Info | |
| Retries | Retry amount for a failed connection/request. Default: 20. More Info | |
| Wait Delay | Wait a specified number of seconds between each scraping & download request. More Info | |
| Retry Delay | The wait time between each failed request. Default: 10. More Info | |
| Random Wait Delay | Wait a random amount of seconds between each request. The time between requests will vary between 0.5 * Wait Delay (inclusive) to 1.5 * Wait Delay (exclusive). More Info | |
| Timeout | Adds a request timeout for a specified number of seconds. More Info | |
| Redirects | Maximum redirects to follow. Default: 10. More Info | |
| Proxy | The proxy to use. More Info | |
| Proxy Auth | The basic authentication needed to use the proxy. *Must use the username:password format. More Info |