v0.8.5-1

Minor Changes

• Updates dependencies for project

v0.8.5 Clap migration

User Changes

• Remove automatically making header name/values lowercase when using the -H,--headers option. Issue -->#4
• New option: --auth. This is a shortcut for using the Basic Authentication Header. Issue --> #4
• -H,--headers can now be used multiple times for using multiple different headers. Ex: zeiver -H "header1$value1" -H "header2$value2$.

Other Changes

• Clap.rs Migration by @ZimCodes in #5

Full Changelog: v0.8.4...v0.8.5

v0.8.4

Important Changes

• New OD support: Caddy
• Updates Scraper to work against all Zeiver supported OD types.

---

Reference #2

v0.8.3

Important Updates

• Reduce default timeout (-T) from infinite to 40 seconds.
• Support for Windex & Indices 1.1 OD types.
• New option --download-only. Enables the ability to use the Downloader only and not the Scraper or Recorder.

Small Updates

• More log messages.
• New example for --download-only option.
• cargo dependencies

v0.8.2

• Removes url encodings from file & directory names
• Corrects messages for single file scrapes;
• Update regex for detecting files;

v0.8.1

Updates

Additional ODs supported:

• Apache Directory Listing
• EyyIndexer
• FancyIndex
• A.B.

Fixes

• Adds new scraping checks to filter unwanted links

v0.8.0

0.8.0 ChangeLog

Major

• Changes user-agent option from -U to -u.
• New option: --update. Updates to the latest version of Zeiver.
• New options: --wait-download & --random-download. With this addition, the wait before sending HTTP requests for scraping & downloading are independent.
• New option: --print-pages. Prints the HTML document for each URL to the terminal. This is the HTML document Zeiver is able to see from the OD(s).
• More OD support:
  • OdIndex
  • PanIndex
  • OneIndex

Minor

• Update restrictions for some options, namely --input-record.
• Reduce scraping, downloading, recording complexity.
• Improve scraping filters.
• Add examples with demo ODs

Bugs Fixes

• Fix Linux compatibility. (file paths)
• Directories with language characters (ex: 日本語, 项) were not recognized.
• Fix the generation of multiple stat & URL_Record files when handling multiple URLs.
• Inputting a link to a file treats it as a directory.
• Fix Onemanager identifier.
• Fix scraping javascript: links sometimes.
• Fix Downloader downloading only parts of a file.
• Clarify command line option help messages

v0.7.0

Major

• Upgrade to Rust 2021 edition

Bug Fixes

• Fixes Recorder not documenting all acceptable files to stat files.
• Fixes issue where if parent & child directory have the same name it causes the child directory to be ignored. Instead, Zeiver would combine the two directory paths.
  • Ex: coolfolder/coolfolder
  • Since the parent has the same name as the child, Zeiver would instead combine the two paths like so coolfolder/. This is fixed!

v0.6.2

• Fix no-stat-list not working when creating stats from a record input file.
• Stat files are now in JSON format
• Support snif od type

v0.6.1

Important Changes

Many changes have been established with Zeiver, so lets get started!

New options

More options are added to Zeiver.

• print_header
• print_headers
• no_stats_list
• scan
• all_certs
• https_only
• input_record

The print- options provide Zeiver's Grabber module with a chance to be used as a standalone component. Information about these options can be found in the README.

OD Support

Zeiver supports even more ODs than before. The supported ODs can be found in OD.md. The ODs listed here have been fine tuned to work with Zeiver. Though the ODs that aren't, may also have a chance of being supported as well.

Asynchronous

Zeiver now fully supports tokio's asynchronous runtime. In the beginning, only part of Zeiver was asynchronous while the majority was synchronous and multi-threaded.

Miscs

• Change module name from HTTP to Grabber
• Change option name --record-file to --output-record
• Colorful user interface for the terminal
• Present status codes when Scraper uses the Grabber module.
• Supports 7z split files
• Reduce --retry-wait default from 10 to 8
• Accepts file extensions ranging from 2 to 7 in length
• Provide the correct link to the file
• And more!