Skip to content

Implemet hashing #20

@dovudo

Description

@dovudo

Is your feature request related to a problem? Please describe.

I'll fix a problem of duplicate files.
This solution is simple and good for first issue.

Describe the solution you'd like

Hash files by "xxhash" algorithm, because it's pretty fast algorithm.

  • Make hashing each file.
  • Add hash to store or txt file in main directory.
  • Check hash of every downloaded file with hash store.
  • Skip same files.

Additional context
Xxhash benchmark
Screenshot from 2020-05-04 16-51-01

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions