Skip to content

Commit 6eed255

Browse files
authored
Apache Feather-based species reporters (#168)
* Initial exploration of Apache Arrow format for species locations dataframe * Minor perf improvement to feather dataframe generation * Initial implementation of compressed feather dataframes * Refactored SpeciesIdentity + Added unit tests * Optimised performance of Apache Feather species reporter * Renamed species reporters * Renamed LocationSpeciesFeatherReporter compression option to deduplication * Fixed clippy formatting lints
1 parent bf913fb commit 6eed255

File tree

16 files changed

+1657
-150
lines changed

16 files changed

+1657
-150
lines changed

Cargo.lock

Lines changed: 101 additions & 0 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

necsim/plugins/species/Cargo.toml

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -20,4 +20,9 @@ log = { version = "0.4" }
2020
rusqlite = "0.28"
2121
fnv = "1.0"
2222
base32 = "0.4"
23+
hex = "0.4"
2324
bincode = "1.3"
25+
arrow2 = { version = "0.12", features = ["io_ipc"] }
26+
27+
[dev-dependencies]
28+
rand = "0.8"

0 commit comments

Comments
 (0)