Skip to content
This repository was archived by the owner on Oct 23, 2019. It is now read-only.
This repository was archived by the owner on Oct 23, 2019. It is now read-only.

Slow entities download - is it possible to selectively pick types of entities? #118

@polymorpher

Description

@polymorpher

When I export channels with a reasonably larger number of users (e.g. >10000), the speed of downloading entities is extremely slow. The rate I observed is at around 0.66 entities per second. And each second, new entities are discovered. This results an estimated completion time at least 6 hours.

Is it possible to just get some entities (e.g. channel), and skip some others (e.g. users)? Anything I can do to make it faster?

To give some more context, my config uses a Whitelist which contains solely the name of the channel plus @ prefix. e.g. @binanceexchange

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions