Skip to content

Slow loading of the dataset files  #25

@ArashJavan

Description

@ArashJavan

Hello,
thanks a lot for your great work! Currently, I am trying to integrate the "completion3d" dataset into torch-point3d. To load the point cloud "h5" files I just used the same code as presented in this repo.

def load_h5(path, key='data', dtype=None, device=None):
    f = h5py.File(path, 'r')
    data = torch.tensor(f[key], dtype=dtype, device=device)
    f.close()
    return data

The only thing is that it takes about 200 milliseconds to load one h5-file, which is really a lot of time for ~50KB data!
My env:
OS: Ubunut 20.04
RAM: 32GB
Drive: SSD

Are you also observing the same effect?
Do you plan to provide the dataset in other formats like plain text-file!

Thanks

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions