Skip to content

SynBioHub struggles to process multiple jobs at once #23

@tramyn

Description

@tramyn

I have created a set of threads that will try to make X pushes to SynBioHub at a given time. I repeated this process Y times and calculated the average time it takes to perform one push to SynBioHub. Each thread contains the same number of documents and each document are the same size.
From this test, I saw that the time it took for SynBioHub to execute one push increases 8 times more when pushes are performed in parallel rather than in sequential order. As I increase the number of threads pushing to SynBioHub, the time also increases.

One specific example was when I was pushing 125 triples (10KB). One push of 125 triples to SynBioHub took me 112 ms. When I try pushing this same size document on 3 threads, the time went up to 25 seconds per push, 6 threads for 48 seconds per push, and 9 threads for 70 seconds per push. This shows that SynBioHub does not handle execution of multiple jobs as well and this should be something that SynBioHub should consider on addressing.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions