Import of large json fails

[PietrH]

I'm getting a 504 Gateway Timeout when trying to import a large JSON (4MB).

I've had this issue before, and some imports might actually have gone trough even though I got the 504. This is leading to duplicate records in UAT, which we want to avoid for production.

2025_03_06-16_22-vespadb_import_iasset.json

[PietrH]

If there is something wrong with the import file, an error would be preferred over the Gateway error.

[PietrH]

504 gateway timeout on

2025_03_31-13_40-vespadb_import_iasset.json

[PietrH]

504 Gateway Time-out on

2025_05_07-13_59-vespadb_import_iasset.json

[PietrH]

504 Gateway Time-out on

2025_05_07-13_59-vespadb_import_iasset.json

@stevegerrits I got a timetout, but then 20 minutes later I noticed around 8000 extra records on UAT. So I believe (at least part of) the import was successful, but I got no messaging and have no way of knowing if all my records made it.

Any way we can avoid the timeouts? Is this a server resources thing?