This repository was archived by the owner on Mar 7, 2025. It is now read-only.
This repository was archived by the owner on Mar 7, 2025. It is now read-only.
Reduce the number number of S3 PutRequests and size of uploads #860
Description
MapCampaigner doesn't scale too well with numerous large campaigns. It makes a ton of regular PutRequest s3 API calls which can add up over time.
Some initial thoughts to improving this problem:
- smart updating based on user interaction
- regularly update partial data with manual option for full updates
- limit AOIs, campaign lengths, zoom levels, etc.
- rather than delete all date and reupload, intelligently update (sync?)