Skip to content

Shrink DB Size#185

Open
mjiori wants to merge 32 commits intoqafrom
shrink-db-size
Open

Shrink DB Size#185
mjiori wants to merge 32 commits intoqafrom
shrink-db-size

Conversation

@mjiori
Copy link
Copy Markdown
Contributor

@mjiori mjiori commented Dec 16, 2025

In order to shrink the Postgres database, changes need to be made to code referencing the PREMIS event's event_type. The event_type will now be stored as an int, not a string, to save space. We can also save these values as constants, and continue to use them in code.

@mjiori mjiori requested a review from diamondap December 16, 2025 07:30
@mjiori mjiori changed the base branch from master to qa December 16, 2025 07:45
Copy link
Copy Markdown
Member

@diamondap diamondap left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good so far. See comment on util/util.go. Looks like this is a work in progress and we can't fully test it until other PRs related to db changes have been merged. We'll circle back to this one later.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The Convert functions in util/util.go need to be fleshed out.

Caesonia and others added 25 commits February 12, 2026 12:00
…d so we do not wipe out the CFN changes and cause regression.
Updating the CFN default template for the make update-template comman…
…iles.

This update removes our custom DefaultMinioPutOptions in favor of the standard minio.PutObjectOptions{}. Our former DefaultMinioPutOptions were experimental and included settings to work with Wasabi. We are no longer using Wasabi, so we no longer need those settings. In addition, those old Wasabi-specific settings cause problems with the latest minio-go client when uploading files of unknown size (size = -1) because the old Wasabi-specific settings, with their hard-coded checksum algorithm, prevented minio-go from choosing the proper checksum algorithm for files of unknown size. This resulted in failed uploads. https://trello.com/c/53T5k08v
…efix.

The endpoint prefix for preservation services will always be "admin-api." This fix is for DART 3, which borrows the RegistryClient and needs to call "member-api." https://trello.com/c/xU77Ploy
S3 large files merges the latest minio client for s3 objects. The primary change for APTrut on this merge is increasing the S3 object size allowed from 5TB to 50TBs.
MetadataGatherer now uses new GetLargeObject call to download bags la…
StagingUploader now also uses GetLargeObject for files over 5TB
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants