[Spring 2026] Get all files from remote file providers

[llam36]

Context

• We would like to see what files are stored in Azure/S3
• Create an endpoint to fetch the file info for both providers

Requirement

• In File Service, create a method that gets all buckets from Juno DB, gets providers that store those buckets, and gets all files under those buckets from external providers
• Make the external fetch process efficient
• Return a list of {<bucketName>: [<files>]}
• See how to structure handlers for different providers in existing methods for code clarity
• E2E tests expecting status code are sufficient
• Add endpoint in api-gateway to expose this method and add e2e tests there too
• Update SDK as needed to offer this feature
• Beware of bucket name changes during the bucket registration process

Reference

There should be instructions under the Azure and S3 packages in the node modules for these get files operations

PR requirement

• Create your S3 Backblaze account and api keys to test getting files with S3
• Create your Azure Blob Storage account and api keys to test getting files with Azure (if this requires payment, DM me and I'll give you BOG Azure credentials)
• Video demo of using Postman to hit the endpoint and show that files are retrieved correctly