As a user, I want to monitor the progress of Data Upload Manager in a visual dashboard in AWS #129
Description
Checked for duplicates
Yes - I've already checked
🧑🔬 User Persona(s)
Node Operator
💪 Motivation
...so that I can monitor how successful DUM is on the upload of data, and whether or not there are any errors or issues encountered
📖 Additional Details
Interested to see if there is some way for us to setup a Cloudwatch dashboard or something else to be able to help aid in monitoring of DUM uploads from AWS. The on-prem logs are great, but we also have those logs flowing into AWS. As we continue to move from the cloud, more and more node operations are going to be happening within the AWS console (e.g. Airflow, S3, etc.).
How can we monitor these more easily? CloudWatch dashboard? Athena? Logstash -> OpenSearch and use Kibana?
Acceptance Criteria
Given
When I perform
Then I expect
⚙️ Engineering Details
No response
🎉 I&T
No response