Dashboard to monitor usage

[GianniCarlo]

We need to have a dashboard that can serve the purpose in a better way than what we manually do with the /admin endpoint

[harrisi]

Here are a few things that I think might be useful (there are definitely more I can't think of now):

• Usage per user (roughly what /admin/users_usage gives right now, it seems)
• File sizes
• Number of files
• Number of times files are accessed
• Total data ingress/egress per user

I think for each there could be mean/median/mode and a bar graph to see the distribution.

One thing to keep in mind is general privacy. I think we can anonymize most of the data easily, since the actual users and file names don't matter and can just be random/hashes. I figure this would be useful more for identifying trends to enable us to potentially decrease storage and compute costs and improve user experience. I don't think this would be a useful replacement for automated rate limiting and access controls, but it would help us enable those things in an ideal way.

Really all we'd need to do for this would be a few database queries. We'd need to add a column for number of times a file is accessed and another for total data ingress/egress per user. It may be nice to use a separate data store for this so it's not tied to any specific infrastructure. It could be hosted separately and just be some middleware on the server to feed it data.