I want to process files that are being added to a date/time directory hierarchy

[rful011]

I am trying to process some log files from AWS. The logs are delivered to an S3 bucket with a directory structure /year/month/day/hour. Logs appear in files containing small batches of records in the hour directory so there is a regularly changing directory that needs to be watched and no straight forward way to know when the directory has changed.

Any suggestions on how one might use Listen to process the files as they appear?

The only way I can think of is to have a hierarchy of listeners running in separate threads which is messy.

[LouisaNikita]

我已收到你的邮件，谢谢！