We have an extremely large S3 bucket, which is divided into folders by date. e.g.dt=2024-11-19dt=2024-