I need advice/ ideas about how can I ensure data consistency in my s3 bucket. I have 2-3 users pushing and reading resources from s3. As one can easily see this leads to data inconsistency( User A is downloading that resource from S3 while User B is still writing to it).
We are syncing saltstack code from s3. We have one bucket setup per environment(prod, staging) and are using AWS IAM roles to control access. Problem happens when I am trying to grab data from s3 and the other developer is pushing code to that bucket, we end up with downloaded resource in a inconsistent state.
I would really appreciate if you guys can share your thoughts, ideas, experiences in dealing with such kind of problem.
Thanks