I have an s3 bucket named media
and in it I have a folder named contracts
that stores pdf files ~400kb each. For the files in this folder I keep a record in a database as well with the following information:
- ID
- Filename in the s3 bucket
- Date Uploaded into s3 bucket
- Date Archived into glacier
- Glacier filename
And I am making a script that copies files from the s3 bucket media
and specifically from the folder contracts
into a glacier S3 Vault, and I wonder which is the most optimum way to save it. Should I zip any file that have not moved into the glacier and then upload into glacier alltogether, or just download the file contents and save it into glacier as is?
If I save the files one-by-one what are the benefits and what are the drawbacks? The script will run every 30 days and I estimate that will backup about 5-6 files per month.