18
3
I have bought some space from evbackup which provides me FTP, rsync and SSH. But I have also read that Amazon S3 can also be used to backups.
So I am really confused that do Amazon give FTP access to upload files to backup.
How can I download those files.
I read their site many time but could not understood how their system works. I just want to backup my users home directory
Mirage
Posted 2011-05-25T06:40:28.560
Reputation: 2 563
24
No, you cannot use rsync to transfer files to Amazon. It uses its own protocol for the service. But you can access their storage via third-party services, like www.s3rsync.com, then you'll be able to use rsync, and your data will be finally transfered to S3 storage.
Or you can use special utilities designed for S3 storage. There are: s3sync, s3command, s3cp, tarsnap (tarsnap is a third party service, like s3rsync).
Another rsync-like tool, duplicity, supports S3 storage as a backend as well as many other backup backends, including RackSpace Cloud Files (another cloud storage service, priced similarly to Amazon S3).
Backup to S3:
duplicity /home/me s3+http://bucketname/prefix
or to Rackspace's Cloud Files:
duplicity /home/me cf+http://container_name
sastanin
Posted 2011-05-25T06:40:28.560
Reputation: 3 537
5
Amazon's official command line interface worked well for me. It can sync from local to an S3 bucket, and also sync from an S3 bucket back to local files.
1) install Amazon's command line interface, from https://aws.amazon.com/cli/
2) from a shell,
export AWS_ACCESS_KEY_ID=(access key here)
export AWS_SECRET_ACCESS_KEY=(secret key here)
export AWS_DEFAULT_REGION=(region here)
cd dirtoupload
aws s3 sync . s3://nameOfBucket
More useful options like --dryrun and --delete (to mirror) listed at http://docs.aws.amazon.com/cli/latest/reference/s3/sync.html.
moltenform
Posted 2011-05-25T06:40:28.560
Reputation: 171
4
You can simply mount your bucket locally using s3fs and then use rsync to copy to that mount point.
GJ.
Posted 2011-05-25T06:40:28.560
Reputation: 8 151
2That sounds fun, but it would surely be reading locally to compare the hashes, which defeats the purpose of rsync... No? – David Fraser – 2012-09-18T14:07:58.120
0
Jungle Disk is an easy way to back up files on Amazon S3 (subscription including S3 account, but you can use any other AWS account). You may also be might want to have a look at Super Flexible (software only).
paradroid
Posted 2011-05-25T06:40:28.560
Reputation: 20 970
You can also try minio client [https://github.com/minio/mc ] aka mc. You can use [mc mirror] command to mirror your local folder with S3 bucket. – user52692 – 2015-11-26T07:19:35.417
thanks for that , also i could not understand their data model . i was checking their prices and they always state for bandwidth . like 0.18cents per GB data transfer. Suppose i upload 50GB data there for backup thats it and then do nothiing . Then how much they charge if i don't do nay tranfer. i could not find any where they staate how much space they give like 50$ for 50GB hard disk – Mirage – 2011-05-25T07:00:34.540
@Moorage: Amazon charges both for storage (from $0.14/GB per month), and transfer ($0.1/GB for transfer in). So for 50 GB you pay $7/month if you don't access this data. There are also RackSpace Cloud Files which is a similar service.
– sastanin – 2011-05-25T15:09:53.737duplicity looks very nice. I wish I would have seen that before writing my own rsync clone.
If duplicity is a little too elaborate for you, check out my simple "rsync-like" wrapper for boto: http://github.com/seedifferently/boto_rsync
1P.S. I've never used duplicity myself, but one of my friends reported broken backups. Use with care. – sastanin – 2012-07-27T16:44:33.443