What would you suggest is the best option to get "enterprise" data from a client into AWS S3 so we can provide Heroku hosted SaaS?
The data volumes are tiny, it's just daily spreadsheet/csv records. But to provide a SaaS solution we need to get the data from the client machine to S3 for our Heroku app to use. This obviously should be an automated, secure process.
Possible options I know of are:
SFTP the files through a service like cloudgates.net or cyberduck.io - but this needs a scheduling procedure to be set up somehow and seems inflexible.
Use AWS Storage Gateway to move the files from a ringfenced machine to S3. This may be a non-starter as internal IT staff may not be in a position to install the VM, configure the Gateway and whatnot.
"Oracle Secure Backup Cloud Module for Amazon S3" If we could get the client to create an Oracle database in which they place the data we need every day, Oracle RMAN could send it to S3. But we want plain text files in S3, not an Oracle database, so maybe this doesn't make sense (as we have a Heroku app not an EC2 instance with Oracle).
It seems to me the only suitable approach to automated data upload is to write the code using an AWS SDK in Java or .Net, that runs on the client machine. This is problematic if it's not something in house IT staff are comfortable with maintaining, particularly security-wise.
I thought I would ask here in case I'm missing a simple option that's an improvement over Bob from accounts uploading the files through our Heroku app to S3 every morning?