1
I am trying to access AWS s3 bucket from Azure HDInsight Cluster VM. I generated new keys and added to .aws/credentials. "aws s3 ls" is working fine in Azure VM. If I do hadoop distcp or read a s3 file in spark-shell, I am getting 403 error "AWS Access Key Id you provided does not exist in our records.". I did try exporting AWS_SESSION_TOKEN,AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY. but no luck. Please help me resolve this issue.