Take the 2-minute tour ×
Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

So here is the use case:

Our company has customer data files stored in S3. Their website is hosted with a third party hosting company (Lets call it Hosting X). They are planning to provide a new offering where the customer can select a cloud space he has account with like dropbox, skydrive etc.Then the company will transfer the customer data to that cloud space account using the cloud space's API calls.

We have done cloud uploads in the past, but the data servers were ours, so we just had a bunch of scripts running in the data servers. The scripts would fetch the data files locally and upload them to the desired cloud space.

In the current scenario I am thinking the following are two possible options:

Option 1. Download data files from S3 to Hosting X. Then run script in Hosting X which will upload the local files to desired cloud space.

Option 2. Host the upload script in EC2. When customer requests a data transfer, a script from Hosting X will hit the upload script in EC2. The upload script in EC2 will fetch the files from S3 and upload to the cloud space.

I believe Option 1. will have a recurring cost associated since every data transfer from S3 to outside AMZ infrastructure costs money.

In any case I am not sure if these solutions are possible. Can EC2 and S3 communicate so? Will EC2 need to download the data files from S3 or can it access them as if they are "virtually local"?

Anyone has any experience with such a scenario? Any suggestions, tips are GREATLY appreciated!!

share|improve this question

closed as unclear what you're asking by Stephen Ostermiller Nov 15 at 10:46

Please clarify your specific problem or add additional details to highlight exactly what you need. As it's currently written, it’s hard to tell exactly what you're asking. See the How to Ask page for help clarifying this question.If this question can be reworded to fit the rules in the help center, please edit the question.

I am a little unclear of your goal/problem. Are you trying to determine how to manage end-user file uploads before they are transferred to the final cloud storage provider? –  jeffatrackaid Jun 25 at 15:41
@jeffatrackaid My problem is that I need to transfer files from S3 to a third party cloud storage provider. My code is residing in a web server outside Amazon. Do I need to set up an EC2 account? –  open_sourse Jun 25 at 18:21
I still don't understand the workflow. If someone is uploading a file that needs to go to dropbox, then have your web server send it directly there. S3 would not be involved. If you have legacy content in S3, then you can just use the S3 API from any server to grab the object and push it into the other cloud storage provider. –  jeffatrackaid Jun 25 at 18:29

Browse other questions tagged or ask your own question.