Copy a file from SharePoint to AWS S3 bucket

[SachV]

Hello,

We have a requirement to copy a file from SharePoint document library to an AWS S3 bucket. We want to schedule this to run daily (it’s the same file and we just need to replace the file in S3 bucket with the file in SharePoint).

Has anyone achieved this before? I found some posts that we have to use the SFTP – SSH action for this. Is that correct?

These are the only details I have on AWS side :

Resource ARN

Bucket Name

Resource Region

Destination Folder

Access Key

Secret Key

Thank you.

[TMGinzburg]

We have the same requirement. Has anyone solved this?

[Deesha]

I have the same requirement. Please help.

[eric-cheng]

Hi @SachV @Deesha @TMGinzburg 

Few ways:

1) API call here

2) Setup AWS Transfer Family which is a managed sFTP.  You can then use Power Automate to FTP fies to S3.  I wrote a blog on AWS Transfer Family here.

3) Use 3rd party tools like couchdrop etc here.

--------------------------------------------------------------------------
If I have answered your question, please mark my post as a solution
If you have found my response helpful, please give it a thumbs up

Connect on LinkedIn

[Deesha]

Thanks for the revert @eric-cheng 🙂

I am aware of AWS Transfer Family , but I am beginner in sharepoint. How to use Power Automate to achieve this ? Sharepoint doesn't have a connector to transfer files to s3.

Thanks
Deesha

[eric-cheng]

Hi @Deesha 

Transfer family allows you to ftp files to S3

You can use Power Automate to ftp files via the ftp connector

--------------------------------------------------------------------------
If I have answered your question, please mark my post as a solution
If you have found my response helpful, please give it a thumbs up

Connect on LinkedIn

[Deesha]

Thanks for the revert @eric-cheng  🙂
I configured sftp server using AWS Transfer family. It is a public server. I am able to sftp into the server using terminal command.

But when I am trying to create a flow in Power Automate using SFTP-SSH connector , I am getting the following error : Test connection failed. Details: BadGateway


Am I missing something ?

Thanks

Deesha

[Deesha]

Hello @eric-cheng ! 
I was able to connect to the AWS sftp server via MS Power Automate SFTP-SSH connector and was able to create a worklflow that solved my use case.

(Use Case : Transferring file to S3 from Sharepoint whenever the file is updated. )

Thanks for the suggestion ! It really helped me a lot !

Thanks a lot 🙂

- Deesha

[Anonymous]

Hi @Deesha can you describe how to do that? I have the same requirement but strugglin to do!

[TMGinzburg]

We are having the same issue - can anyone provide guidance?

[claudiagrajeda]

How did you solve this. i still have BadGateway error. Thanks 

[claudiagrajeda]

Hi, i follow the instructions, but i get a BadGateway in power automate SFTP connection.  😣

[Deesha]

Hello @claudiagrajeda 
Initially I had also got this error , I remember I had checked Network logs at that time , which had the details of the error. It was with the aid of network logs I had found out that in my case , the actual error was this :
"openssh key type : ssh-rsa is not supported"

Basically this error was getting encapsulated with ” Bad Gateway ” error. I updated the format of the private key from openssh to rsa and tried. It worked.

I'll thus request you to check the network logs, it would give more clarity on the details of the actual error that you are getting.

Hope this helps ! Keep me posted.

Thanks

Deesha

[claudiagrajeda]

thanks so mucho @Deesha it help me a lot  checking the network logs. I put in my SSH a passphrase and i was having trouble there. 

Thank you. 

[Deesha]

that's awesome @claudiagrajeda  ! Happy to know that my reply helped you !

[Anonymous]

@Deesha 

Hi Deesha,

I'm getting the same bad gateway error. May I know how and where to check the network log files?

Appreciate your help.

Thanks,

Siva

[claudiagrajeda]

You have to right click in your Edge browser and select "Inspect".  you will have network logs in one of the tabs, or click de "+" icon.

Let me know if you dont found it 

[Anonymous]

@claudiagrajeda  Thank you. I found it.

I am getting invalid data type while connecting in the network logs. Do you know why is that?

"Invalid data type, INTEGER(02) is expected, but was 01\r\nclientRequestId: aa1af280-742f-ca4d-56eb-76

[Anonymous]

You all using puttygen to generate key?

[claudiagrajeda]

Yes i am using puttygen, but have to converted to openSSH key you can do that with putty to