Upload a pdf/image in power app, extracts data from it using AI Builder, insert the extracted data in sharepoint and retrieves it to the power app for display

[Crantz]

Hi guys! I'm trying to create a flow that works when I upload a pdf/image in power app, extracts data from the AI Builder model that I created and inserts it in a list in sharepoint + retrieves the data back to power app. I tried something like in the attached image but couldn't figure out what should I put in Power App (after I selected Action-Power Automate and selected the flow) in File Content, I mean, in the Run command that appears.

First I tried to do this by using a form processor, so the images I attach would be with that idea.

Hope you can help me! Thanks!

P.S: Don't blame me for how it looks, tried a lot of things 😁.

[JoeF-MSFT]

Hi @Crantz - thanks for the question. No worries, this is a very welcoming community. You will see that my app UX skill won't win design of the year award 😉

This is an interesting use case. You should we able to do all this within the Power App. Here's what I'd suggest:

1. Add the form processor control and then text inputs for each of the fields you want to display. Last, add a button. 

2. For each of the text inputs, set each Default property to get the corresponding value to display what will get extracted by the AI Builder form processor control. To do this, write the following expression, using the name of the fields you defined on the AI model:

 3. Test the app and upload a document. It should display the extracted values on the text inputs

4. Exit preview mode and now let's save the data to SharePoint. On the Data menu on the left, select Add Data and pick SharePoint.

5. Power Apps will then ask you to pick a list

6. Now on the button that we added to the app, on the OnSelect property set the following formula: 

Collect('List name', {'Column name 1': TextInput1.Text , 'Column name 2': TextInput1_1.Text})

Replace List name, Column names to match yours, and add as many columns present on your SharePoint list

Now if you run the app and select that button, the data displayed on the text inputs should be saved to the SharePoint list. 🎉

[Crantz]

Hi, @JoeF-MSFT ! Thank you for your time! I already did it with a button, but I thought I could do it automatically when I insert a pdf with a flow.  I mean not to insert any button, just upload a pdf/image and instantly extract the data and put it in sharepoint or just get it back to power app ( like you showed with text inputs, but done it by the flow).
Have any ideas on that? Thank you again ! 😀

[JoeF-MSFT · Accepted solution]

Got it @Crantz ! 👍 For this case, you can follow the following walkthrough: Use invoice processing in Power Apps - AI Builder | Microsoft Docs that explains how to upload an invoice form a Power App, process it in a cloud flow in Power Automate and return the results back to a Power App. 

For your case, you just have to replace the invoice processing action in the flow by the form processing one, and add the Create item step for SharePoint. 

[Crantz]

Somehow, I've managed to get it done. Muchas gracias @JoeF-MSFT ! I will add some images maybe it will help someone else. 😉

- Returnextracteddataandinsertsharepoint - the name of the flow

- FormProc                                                  - the name of the form processor