Solved: A.I Document Preview

Jentsch · ‎03-07-2021

Hi Everyone,

I've gone through and just built an A.I document processing model following the instructions in Microsoft learn.

I was wondering with anything that errors - Do you get the opportunity to retrain the model? Lets assume that you receive invoices and the model has failed to pick up a table. When a user manually enters information etc does the model learn to look at this more closely? or do you need to rebuild models using errored documents?

I also have a question on closing the loop here and exporting the data out of the Dataverse - Understanding that in the preview there isn't an exporter at this time. Is it possible to export the validated invoice out of the dataverse? I've tried to export this and its returned blank on everything despite the 'invoice' being valid in the power app. Is there/do you know if there are any additional steps required to push the data in? This is more so a test to see if we can do what we need.

On the cost side - We have multiple brick and mortar stores that receive invoices from suppliers. In the example in Microsoft Learn it was suppliers feeding information into a services mailbox and having the triggers occur off that inbox. In our example, is it possible through a single A.I seat and Power apps license (etc) to integrate multiple email addresses into the flow rather than needing to purchase an A.I seat + Power apps license for each user?

I am not a developer or have much coding experience with these things so it is pretty amazing that this solution is available to users like me.

Thanks!

v-jefferni · ‎03-08-2021

Hi @Jentsch ,

Could you please share more details about your scenario? Which AI Model have you built, is it a Form Processing model from blank or the Invoice Processing? What type of file would you like to export to, Excel worksheet or PDF file?

I see 3 questions from you and I would answer them one by one.

1\ If your AI Model failed to extract proper data from an invoice, you could choose to retrain the Model. Without retraining, AI Model would not be more reliable if you simply enter the correct values. Please refer to below doc to know more about retraining AI Model:

https://docs.microsoft.com/en-us/ai-builder/manage-model#retrain-and-republish-existing-models

But if you are using Invoice Processing which is a tool pre-built by Microsoft, you will not be able to retrain it since it has been built with a well-trained AI Model.

2\ Since I’ve no idea about your App or your AI Model, the conservative answer for your question is when you have data from an invoice stored in Dataverse, you will be able to export it to a PDF file or Word document via Power Automate. It would not be a complex process and you will be able to find many tutorial in the Community and Videos in Youtube. See below links:

https://powerusers.microsoft.com/t5/Building-Power-Apps/Create-pdf-from-PowerApps-form-and-upload-it...

https://powerusers.microsoft.com/t5/Building-Power-Apps/Print-Facility-or-Export-to-PDF-the-Powersap...

Another choice is in the learning tutorial that you could directly export the extracted data from the invoice to Excel worksheet for you to preview:

https://docs.microsoft.com/en-us/learn/modules/ai-builder-invoice-processing/2-automate-workflow

3\ You could create an Official Email address as the recipient to whom all your “brick and mortar stores” send emails with invoices that coming from suppliers. Still using a to store the received invoice data into Dataverse and verify all records in Power Apps and export to document or PDF file. Below is a simply flow to demonstrate for you:

So this would cost only 1 Power Apps stand alone license and AI Builder license.

In conclusion, the whole scenario could be:

1\ Suppliers send Emails with invoices attached to the stores then stores forward it to the services mailbox which

has Power Apps and AI Model licenses.

2\ The services mailbox account using flow to extract data from received invoices, save data into Dataverse, using Power Apps to preview and verify.

3\ If data valid, using flow to send Emails back to stores with invoice data. If not, manually modify the data then save and send Emails.

Hope this helps.

Best regards,

Community Support Team _ Jeffer Ni
If this post helps, then please consider Accept it as the solution to help the other members find it.

Community Support Team _ Jeffer Ni

If this post helps, then please consider Accept it as the solution to help the other members find it.

View solution in original post

CedrickB · ‎03-08-2021

Hi,

With regard to model retraining, at the moment you have to manual retrain the model with the documents causing problem either by creating a new collection if the layout is totally different (need at least 5 samples) or adding to an existing collection in case of variant.

On the export part, if you are using document automation (https://flow.microsoft.com/en-us/blog/automate-document-processing-with-power-automate/) the exported data is stored in the "document automation data" table of dataverse. From that you can build an export flow using any of the prebuilt Power Automate connectors.

On last question, you can duplicate the built-in "Document Automation Email Importer" which will trigger on a different address. All new documents will be visible in the pipeline. Ibelieve you need just 1 Power Automate license for this.

v-jefferni · ‎03-08-2021

Hi @Jentsch ,

Could you please share more details about your scenario? Which AI Model have you built, is it a Form Processing model from blank or the Invoice Processing? What type of file would you like to export to, Excel worksheet or PDF file?

I see 3 questions from you and I would answer them one by one.

1\ If your AI Model failed to extract proper data from an invoice, you could choose to retrain the Model. Without retraining, AI Model would not be more reliable if you simply enter the correct values. Please refer to below doc to know more about retraining AI Model:

https://docs.microsoft.com/en-us/ai-builder/manage-model#retrain-and-republish-existing-models

But if you are using Invoice Processing which is a tool pre-built by Microsoft, you will not be able to retrain it since it has been built with a well-trained AI Model.

2\ Since I’ve no idea about your App or your AI Model, the conservative answer for your question is when you have data from an invoice stored in Dataverse, you will be able to export it to a PDF file or Word document via Power Automate. It would not be a complex process and you will be able to find many tutorial in the Community and Videos in Youtube. See below links:

https://powerusers.microsoft.com/t5/Building-Power-Apps/Create-pdf-from-PowerApps-form-and-upload-it...

https://powerusers.microsoft.com/t5/Building-Power-Apps/Print-Facility-or-Export-to-PDF-the-Powersap...

Another choice is in the learning tutorial that you could directly export the extracted data from the invoice to Excel worksheet for you to preview:

https://docs.microsoft.com/en-us/learn/modules/ai-builder-invoice-processing/2-automate-workflow

3\ You could create an Official Email address as the recipient to whom all your “brick and mortar stores” send emails with invoices that coming from suppliers. Still using a to store the received invoice data into Dataverse and verify all records in Power Apps and export to document or PDF file. Below is a simply flow to demonstrate for you:

So this would cost only 1 Power Apps stand alone license and AI Builder license.

In conclusion, the whole scenario could be:

1\ Suppliers send Emails with invoices attached to the stores then stores forward it to the services mailbox which

has Power Apps and AI Model licenses.

2\ The services mailbox account using flow to extract data from received invoices, save data into Dataverse, using Power Apps to preview and verify.

3\ If data valid, using flow to send Emails back to stores with invoice data. If not, manually modify the data then save and send Emails.

Hope this helps.

Best regards,

Community Support Team _ Jeffer Ni
If this post helps, then please consider Accept it as the solution to help the other members find it.

Community Support Team _ Jeffer Ni

If this post helps, then please consider Accept it as the solution to help the other members find it.

Jentsch · ‎03-08-2021

Hey @v-jefferni thanks for the detailed reply. Appreciate it.

From the scenario perspective - The ultimate goal of the A.I model (at least how I potentially see this) would be to automate our invoice in process.

That is a supplier would send an invoice into a mailbox/sharepoint folder (or anything else we can connect to) > Trigger the AI workflow > Information would be extracted > Human intervention to approve/ make sure the model is getting the right information > Data from that would be exported into a POS/ Office solution or in the worst case exported into excel/CSV to be manually uploaded into the source system (ERP/PMS etc). That is the ultimate goal anyway.

Thanks for linking the AI retraining processes. I have just set up a Form Processor at the moment as the Invoice processor preview isn't available in my region (or maybe its my licensing).

I'll read the documents that you've linked and I think that this answers the question 🙂

Thanks!

Jentsch · ‎03-08-2021

Hey @CedrickB

Thanks for the reply. Appreciate it.

Maybe I've missed a step or something. I can't seem to see that the data is in the Document automation data table when I edit in excel, even with the power app saying the document has been validated. I'll keep playing around.

Thanks.