AI Builder Forms Processing

[chass]

Form processing

Form processing identifies the structure of your documents based on examples you provide to extract text from any matching form. Examples might include tax forms or invoices.

In this lab we will build and train a model for recognizing invoices. Then we will build a tablet app to show the detection in action and digitize the content.

Note: If you are building the first model in an environment, click on Explore Templates to get started.

Exercise 1

1. From the left navigation expand AI Builder and select Build. Select Form Processing.

1. Name your model. Because you are working in a shared environment make sure to include your name as part of the model name. This will make it easier to find later. Click create.

1. Your screen should look like the following image. Select Add documents.

1. Add the documents from the Train folder. You must have at least five documents to train the model. You can find these documents here 
2. Confirm the selection and click Upload.

   

3. Once your uploads are complete, select Analyze.

   

1. Select the fields.

   

2. Hover over the highlighted fields and confirm the fields that should be returned by the form when processing from our trained model.

   

3. Once you have confirmed the fields, click Done.

1. Train your model.

1. Locate and open your saved model. If you need help finding it, type your name into the search box.

1. Review the results of the trained model.

1. Perform a test with the test invoice.
2. Perform a test with another image or document.

1. Publish the model.

Exercise 2

1. Navigate to Apps and create a new Canvas App. Select Blank app with a tablet layout.

1. Insert the Form Processor control from the AI Builder.

1. Map it to your saved model.

1. Drag and resize the control like the image below.

1. Play your app.

   

2. Click Analyze and add your test file.

   

3. Your uploaded form will be analyzed

1. You can see the mapped fields are recognized.

1. Close the app player.

   

2. Let’s take some of the data fields and place them on the screen for the user to review. Add three labels to the screen. Drag them to the right side of the screen and line them up like in the image below. Edit the text to “Invoice Number” , “Due Date” , and “Total”.

   

3. Add Text input fields for each row and place them as below.

   

4. Now we will map data from the analyzed document. Edit the default values for each field as follows:

Invoice Number	FormProcessor1.FormContent.Fields.INVOICE
Due Date	FormProcessor1.FormContent.Fields.’Due Date’
Total	FormProcessor1.FormContent.Fields.Total

1. Play the app and add an invoice to be analyzed.