Get Started in Form Processing in AI Builder

 

Introduction

Form processing lets you read and save information from standard documents such as invoices or tax documents. When you automate this process, you can save valuable time by reviewing, extracting, organizing, and saving the data automatically by using Power Automate and Power Apps.

Train your model and define the information to be extracted from your forms. You only need five form documents to get started. Quickly get accurate results tailored to your specific content. With AI Builder, you don't need a lot of manual intervention or data science expertise.


Create your first model


The following procedures will show you how to create a Form processing model in AI Builder. This guided experience will walk through each step of the model creation process. You can save your work and return at any time. Progress will be saved automatically when you go between steps.


Sign in to AI Builder

Follow these steps to sign in to AI Builder:


1. Go to Power Automate or Power Apps and sign in with your organizational account.


2. In the left pane, select AI Builder > Build.


3. Select Form processing.


4. Enter a name for your model.


5. If you want to create your model by using your own documents, make sure that you have

at least five examples that use the same layout. Otherwise, you can use sample data we will

be using in this guided experience. You can download the sample data.


6. Select Create

.

Summary and train

After you have tagged all documents across all collections, follow these steps:


1.Select Next.


2.Review the summary of your model's details. If everything looks acceptable, select Train.


Next steps


Now that you've created a Form processing model in AI Builder, you'll learn how to test your model and use it in Power Apps.


Use your model

Learn how to use your Form processing model in Power Apps .


Quick test


After your model has completed training, you can view important details about your newly trained model on a details page.


Use your model in Power Apps

After your Form processing model is published, you can also use it in a power apps. 


You can use the AI Builder action in Power Apps to take advantage of the results of your model.


1.Select Use model.


2.Select + New tab in Power apps  as tablet and go to the power apps environment


Run the apps.


Choose information to extract


In this step you define the fields and tables you want to teach your model how to extract.

The provided sample data are invoices from two different providers. Define the following fields to extract:

• Invoice number

• Due date

• Total amount

• Customer ID 

We also want to extract the description and total amount for each line item present on the invoice.Define a table names Items and with the columns Description and Item total.

Define collections and upload documents

A collection is a group of documents that share the same layout. Create as many collections as documents with different layout that you want your model to process. In this guided experience, since we have two invoice providers, and each invoice provider uses a different invoice template we define two collections.Name the first collection Adatum and the second collection Contoso.


For the collection named Adatum, upload the five documents you will find on the AI Builder Form processing Sample Data/Adatum/Train folder. For the collection names Contoso, upload the five documents you will find on the AI Builder Form processing Sample Data/Contoso/Train folder.

Now is the time to teach your AI model how to extract the fields and tables you have defined. You do this by tagging the sample documents you have uploaded.To start the tagging process, select a collection on the right panel.

Let’s start by tagging our defined fields Invoice number, Due date, Total amount, and Customer ID. To tag a field, simply draw a rectangle around the field on the document and select to which field name it corresponds to.

Once you have finished tagging one document, move to the next one to tag by clicking the navigation arrows bellow the document preview on the top right.Once you have finished tagging one collection, navigate back to the collection list to tag the second collection.


Comments

Popular posts from this blog

Configure forms, charts, and dashboards in model driven apps

Create and Manage tables in Dataverse

Use the Admin center to manage environments and data policies in Power Automate