Issue for Null values when converting string to base64 value

[DBTS7]

Hi,

I've create a flow in which we're getting data from Azure AD and in compose (taking MailId of users) and in Compose 3 (converting the MailId to base64 value). 

Expression that I've written is:  base64(outputs('Compose'))

 But I'm getting the below error for some values (6 values), I think the problem is with base64 conversion for some values.

But I'm not sure about the approach. Please reply if anyone have any idea about this.

Unable to process template language expressions in action 'Compose_3' inputs at line '0' and column '0': 'The template language function 'base64' expects its parameter to be a string, an object or an array. The provided value is of type 'Null'. Please see https://aka.ms/logicexpressions#base64 for usage details.'.

Thanks

[Matthy79]

You shouldn’t use apply to each for such things. Use a select action instead. If you provide sample data of your array I can help with that. And what should happen if no email is available?

[DBTS7]

Hi,

The sample data you can take multiple EmailIDs like: DBTS@gmail.com, abc@gmail.com

These email IDs are coming from Azure AD group.

And I've not written the condition if there is no email Id. (I think that is the problem)

Thanks

[Matthy79]

So you have a comma separated string with 3855 email adresses? What is your for each condition? Split?

[DBTS7]

I'm fetching all group data in Apply each, then in Compose I'm only fetching mailid and then converting it to base64 value and finally inserting it to sql server. No other condition I wrote in for each.

I'm thinking of filtering the Null values/empty values using Filter Array action (let's see if this works). If you have any other way then let me know.

Thanks

[grantjenkins]

This is how I'd probably do it.

IMPORTANT: I'd suggest you delete your screenshot that contains your user data, or at least replace it with some of the data crossed out 🙂

See full flow below. I'll go into each of the actions.

Get group members is what you already have.

Filter array will remove any emails that are blank.

Select will convert each of the emails to base64.

This will give the following output.

You can then just loop over each of the base64 emails and add to Dataverse.

[DBTS7]

Hi,

I'm not able to find mail in this, it happens sometimes. What should I choose in this then?

[grantjenkins]

You would type:

base64(item()?['mail'])

[DBTS7]

Hi, 

I tried but I'm getting the empty body:

Expression: 

base64(item()?['mail'])

[grantjenkins]

It looks like the issue is with your Filter array. Can you check the condition is set to not equal to as per my screenshot?

[DBTS7]

Hi,

Yes, you were right, but when I changed it to is not equal to, then it is showing like this

[grantjenkins]

Wow - that must be a lot of data you've got coming back. How many records do you expect to come back from your Get group members?

[DBTS7]

Hi,

In sql server it is showing 3856 rows 🙂

[grantjenkins · Accepted solution]

We might be able to get around it by chunking our data, so it's processed in smaller chunks. Adding that many rows into Dataverse via Power Automate might take quite a while though. Will be interesting to see how long it takes to complete.

See updated flow below that chunks the data into blocks of 1000 rows at a time. If still too much, we can reduce it to 500, etc.

Get group members and Filter array are the same as the previous post.

Apply to each Batch uses the following expression so it iterates over the data in batches of 1000 at a time. If still too much, we can reduce to 500, etc.

chunk(body('Filter_array'), 1000)

Select uses the Current Item from Apply to each Batch, and the following expression to get the email.

//From
items('Apply_to_each_Batch')

//Map
item()?['mail']

Apply to each uses the output from our Select.

Add a new row uses the Current Item from Apply to Each which will be the email address.

items('Apply_to_each')