cancel
Showing results for 
Search instead for 
Did you mean: 
Reply

Find only the latest unique item in a SharePoint List

Hi all

 

As per subject, I've been trying to accomplish this for quite a while now using collections in PowerApps but have yet to find a solution. I was hoping PowerAutomate would have an intuitive one but not having much luck. The below pic illustrates what I want to achieve.

 

Snag_ade42f8.png

 

 

 

 

 

The problem is that I can't use 'normal' methods like Distinct, as the duplicates I want to remove (or not get) are not distinct but unique. The list has dozens of columns with unique values but only the Item (text type) and Date (date type) columns are relevant.

 

Simply put, how can one remove the three oldest Belt entries in the example above?

 

Using the Get-Items action and a Filter Query, I'm able to get all the items I want within a specific date range, and also based on other parameters like the number column, but I can't figure out how to subsequently (or in the same step?) filter the Item column to only have one unique item in the resulting list.

 

Any help appreciated.

1 ACCEPTED SOLUTION

Accepted Solutions

Hello all,

 

We often have the problem to reach the Power Automate limits and runtime is also a pain point so I always try to avoid apply to each whenever it is possible.

 

This is how I would do it.

 

Matthy79_0-1692518972837.png

View solution in original post

13 REPLIES 13

Hello @fnanfne 

 

you could sort the array and after that use „first“ or „last“ to get your item.

SamLed
Super User
Super User

Hi fnanfne,

 

I understood you want to get the latest record for each unique item, here how I would do it:

 

  • My test input data:

SamLed_0-1692294248009.png

 

  •  Create an array variable to store output records, Get your rows, Add a Select action to fetch all "Item" and use union() expression to get unique value from Select:

SamLed_1-1692294491540.png

 

  • Add an Apply to each to loop over unique "Item", Filter Get rows outputs to fetch every record matching current "Item", Select "Date" converted to int by format 'yyyyMMdd' from filter output, return max number and convert it back to string:

SamLed_2-1692294847834.png

 

NB: I saw date in format dd/MM/yyyy, I first parse that date using 'fr-FR' locale to get ISO format date. Then format it to yyyyMMdd and finally into int: 

int(formatDateTime(parseDateTime(item()?['Date'],'fr-FR','dd/MM/yyyy'), 'yyyyMMdd'))
 
  • Add a compose to rebuild date from int to input "Date" format, filter Get rows outputs again to now fetch record matching "Item" and newer "Date", finally, append record to array variable. I use first() because filter array returns an array, I need only the item it contains:

NB:

Expression to rebuild date:  

replace(replace(replace('dd/MM/yyyy''yyyy', substring(outputs('Compose_-_get_max_date_int_value'),0,4)), 'MM', substring(outputs('Compose_-_get_max_date_int_value'),4,2)), 'dd', substring(outputs('Compose_-_get_max_date_int_value'),6,2))
 
Expression to filter array: @And(equals(item()?['Item'], items('Apply_to_each')), equals(item()?['Date'], outputs('Rebuild_date')))
 

SamLed_3-1692295229962.png

 

Result :

SamLed_4-1692295437523.png

______________________________________________________________

If I have answered your question, please Accept the post as solution.
If you like my response, please Thumbs Up.

 

 

 

SamLed
Super User
Super User

Hi,

 

Don't forget to mark as solution if it fulfilled your need in order to close the topic 😉

My idea is the following:

  • Create an array from the Item col and make its items unique (in the Apply to each)
  • Sort the rows by date reversed (newest on top, in the Filter's From)
  • Filter the rows by Item
  • In the nested Apply to each 2, skip each first row and delete all other rows.

 

Chriddle_0-1692376824313.png

 

Apply to each:

 

 

union(
	xpath(
		xml(json(concat('{"root":{"item":', outputs('Compose'),'}}'))),
		'//Item/text()'
	),
	json('[]')
)

 

 

Filter array:

From:

 

 

reverse(sort(outputs('Compose'),'Date'))

 

 

Filter:

 

 

@equals(item()['Item'], items('Apply_to_each'))

 

 

Apply to each 2:

 

 

skip(body('Filter_array'),1)

 

 

Compose 2:

This shows the row that must be deleted

This action has to be replaced with an according Delete row action 😉

 

 

items('Apply_to_each_2')

 

 

 

@fnanfne 

 

please tell us if you are happy with one of the solutions. If you provide sample data, I will also provide a solution that doesn’t need loops and can handle large data as well.

SamLed
Super User
Super User

Hi @fnanfne ,

 

I have to admit that the solution provided by @Chriddle  is really elegant. I especially like the use of XPath to get unique item and reverse sorting to get most recent one. That's saving so many actions. Here's what my solution becomes inspired by his work:

SamLed_0-1692462593682.png

 

I used same input data and got same results, but look how it lost weight !

 

My solution returns an array of newest of each unique items, @Chriddle's one offers the ability to delete all items except newest. Whichever solution you prefer, believe me, @Chriddle's one deserves to be mark as solution.

 

Sam

Hello all,

 

We often have the problem to reach the Power Automate limits and runtime is also a pain point so I always try to avoid apply to each whenever it is possible.

 

This is how I would do it.

 

Matthy79_0-1692518972837.png

SamLed
Super User
Super User

@Matthy79 

Hehe the ultimate one I like to see, loop less, great job!

For Number and Date in select you're taking last of array sort by date, I guess?

You deserve your Kudo 😁

 

You both inspired me, nice topic, on my way to upgrade my flows!

The sort by date is during the xml conversion. After that it is just picking the last found item using xpath. You can see the formulas inside the note. The Number Select is the same es the Date Select. Just change Date to Number.

SamLed
Super User
Super User

Oh, of course the notes... get it, many thanks.

I like flow golf 😁

This saves the final Compose action in @Matthy79 's great suggestion:

Chriddle_0-1692609089592.png

From:

 

union(
	xpath(
		xml(json(concat('{"root":{"item":', outputs('Compose'),'}}'))),
		'//Item/text()'
	),
	json('[]')
)

 

Map Id:

 

last(
	xpath(
		xml(json(concat('{"root":{"item":', sort(outputs('Compose'), 'Date'),'}}'))),
		concat('/root/item[Item=''',item(),''']/Id/text()')
	)
)

 

Map Item:

 

item()

 

Map Date:

 

last(
	xpath(
		xml(json(concat('{"root":{"item":', sort(outputs('Compose'), 'Date'),'}}'))),
		concat('/root/item[Item=''',item(),''']/Date/text()')
	)
)

 

Map Number:

 

last(
	xpath(
		xml(json(concat('{"root":{"item":', sort(outputs('Compose'), 'Date'),'}}'))),
		concat('/root/item[Item=''',item(),''']/Number/text()')
	)
)

 

 

To defend my previous suggestion:
The external Apply to each can be avoided, but the internal one is due to the fact that a Delete row should take place anyway if you assume that the Excel file will be cleaned.

 

takolota
Multi Super User
Multi Super User

@fnanfne 

 

There’s also this template that will get distinct records for any given column criteria without any loops & without any xpath:

https://powerusers.microsoft.com/t5/Power-Automate-Cookbook/Get-Distinct-Records/td-p/2191533

 

If alternatively you want to remove/delete the duplicates, here is the companion Remove Duplicates template flow with a similar set-up: https://powerusers.microsoft.com/t5/Power-Automate-Cookbook/Find-and-Remove-Duplicates/td-p/2191403

@Matthy79 @takolota @Chriddle and @SamLed 

 

Apologies for my belated reply, I have been on annual leave. I'm still catching up on on everything at work and have not given this another look, will do soon. However, I'm appreciative of all your helpful and detailed replies, thank you very much!

Helpful resources

Announcements

Community will be READ ONLY July 16th, 5p PDT -July 22nd

Dear Community Members,   We'd like to let you know of an upcoming change to the community platform: starting July 16th, the platform will transition to a READ ONLY mode until July 22nd.   During this period, members will not be able to Kudo, Comment, or Reply to any posts.   On July 22nd, please be on the lookout for a message sent to the email address registered on your community profile. This email is crucial as it will contain your unique code and link to register for the new platform encompassing all of the communities.   What to Expect in the New Community: A more unified experience where all products, including Power Apps, Power Automate, Copilot Studio, and Power Pages, will be accessible from one community.Community Blogs that you can syndicate and link to for automatic updates. We appreciate your understanding and cooperation during this transition. Stay tuned for the exciting new features and a seamless community experience ahead!

Summer of Solutions | Week 4 Results | Winners will be posted on July 24th

We are excited to announce the Summer of Solutions Challenge!    This challenge is kicking off on Monday, June 17th and will run for (4) weeks.  The challenge is open to all Power Platform (Power Apps, Power Automate, Copilot Studio & Power Pages) community members. We invite you to participate in a quest to provide solutions to as many questions as you can. Answers can be provided in all the communities.    Entry Period: This Challenge will consist of four weekly Entry Periods as follows (each an “Entry Period”)   - 12:00 a.m. PT on June 17, 2024 – 11:59 p.m. PT on June 23, 2024 - 12:00 a.m. PT on June 24, 2024 – 11:59 p.m. PT on June 30, 2024 - 12:00 a.m. PT on July 1, 2024 – 11:59 p.m. PT on July 7, 2024 - 12:00 a.m. PT on July 8, 2024 – 11:59 p.m. PT on July 14, 2024   Entries will be eligible for the Entry Period in which they are received and will not carryover to subsequent weekly entry periods.  You must enter into each weekly Entry Period separately.   How to Enter: We invite you to participate in a quest to provide "Accepted Solutions" to as many questions as you can. Answers can be provided in all the communities. Users must provide a solution which can be an “Accepted Solution” in the Forums in all of the communities and there are no limits to the number of “Accepted Solutions” that a member can provide for entries in this challenge, but each entry must be substantially unique and different.    Winner Selection and Prizes: At the end of each week, we will list the top ten (10) Community users which will consist of: 5 Community Members & 5 Super Users and they will advance to the final drawing. We will post each week in the News & Announcements the top 10 Solution providers.  At the end of the challenge, we will add all of the top 10 weekly names and enter them into a random drawing.  Then we will randomly select ten (10) winners (5 Community Members & 5 Super Users) from among all eligible entrants received across all weekly Entry Periods to receive the prize listed below. If a winner declines, we will draw again at random for the next winner.  A user will only be able to win once overall. If they are drawn multiple times, another user will be drawn at random.  Individuals will be contacted before the announcement with the opportunity to claim or deny the prize.  Once all of the winners have been notified, we will post in the News & Announcements of each community with the list of winners.   Each winner will receive one (1) Pass to the Power Platform Conference in Las Vegas, Sep. 18-20, 2024 ($1800 value). NOTE: Prize is for conference attendance only and any other costs such as airfare, lodging, transportation, and food are the sole responsibility of the winner. Tickets are not transferable to any other party or to next year’s event.   ** PLEASE SEE THE ATTACHED RULES for this CHALLENGE**   Week 1 Results: Congratulations to the Week 1 qualifiers, you are being entered in the random drawing that will take place at the end of the challenge.   Community MembersNumber SolutionsSuper UsersNumber Solutions Deenuji 9 @NathanAlvares24  17 @Anil_g  7 @ManishSolanki  13 @eetuRobo  5 @David_MA  10 @VishnuReddy1997  5 @SpongYe  9JhonatanOB19932 (tie) @Nived_Nambiar  8 @maltie  2 (tie)   @PA-Noob  2 (tie)   @LukeMcG  2 (tie)   @tgut03  2 (tie)       Week 2 Results: Congratulations to the Week 2 qualifiers, you are being entered in the random drawing that will take place at the end of the challenge. Week 2: Community MembersSolutionsSuper UsersSolutionsPower Automate  @Deenuji  12@ManishSolanki 19 @Anil_g  10 @NathanAlvares24  17 @VishnuReddy1997  6 @Expiscornovus  10 @Tjan  5 @Nived_Nambiar  10 @eetuRobo  3 @SudeepGhatakNZ 8     Week 3 Results: Congratulations to the Week 3 qualifiers, you are being entered in the random drawing that will take place at the end of the challenge. Week 3:Community MembersSolutionsSuper UsersSolutionsPower Automate Deenuji32ManishSolanki55VishnuReddy199724NathanAlvares2444Anil_g22SudeepGhatakNZ40eetuRobo18Nived_Nambiar28Tjan8David_MA22   Week 4 Results: Congratulations to the Week 4 qualifiers, you are being entered in the random drawing that will take place at the end of the challenge. Week 4:Community MembersSolutionsSuper UsersSolutionsPower Automate Deenuji11FLMike31Sayan11ManishSolanki16VishnuReddy199710creativeopinion14Akshansh-Sharma3SudeepGhatakNZ7claudiovc2CFernandes5 misc2Nived_Nambiar5 Usernametwice232rzaneti5 eetuRobo2   Anil_g2   SharonS2  

Check Out | 2024 Release Wave 2 Plans for Microsoft Dynamics 365 and Microsoft Power Platform

On July 16, 2024, we published the 2024 release wave 2 plans for Microsoft Dynamics 365 and Microsoft Power Platform. These plans are a compilation of the new capabilities planned to be released between October 2024 to March 2025. This release introduces a wealth of new features designed to enhance customer understanding and improve overall user experience, showcasing our dedication to driving digital transformation for our customers and partners.    The upcoming wave is centered around utilizing advanced AI and Microsoft Copilot technologies to enhance user productivity and streamline operations across diverse business applications. These enhancements include intelligent automation, AI-powered insights, and immersive user experiences that are designed to break down barriers between data, insights, and individuals. Watch a summary of the release highlights.    Discover the latest features that empower organizations to operate more efficiently and adaptively. From AI-driven sales insights and customer service enhancements to predictive analytics in supply chain management and autonomous financial processes, the new capabilities enable businesses to proactively address challenges and capitalize on opportunities.    

Updates to Transitions in the Power Platform Communities

We're embarking on a journey to enhance your experience by transitioning to a new community platform. Our team has been diligently working to create a fresh community site, leveraging the very Dynamics 365 and Power Platform tools our community advocates for.  We started this journey with transitioning Copilot Studio forums and blogs in June. The move marks the beginning of a new chapter, and we're eager for you to be a part of it. The rest of the Power Platform product sites will be moving over this summer.   Stay tuned for more updates as we get closer to the launch. We can't wait to welcome you to our new community space, designed with you in mind. Let's connect, learn, and grow together.   Here's to new beginnings and endless possibilities!   If you have any questions, observations or concerns throughout this process please go to https://aka.ms/PPCommSupport.   To stay up to date on the latest details of this migration and other important Community updates subscribe to our News and Announcements forums: Copilot Studio, Power Apps, Power Automate, Power Pages

Users online (992)