Power Apps Test Studio Feedback discussion thread

[AengusHeaney]

We recently launched the new Power Apps Test Studio to help you build end-to-end tests for your Canvas apps. You can read more about it in this blog post. As you use the tool, we’d love to hear your feedback, so we can prioritize the next set of improvements, any features that are missing, or any of the current behaviors that may not be ideal.What kinds of tests are you writing? Is there anything that is too hard to understand, and that we could make easier? This community post will be used to consolidate all feedback on the tool. You can also access this post directly from the "Provide Feedback" link in the Test Studio.

[ravindar1]

Hi All,

I have started POC using Test Studio tool to automated Apps functionality in Power Apps. While automating getting time sync issue like tool executes fast but application is loading slow due that test assertion conditions are failing because of late loading of objects. Do have any  static time (wait/sleep/pause) or dynamic time to handle the time sync issue ? Please find below screenshot for the assertion failed issue.

Thanks in advance!

• Att

[Hazim]

Hello @ravindar1

Thanks for your question. Unfortunately, Test Studio does not offer a native Wait or Delay step today. That said, you can still leverage the timer control in Power Apps to set certain triggers based on OnTimerStart and OnTimerEnd events that you can still reference inside Test Studio. 

[ravindar1]

Thanks Hazim. I will use timer control and let you know status. We are planning to use Test Studio in our organization. Need your help to complete implementation of Test studio. Looks to till now. I have very good 14 years of experience testing test automation framework and worked on different tools and developed frameworks. 

Thanks in advance!

[LauraMay]

Hi

I have managed to set up Test Suites and Cases in my PowerApps, getting them to run via the AzurePipeline and pushing the results to two CDS tables AppTestResults and AppTestSuiteResults following the PowerApps guidance. (V pleased great time saving for future relelases!)

Question: The AppTestResults table only collects a record of the TestPasses which occur OnTestCaseComplete, how can I collect TestFailureMessages for those cases that have failed? The fact that the testcases fail means they dont complete, so I am assuming that's why the Patch doesnt collect the Failed results.

All my test cases are very small so its fairly straightforward to identify which ones are missing in the records, but I would rather have a positive affirmation and see a record for all Test cases, both Passed and Failed, then use the TestSucess field to see which ones passed and failed and the TestFailureMessage to see why. Please could you guide me to what code and where the code needs to go be able to create records for the Failed test cases, these are the ones we care about in order to get them fixed. Thanks

[Hazim]

Hello @LauraMay ,

I assume you have been following the instructions outlined in this document. If not, I highly recommend reading the full document. OnTestCaseComplete records both passed and failed tests. So you should be able to capture both. That said, if a test step is incomplete for one reason or another (e.g. it gets stuck waiting for an event or a timer), then you won't get a result back until the step is complete.  Hope that helps ! 

[Anonymous]

I am able to test the Power app manually. I recorded the script using Power app test studio, but while running the recorded tests.

Its getting stuck at "Setup-steps: onTestCaseStart". Please advise. Attaching the screenshot for reference.

[bernersennen]

We lost all our tests in Test Studio and we are getting an error message that we've lost the connection, see attachment.

We have tried restarting the app, restarting the computer, with different user accounts, with different computers, but we are getting the same error message. 

Any clues what is going on and how we can get back our tests?

[SPJP2Adm1]

I find this feature very useful, but since it seems to be in the testing phase, I am hoping that this feature will become a preview soon.
Are there any plans to promote it to preview at this time?

[LauraMay]

Hello, I have been trying to open the Power Apps Test Studio via my app in both Google Chrome and Microsoft Edge and I am always receiving the message 

Your session is currently disconnected. You can restart your connection by re-entering the tool.

We've lost connection to your app. You can restart your connection by re-entering the tool.

This started yestrerday and is continuing today (20-Jan-21)

I have opened all my Apps multiple times and seem to be getting the same problem with all of them.

Is there something fundamentally being worked on or wrong in the back end causing this?

Thank you

(Sorry I note after posting that this has already been raised by @bernersennen  sorry for duplication, an update would be appreciated)

[LauraMay]

Thank Hazim, Yes it must be a case that the test in incomplete because something else failed on a previous test. Thx for the guidance.

A second question for you @Hazim, I have set testing up to save the results to  DataVerse tables AppTestResults and AppTestSuiteResults as per the procedures you referred to. Would you be able to help advise me how I can send the results to a Sharepoint site, where you say in point 3

"The following sample saves each test case's results to the custom AppTestResults entity in Dataverse. The test results can optionally be stored to SQL, SharePoint, or any other data source. You might need to set or increase the Trace field in your data source as required."

Reason why...I have multiple PowerApps environments Development, Test, Production. At the moment to having automated testing in each environment, I need to set up the pair of tables in every environment to collect results. I am thinking can I send the results from my Development, Test and Production environments all to a single centralised Sharepoint list?

Looking forward to hearing how you might approach it.