Skip to content

Commit 09884bc

Browse files
committed
Merge branch 'uipicker-cant-see-elements' of https://github.com/iomimtso/SupportArticles-docs into 8145-open-ui-element-cant-see-elements
2 parents 2848cbf + 13cfbeb commit 09884bc

File tree

1 file changed

+72
-0
lines changed

1 file changed

+72
-0
lines changed
Lines changed: 72 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,72 @@
1+
---
2+
title: UI element picker or Recorder cannot view UI elements in desktop applications
3+
description: Learn how to resolve issues when Power Automate for desktop cannot view or interact with specific UI elements in desktop applications.
4+
ms.date: 11/05/2025
5+
ms.custom: sap:Desktop flows\UI automation
6+
ms.reviewer: nimoutzo
7+
ms.author: iomimtso
8+
---
9+
10+
This article provides solutions for situations where Power Automate for desktop cannot view or interact with specific UI elements in a desktop application.
11+
12+
## Symptoms
13+
14+
When using Power Automate for desktop, the element picker tool cannot detect or "see" certain UI elements within desktop applications. This issue prevents you from selecting elements for automation tasks.
15+
16+
## Cause
17+
18+
Some desktop applications use custom UI frameworks or rendering methods that aren't compatible with standard accessibility APIs that Power Automate for desktop relies on. This can make certain elements invisible to the element picker.
19+
20+
## Resolution
21+
22+
Use one of the following workarounds to interact with UI elements that cannot be detected by the element picker.
23+
24+
### Solution 1: Use Move mouse to image action
25+
26+
1. Add a **Move mouse to image** action to your flow.
27+
2. Capture an image of the UI element you want to interact with.
28+
3. Enable the **Send a click after moving mouse** option.
29+
4. Configure any additional settings as needed.
30+
31+
The action moves the mouse to the first occurrence of the specified image and sends a left click.
32+
33+
### Solution 2: Use Move mouse to text on screen (OCR) action
34+
35+
1. Add a **Move mouse to text on screen (OCR)** action to your flow.
36+
2. Specify the text that appears on or near the UI element you want to interact with.
37+
3. Enable the **Send a click after moving mouse** option.
38+
4. Configure OCR settings and click options as needed.
39+
40+
The action uses Optical Character Recognition (OCR) to locate text on the screen or foreground window and sends a mouse click to that location.
41+
42+
### Solution 3: Use the recorder with coordinates
43+
44+
1. Open Power Automate for desktop and create a new flow.
45+
2. Select **Recorder** from the toolbar.
46+
3. Start recording and perform the click action on the desired UI element in your desktop application.
47+
4. Stop the recording.
48+
49+
The recorder creates a **Click UI element in window** action with coordinate-based input parameters populated with the respective values from your click action.
50+
51+
### Solution 4: Use Move mouse and Send mouse click actions
52+
53+
1. Add a **Move mouse** action to your flow.
54+
2. Configure the action to move the mouse to the specific coordinates of the target element.
55+
3. Add a **Send mouse click** action immediately after the Move mouse action.
56+
4. Configure the Send mouse click action to perform the desired click (left, right, or double-click).
57+
58+
## Important considerations
59+
60+
> [!IMPORTANT]
61+
> For coordinate-based solutions (Solutions 3 and 4) to work reliably:
62+
>
63+
> - The screen configuration (resolution, DPI settings, scaling) must remain static at runtime and match the configuration used during development.
64+
> - Changes to the application's user interface structure may affect the effectiveness of these workarounds.
65+
> - Test your flows thoroughly when deploying to different machines or environments.
66+
67+
## See also
68+
69+
- [UI automation in Power Automate for desktop](/power-automate/desktop-flows/ui-elements)
70+
- [Use the recorder in Power Automate for desktop](/power-automate/desktop-flows/recording-flow)
71+
- [Mouse and keyboard actions](/power-automate/desktop-flows/actions-reference/mouseandkeyboard)
72+
- [OCR actions in Power Automate for desktop](/power-automate/desktop-flows/actions-reference/ocr)

0 commit comments

Comments
 (0)