Change Button Shapes in AI Builder Manual Mode

Updated 4 November 2026 · Standard formula, shown below

This guide shows you how to change the shape of buttons in AI Builder’s manual mode, which is useful when you want your automated workflow to interact with a web page by clicking a specific button. You’ll learn to adjust the button’s appearance (like making it round or square) directly in the AI Builder interface, so the model recognizes it correctly. First, make sure you have access to AI Builder in Power Automate or Power Apps, and that you have a flow or app with a button element you want to modify.

What You’ll Need

A Power Automate flow or Power Apps canvas app with AI Builder enabled.
A button control (like a submit button) that you want to change the shape of.
Basic familiarity with the AI Builder interface, especially the “Manual mode” for form processing or object detection.

Step-by-Step

Open your AI Builder model: Go to the Power Automate or Power Apps environment where your AI Builder model is stored. Open the model that you want to edit (e.g., a form processing model or an object detection model).
Enter Manual mode: In the model editing screen, look for the mode selector. Switch from “Automatic” or “Quick test” to “Manual mode.” This mode lets you manually adjust the regions and shapes that the model uses for detection.
Locate the button: In the manual mode canvas, you’ll see the sample document or image you uploaded. Find the button you want to change the shape of. It might be a rectangular button or an icon that looks like a button.
Select the current shape: Click on the existing bounding box or polygon that outlines the button. This will highlight it and show handles (small squares) around the edges.
Adjust the shape: To change the shape, you can drag the corner handles to resize the rectangle, or use the toolbar to switch to a different shape type. Look for a “Shape” option in the top toolbar (it might be a dropdown with icons like rectangle, ellipse, or polygon). Choose the desired shape, like a rounded rectangle or an ellipse.
Fine-tune the shape: After selecting the new shape, drag the handles to adjust its size and position so it precisely covers the button. For an ellipse, you’ll see a bounding box, and the ellipse fits inside it. For a polygon, you can click to add vertices and drag them to match the button’s outline.
Save your changes: Once the shape looks correct, click “Save” or “Apply” in the top-right corner. This updates the model’s configuration.
Test the change: Use the “Test” button to run the model on a sample input. Verify that the button is still detected correctly with the new shape. If not, go back and adjust the shape further.

Common Mistakes

Using the wrong mode: Trying to change shapes in “Automatic” mode, which doesn’t allow manual adjustments. Always switch to “Manual mode” first.
Not covering the entire button: Leaving gaps between the shape and the button’s edges, which can cause the model to miss part of the button or misidentify it.
Overlapping shapes: If you have multiple shapes, making them overlap can confuse the model. Keep shapes separate.
Forgetting to save: Making changes but not saving them, then wondering why the model still uses the old shape.

Tips

Use a consistent shape: If all buttons in your documents are rectangular, stick with rectangles. Using ellipses for rectangular buttons might reduce accuracy.
Zoom in: Use the zoom feature to get a close-up view of the button, making it easier to align the shape precisely.
Check the label: If the button has a text label, ensure the shape includes the entire label area, as the model may need to read the text.
Use keyboard shortcuts: In manual mode, you can often use arrow keys to nudge the shape pixel by pixel for finer control.

Troubleshooting

The shape won’t change: If you select a new shape but it doesn’t apply, try refreshing the page or restarting the AI Builder editor. Also, ensure you’re in the correct editing mode.

The button is not detected after changing the shape: This usually means the new shape doesn’t match the button’s actual appearance. Revert to the previous shape or adjust the new shape to better fit the button. You can also try increasing the shape’s size slightly to cover any margins.

Changes not saved: If you exit the editor and return to find your changes gone, make sure you clicked “Save” before leaving. Also, check if you have the necessary permissions to edit the model.

Frequently Asked Questions

Can I change the shape of a button in AI Builder without using manual mode?

No, manual mode is the only place where you can directly edit the shape of detected elements. Automatic mode uses preset shapes that you cannot modify.

What shape types are available in manual mode?

Typically, you can choose from rectangle, ellipse, and polygon. The exact options may vary depending on the AI Builder feature you’re using (e.g., form processing vs. object detection).

Will changing the shape affect the model’s accuracy?

Yes, it can. If the shape matches the button’s actual outline, accuracy improves. If it doesn’t, the model might fail to detect the button or misclassify it.

Can I change the shape of multiple buttons at once?

No, you must adjust each button individually. There’s no batch edit feature for shapes.

How do I delete a shape and start over?

Select the shape and press the Delete key on your keyboard, or look for a trash icon in the toolbar. Then you can draw a new shape.

Does changing the button shape require retraining the model?

No, manual mode adjustments are part of the model configuration, not the training data. You don’t need to retrain, but you should test the model after making changes.

Method: the standard formula for this calculation, rounded as each result states. See how the calculators work or report an error.