Skip to main content

Image Search

🔗 Original page — Source of this material


Description​

Allows you to click an element using visual search. We recommend using it when you cannot find the element by other means. It is also suitable for Flash and Canvas.

Uses a lot of computer resources

image-20200813-211635

How to add to your project?​

Hover your mouse over the element and right-click to open the context menu:

image-20200813-211831


How it works​

image-20200814-180030

  1. Adjustable search area — select a unique part of the element that distinguishes it from the others.
  2. Click target — sets the click location inside the search area and can be moved.
  3. Match accuracy — specify, as a percentage, how closely the element must match the sample.
  4. Search — search in the browser window.
The element found will be highlighted with a red frame

image-20210613-082930

  1. Yes — confirm that the element found meets your criteria.

  2. No — reject the result to change the search parameters.

Click settings​

These apply to the successfully found element.

image-20200814-180412

  1. Choose the Click type:
    • Left click — a regular left mouse button click;
    • Right click — a right mouse button click on the element;
    • Double click — a double left mouse button click;
    • Drag event — an event that occurs while the object is being dragged;
    • Drop event — an event that occurs when the object is released in a valid area.
  2. Test the click in the browser window.
  3. Add the configured action to your project.

Example usage​

Search example​

Suppose you need to find a particular button to click on a page:

image-20200814-180819

Open image search in the browser window and specify a unique area:

Unique areaContains a lot of uniform color
image-20200814-181437image-20200814-181200

Now choose the click type (Left click in this example) and test it in the browser window:

image-20200814-181604

The click succeeded, so add the action to the project canvas:

image-20200814-181704

Project example​

This feature can be useful in Flash games or applications where you cannot access individual elements. The workflow is as follows:

image-20200814-182208

  1. Go to the page and wait for it to fully load.
  2. Hover your mouse over the element, open the context menu, and select Image Search.
  3. Specify a unique search area and the click parameters.
  4. Test in the browser window.
  5. Add the action to your project.