GUI automation

[kalos]

hello

I have tried several GUI automation solutions, including AHK, AutoIt, Ranorex, Sikuli, etc.

The problem was always the same: there is no way to identify many GUI elements/controls.

is there any solution to this problem?

I need to record macros to programs that have GUI elements/controls, that do not have classnn, or other distinguishable characteristics.

thanks

[Ath]

I need to record macros to programs that have GUI elements/controls, that do not have classnn, or other distinguishable characteristics.

-kalos (September 04, 2011, 05:05 AM)

Eventually, most applications have them, but they can hide it in certain situations. When building WinSendKeys I had a bit similar issues, and reverted to doing other-control-relative mouse-clicks, usually it's toolbarbuttons that don't have these classnames/classnn, but the toolbar or it's surrounding windows has, and the toolbar is often in a fixed location.

Can you give examples of applications that hide (most) controls like this? I know Firefox 4.0 and later has issues in this arena, and some apps created using C++Builder 6 have the issues with the toolbars, mentioned above, but I haven't found much other applications with this behavior.

[kalos]

there are so many controls that are not identifiable, for example in Pop Peeper:
I hover over the Close button, and there is nothing I see that distinguishes it from eg. the Delete button:

[Renegade]

Have you looked at this:

http://www.mjtnet.com/

Not sure if it addresses what you need.

[kalos]

Have you looked at this:

http://www.mjtnet.com/

Not sure if it addresses what you need.

-Renegade (September 04, 2011, 07:49 AM)

I just tried it, it looked promising but unfortunately it did not do what I want
I used a macro recorder to record opening of Pop Peeper main window, opening then an email, then clicking Close, and it only recorded the position and movements of the pointer, not any identifiable info of the windows and controls/elements.

[kalos]

any other solution???

[ldarrambide]

The one I use, and saved me a lot of time from daily chores:

Quick Macros

It's the first program I install when reinstalling windows.

Useful from beginners to gurus

http://www.quickmacros.com/

HTH

[kalos]

The one I use, and saved me a lot of time from daily chores:

Quick Macros

It's the first program I install when reinstalling windows.

Useful from beginners to gurus

http://www.quickmacros.com/

HTH

-ldarrambide (September 06, 2011, 04:09 PM)

seems very interesting

can it take screenshots of the elements I click and create computer-vision-driven identification, like Sikuli?

I also found www.mouserobot.com which is also very promising, with an excellent element region identification, but not sure if I can make it identify accurately any element

[ldarrambide]

I don't get exactly what means "create computer-vision-driven identification", but
if you mean recognize bitmap on screen and do action on it, yes,
there is a "find image, wait" function that allow image processing.

Go to the forum, very useful, and the author (Gintaras) is
real god of programming and generally answers *any* question
in 24-48h. Responsive and clear.

If not, http://www.macrotoolworks.com/ could have tools
to help you, but i feel less comfortable there....

HTH

[bob99]

A while back I did a search on a couple of the different macro recorders and one of the results brought up alternativeTo.net.  It provided a pretty good list of different programs. Link to the list sorted on visitor/user likes: http://alternativeto...k-studio/?sort=likes

I haven't used any of these but one of them may suit your needs or rings a bell with one of the other readers of the post that can provide some input.

Not affiliated with alternativeTo or any of the programs.

[kalos]

A while back I did a search on a couple of the different macro recorders and one of the results brought up alternativeTo.net.  It provided a pretty good list of different programs. Link to the list sorted on visitor/user likes: http://alternativeto...k-studio/?sort=likes

I haven't used any of these but one of them may suit your needs or rings a bell with one of the other readers of the post that can provide some input.

Not affiliated with alternativeTo or any of the programs.

-bob99 (October 12, 2011, 06:24 PM)

thanks for the list, although it is far from complete, since it lacks Ranorex

[Jimdoria]

So Sikuli did not work? Seems from the description like it should wok on any visible screen element. What was the problem?

I'd like to try Sikuli out, but if it doesn't work as advertised, I won't waste my time.

[kalos]

So Sikuli did not work? Seems from the description like it should wok on any visible screen element. What was the problem?

I'd like to try Sikuli out, but if it doesn't work as advertised, I won't waste my time.

-Jimdoria (October 13, 2011, 03:54 PM)

it works very well, but I would like something more accurate

[kalos]

I have an idea

when a specific window control is displayed on screen, specific bytes are in RAM (I suppose)
so why not use that data to identify and manage window controls?