Comments on: Xpresser – Python library for GUI automation with image matching

By: Komarue

Komarue — Thu, 03 Jun 2010 03:49:06 +0000

I think for this tool to be successful it needs to be cross-platform compatible. I have been trying extensively to integrate Sikuli style GUI testing with some applications I’m developing but it has been a very frustrating process to do anything outside of the Sikuli IDE. I am unable to even check the code out in windows using bazaar! I am not an incredibly experienced Python programmer (Java & FLEX/Flash) but I have been using it a lot these past few months and really enjoy it. I think tying in tesseract via the pytesser module might be a good idea. It could help with matching and allow the scripts “read” information out of images.

By: Tony Simpson

Tony Simpson — Thu, 20 May 2010 16:28:53 +0000

Quasar beta windows branch is available.

Find it through:
https://blueprints.launchpad.net/xpresser/+spec/ms-windows-support

By: Quasar Jarosz

Quasar Jarosz — Thu, 20 May 2010 14:26:42 +0000

Biggest problem I had was finding a windows version of PyGTK with Numeric support. I found one.. but when pixbuf.get_pixels_array() is called it hard crashes without any output.

I.. was not up to trying to compile my own.

So yeah, as far as it not depending on GTK.. it doesn’t seem to, except for the screenshot-taking bit. I looked at doing it another way, but I’m a very junior programmer and unfamiliar with much of this

I will keep following though, as best I can, to see if it will be useful to me.

By: Gustavo Niemeyer

Gustavo Niemeyer — Thu, 20 May 2010 07:58:24 +0000

Thanks for the changeset Henning.

Please note that, even though it depends on gtk to *implement* its features, at this point there’s absolutely nothing specific to gtk on the features and interface that Xpresser offers.

With this in mind, I don’t see a big reason to be pushing two different implementations in parallel.

If we manage to find a way to avoid gtk *and* qt entirely, then that might be an interesting move. It should certainly be possible, given what we’re doing with Xpresser.

As a side note, running tests with your qt interface breaks the test suite, which so far has almost 100% coverage, and ideally the screenshot taking routine should avoid touching the disk, for speed purposes.

I see you submitted a bug at:

https://bugs.launchpad.net/xpresser/+bug/583124

Let’s communicate about further ideas regarding this branch there.

By: Henning Schröder

Henning Schröder — Thu, 20 May 2010 00:28:21 +0000

Hello, I created a branch with support for PyQt and Xlib (pure Python) to remove the dependency on Gtk and pyatspi (which needs Gnome).
You find the code at https://code.launchpad.net/~henning-schroeder/xpresser/pyqt

By: Tony Simpson

Tony Simpson — Wed, 19 May 2010 18:12:41 +0000

I’m not very familiar with launchpad/bzr but I’ve created a blueprint for windows support and I’ll update it with any progress.

https://blueprints.launchpad.net/xpresser/+spec/ms-windows-support

By: Quasar Jarosz

Quasar Jarosz — Wed, 19 May 2010 15:46:42 +0000

Any luck with Windows Tony? I’m going to fiddle around with that right now. I wish I was lucky enough to need to handle testing and/or automation on Ubuntu machines, but I’m afraid it’s the window’s shops that actually hire people..

By: Tony Simpson

Tony Simpson — Wed, 19 May 2010 15:34:08 +0000

Excellent! Used Sikuli recently to automate some very boring task, was very impressed with the idea, but missed recent Python features and wanted more control over the matching etc.

I’ll be playing with this as soon as I get home, I’d like to be able to use it on windows (MSAA), so I’ll have a go at that.

By: Gustavo Niemeyer

Gustavo Niemeyer — Wed, 19 May 2010 15:32:16 +0000

Thanks for the note Warren.

I’ve not heard about this tool before your comment, and I’m not really concerned about patent attacks. If I had to look at what’s patented by someone every time I tried to implement something, I would have to retire as a developer.

Either way, thanks for letting me know.

By: Warren Smith

Warren Smith — Wed, 19 May 2010 15:17:52 +0000

This is really cool. There is definitely a need for an open-source solution in this space.

However, in case you are not aware, there is an existing commercial product that does functional GUI testing and automation using image-matching technology.

http://www.testplant.com/products/eggplant_functional_tester

I don’t know if they have any patents on their technology, but it may be prudent to check.

I use EggPlant at work and it is an amazing tool. My only gripe is that is uses an AppleScript derivative for scripting (called SenseTalk) instead of something more mainstream like Python.