Wow, this is nice, anyone know how to take screenshot with this? Also how is this compared to Splash[0]?

[0] - http://splash.readthedocs.org/en/latest/

Shameless plug, a while ago I wrote a micro rest api (ghost.py + flask) to take screenshots and optionally upload them to S3: http://gedrap.github.io/lightshot/

It still needs some extra work to be production ready though, please feel free to email me or create a github issue if you think it might useful for you :)

There is a capture_to[0] method that can be used to save a screenshot.

Btw, Thanks for telling me about Splash, I needed something that has support for Ad Block Plus rules.

[0] - http://ghost-py.readthedocs.org/en/latest/#ghost.Ghost.captu...

How is this different from https://github.com/niklasb/dryscrape?

Based on "scriptable" and the short example I'd guess this is a headless browser ala PhantomJS, but then it says it requires PyQt/PySide so maybe not?

It probably uses WebKit from PySide / PyQT see:

https://pyside.github.io/docs/pyside/PySide/QtWebKit/index.h...

I think it's sort of an approach towards something like nw.js but I could be wrong, a bit of more description as to the purpose and use case would help evade the confusion since I'm only speculating..

Can someone please explain what this does? I'm a little unclear.

It lets you interact with a version of webkit via python. Useful for writing programs to interact with websites that normally require a user to press buttons.

How does this compare to mechanize?

it's basically a tool for mining a web site.

Very interesting project, keep it up.