Controlling PC

H

HavocXphere

Honorary Master
Joined
Oct 19, 2007
Messages
33,153
Reaction score
1,297
Location
Europe
I'm missing a "tool" in my toolbox for daily work: Something like AutoIT that can script things like mouse clicks and key presses easily.

Rather than learning AutoIT I'd rather spend the time learning a proper language even if it takes a bit longer. I'd rather not use a 3rd party library to do the mouse & keyb stuff.

I've got a bit of Python, C# and Delphi knowledge. Not so keen on Python anymore though...new lang would be better.
 
You can use scelenium.

Edit:

Wait so you want to control mouse and stuff with a programming language?
 
Last edited:
semaphore said:
You can use scelenium.

Edit:

Wait so you want to control mouse and stuff with a programming language?
Click to expand...
Yip. Though I don't need it to actually "move" as in have it visually cross the screen...just need the final outcome (button clicked or whatever)

Googling scelenium doesn't seem to show much aside from game replays?
 
HavocXphere said:
Yip. Though I don't need it to actually "move" as in have it visually cross the screen...just need the final outcome (button clicked or whatever)

Googling scelenium doesn't seem to show much aside from game replays?
Click to expand...

Lol. Scelenium is more for automated web site testing. Misunderstood you.
 
HavocXphere said:
I'm missing a "tool" in my toolbox for daily work: Something like AutoIT that can script things like mouse clicks and key presses easily.

Rather than learning AutoIT I'd rather spend the time learning a proper language even if it takes a bit longer. I'd rather not use a 3rd party library to do the mouse & keyb stuff.

I've got a bit of Python, C# and Delphi knowledge. Not so keen on Python anymore though...new lang would be better.
Click to expand...

I own (bought a personal copy) this:

http://www.jitbit.com/macro-recorder/

And have bought it on a few occasions where the need has been to automate things like that in Windows... You can record a series of actions then turn it into an executable that can be scheduled... This becomes EXTREMELY useful if you know your shortcut keys but not necessary as u can record mouse actions too.

Really top notch!

It also mentions this:

Automation software. Insert custom commands and statements into your macros, like: "launch website", "open file", "wait for window", "goto", "shutdown" and many more. Add logic to your macros using the "IF - THEN" statement, "REPEAT X TIMES" statement.

C# scripting language - you can insert code snippets in C#

And just a note from my experience with it... If you are recording mouse actions it tends to depend on the current resolution... It's better to script it without the need for a mouse as if you change a screen or the PC boots in safe mode etc, you're screwed...

Also a small hint... This + WAMP server... Shjoh man, you can do a lot! :D
 
Last edited:
HavocXphere said:
Seems nice. Same issue as AutoIT though...might as well learn a real programming language.
Click to expand...

Only you would know what your uses are... I have not made use of the highlighted features as most of the time its a combination of shortcuts, run, tab, space, enter and batch files...

If you're really going to dive deep into the depths of manipulating stuff like that... It would more than likely end up interesting however... Maybe you just need a paradigm shift :)
 
What is the use-case for this? (What are you trying to accomplish?)

Maybe there is an alternate method, instead of using a screen-action recorder.
 
noob_saibot said:
What is the use-case for this? (What are you trying to accomplish?)
Click to expand...
Controlling browser & controlling 3rd party software for repetitive tasks. Mostly the kind that is just a hint to complicated for a simple macro recorder....so I need some kind of scripting lang...and if I learn that then it might as well be something proper.

e.g. I recently had a case where I needed to interact with 3rd party software based on a very long list....for each item on the list something needs to be done (or not depending on item). The 3rd party app has no usable interface or anything like that so I need mouse & kb. Obviously just an example...
 
Last edited:
HavocXphere said:
e.g. I recently had a case where I needed to interact with 3rd party software based on a very long list....for each item on the list something needs to be done (or not depending on item).
Click to expand...

Kinda sounds like you're trying to interact with a database using a bent spoon? Just saying... If it makes a list, surely you can change the info that makes up the list? o.O

Guess you might need some kind of foreign language after all... like COBOL because those vision files really suck! :D

In any case, it sounds like what I use the said program for a lot... It's really not that difficult to use either, give it a bash?
 
Last edited:
IndigoIdentity said:
Kinda sounds like you're trying to interact with a database using a bent spoon?
Click to expand...
If only...we're talking custom rolled software with custom rolled back ends and custom rolled file formats...no chance of dealing with the issue in a sane manner here. Mouse & keyboard all the way....

Thats just an example...not all of the situations are that rubbish but thats the reason why I need Mouse & kb...need to work around an assortment of BS.

IndigoIdentity said:
COBOL :D
Click to expand...
lols maybe next time.

And no - to clarify...the list isn't the issue...that part (in that example) is under my control...its the app I need to jam the info into that is the issue. The opposite applies too though...occasionally need to get info out of apps that are less than ideal.
 
If you are working with web-apps, Ruby + Http + Nokogiri can go a long way.

I've built a lot of automation using simple Ruby scripts.

GUI apps on the other hand, is why I avoid Windows :p

Windows, to me, is brilliant for browsing, watching movies and playing music, my general day to day stuff.

Programming and running work applications (in the form of GUI) not so much, and server environment it is just plain terrible.
 
Windows - XP and 7 mainly. (or worse).

Think inputting numbers into the windows calculator and say drawing a rectangle in mspaint and then you've got the mindset I need...except I sometimes need it to draw a triangle depending on conditions. Hence the programming lang part.

As I said this is more to fix a gap in my skills "toolbox" than solving a specific issue.
 
Last edited:
Simulating user input is very difficult - that's why people usually use the likes of AutoHotKey, etc and easy scripting languages.

If you want to write your own custom handlers, check out:
http://msdn.microsoft.com/en-us/library/ms171548(v=vs.110).aspx

If you have Visual Studio 2012 / 2013 Premium or Ultimate, you may be able to use the automated UI testing framework in there. I haven't used it so I can't confirm what kind of code it has behind it or if it works with non-.NET apps.
 
You must log in or register to reply here.
Back
Top
Sign up to the MyBroadband newsletter
X