Like giggity said you can run wordpress on a local PC with the above tool or this one that once installed can run of a flash drive. Possibly the best way to start is to get one of those running, try fiddling with it to get a feel and you can see how easy it is to make it your own. It comes with basic themes and little plugins but you can search for others and download them to see what is available.