Sure, knock yourself out (the equipment will be fine).
Longer answer: assuming (and no reason not to) standard, and more than likely 802.3af switches and phones, power gets activated only after a successful handshake between a source device (the switch), and a client - in this case a phone. The...