Even if Kinect was highly accurate and it could detect the tiniest motions, still for a sword game you'd want something in your hand because it feels weird to swing around just your hand. Your tactile feedback isn't correct. It doesn't trigger these wrist feelings. People are very physical in that sense.