No that's not right. How big is the array?
If you have software to monitor the status of the array, using it now might be a good idea - perhaps one of the disks are buggered... Last I had RAID 5, we had close to 800GB, that took about 6Hrs to rebuild (UltraSCSI)...
Depending on the type of hardware and size of the array, I'd say now is a good time to perhaps start looking at what it is doing... Use the software you got with your server/controller (aaccli if you're on *nix), and give it a peak. If the disks are not marked as 'Healthy', they are more than likely still rebuilding. If there are errors, they should have shown up by now.
Unless you have definate errors, just relax, have a beer, and let it do it's thing. The fact that you're using the disks while it's building might just slow it down even more... But I know I would feel better if I knew for a fact it was rebuilding, instead of a possible error.