Are you dialing a PPPoE connection for Internet access or does your router dial your ADSL account? If the router dials your internet account you would only be able to monitor the usage with the usage of a SNMP/PRTG monitoring application like PRTG Traffic Grapher. Unfortunately not all routers supports SNMP protocol.
You can always install NetLimiter 2 Monitor to monitor the Internet usage. If you setup your LAN & Internet subnets correctly (which should usually be automatically setup correctly for home networks), NetLimiter would be able to distinguish between Internet, Local Area Network and My Computer zones.