ghoti, having phone records is the tip of the iceberg. What sits under the water is what you should be concerned about. It is the stuff happening in the background where data becomes information and information becomes intelligence where the problems lie. There are algorithms running day and night to identify patterns. To an agency hunting criminals your innocent patterns may not mean anything, but to someone else selling insurance it is a treasure trove. Over time the patterns become the study of behaviour and when behaviour changes alarms go off and questions are triggered to try to explain the change.
We are already logged and analysed. Our kids are from a much earlier age. Over time patterns become extremely valuable in telling who/what we are and what we may be up to. Algorithms will predict our future behaviour based on past patterns. And it will include those from family members going back a few generations in future. A grand-grandchild may be imprisoned before he even starts school because of the outcome of these analytics. Woman may even be forced into abortions before they "bring a risk into society". Now connect this with genetics research. Get the picture?
Either we stand up now when it all starts up, or our descendants will suffer and blame us for selling them out in exchange for a convenient "safe" life inside our pizza-box-filled comfort zones.