With me it was different. If I only listened intently I would have forgotten what was said by the next week. By this I'm not saying that you should write down everything the lecturer is saying. And I'm not saying you should sacrifice the listening. You should learn to do both.
Note-taking is a skill that is crucial to your studies. Writing fast, writing legibly, writing down the important stuff (but as cohesively as possible so that you don't lose the context) and keeping a good filing system is the most important thing you can do as a student. Re-reading a textbook will waste a hell of a lot of time. Good notes are worth more than gold.
I sometimes suffered because my notes were too cryptic. When it came to the exams I got confused with what my notes were all about and the textbooks were just too volumous.
My notes to prospective students has always been "Don't fck around with your notes. Keep your stuff neat and tidy and be systematic from day 1-99 to the point of being obsessively compulsive."