It depends on the work environment
I have worked at several IT jobs, and basically it boils down to whether or not the IT people have a unique identity distinct from the rest of the corporate workforce.
In some jobs, IT people are just like regular people. Nobody really understands what you do, but as long as you do it, they don't care. They have a hard time understanding why your budget is as big as it is, why you make more money than they do, and why you go to out of town seminars when they are penned into the cubicle farm.
Other places, primarily programming houses and other IT heavy places, nerds are the stars. We get to wear what we want, define our own working hours, and get perks left and right. You work with people just like you, who don't get glassy-eyed when you start talking SQL queries and PERL scripts.
Overall, I don't mind being called a nerd. As long as its not derogatory, and the people I work for recognize my talents and give me opportunities to excel and grow, they can call me whatever they want ;)
ps - What's all that talk about money not being the most important thing? Working environments are nice, and I might require a little less money to work in a great office, but still -- YOU WORK TO MAKE MONEY. Never forget that. Especially when your company posts 300% profit increases because of system improvements YOU MADE, and you get a paltry 5% cost of living raise at the end of the year. If they owe their success to your hard work, make sure they know it.