I will never forget taking my daughter home from the hospital and hearing "Hey Ho" by The Lumineers on the radio. I bought that album and listened to it non-stop. Hearing that song will always remind me of her. I also found myself listening to a lot of female artists like Joan Jett (mostly her greatest hits album), Patti Smith (Easter & Horses), Nico (Chelsea Girl), and No Doubt (Tragic Kingdom) while my wife was pregnant with our daughter. I don't even know if I was doing it subconsciously or if I was aware at the time, but those are albums that remind me of her. It also probably explains why she talks back all the time and doesn't listen to either me or her mother.
When my son was born he was a light sleeper, so I played a lot of Paul Simon (Self-titled album, Graceland, and Still Crazy After All These Years) and Lou Reed (Transformer) to chill him out.
Now we are expecting our third, so I we'll see what my tastes are this time around. Probably something chaotic, although, lately I have been listening to "The Rise and Fall of Ziggy Stardust and the Spiders from Mars" pretty much on repeat while at work.
It's funny to see how my familial changes influenced my taste of music.