I sympathize with your situation as I am a gamer and cringed when I heard that. This was not the first time that a comedian on CBB ripped video games and discouraged listeners to play them as they are a "waste of time". I am surprised anyone would spend so much time watching tv/movies, etc and then think that JUST video games are a waste of time.
When I play games such as Journey, The Last of US, Shadow of Coleuses, Half Life series, Persona series, Zero Escape, Heavy Rain, La Noire, Red Dead Redemption, Batman Arkham series, Bioshock 1 & INF, etc, etc I am treated with well written stories, intelligent and funny dialog, beautiful scores and sounds, landscapes/graphics that affect me emotionally and lots of entertainment. This is much more then I can say for your average movie or tv series that is released now a days. Well crafted games/movies/books can change my mood and inspire me to be productive or allow me to reflect on something going on my life with new perspective. I include all 3 mediums, movies, games and books and neither is more valuable to me then the other. Books usually provide the most intelligent/educational writing, movies effect me the most emotionally, and games fall somewhere in between the two. Yes, if you play the right games I think you will find that video games have more intelligent, funny and thought provoking dialog then your average tv/movies.
Some ppl knock video games for making ppl anti social which is just ridiculous because you could say the same thing for books. It all depends on what types of games you play and whether you are capable of putting the game down at any moment when you really should. Games are great when played solo but even better with creative friends. When playing games which resemble interactive movies, I am equally entertained while watching someone else play as I am holding the controller. Video games are so far beyond just being silly fun with spacey sound effects that will rot your brain and give you sore thumbs. Anyone who is reluctant to play them because they consider them self "grown up" and not a kid anymore is missing out. If you spend all of your time in life helping people or developing new technology to improve society and have no time for entertainment then sure video games are probably not worth your time. But 99% of people could benefit from playing certain games, and I'm sure if the naysayers would approach it with an open mind they would realize their potential.