For me, he is 80, and playing the dirty grandpa can be funny - that time - maybe not so much in light of the subject matter and clipped for sound-bytes. But he was on the Howard Stern Show...it's not like he was at church.
It just isn't that damming to me. It's a not a real part of the overall narrative versus something that's just "come out". In that way I do think it's taken out of context.
Maybe I get proven wrong on this one and a slew of things come out against George Takei where you have to look back on the clip and say, damn...(god I hope not), but for now, nothing new at least...