Inside jokes

I was asked to read and comment on a screenplay this past month. The writer had written a story that was pretty universal but had buried it in the language and jargon of a particular hobby group. I won't say what to protect the writer, but let's just say that if you didn't share this unique interest most of the dialogue made no sense. Early in my writing I struggled with the fact that too many of my characters sounded like me. It led to lots of late nights and rewrites. Sometimes I wonder if in our enthusiasm about a particular topic we might be losing our audience because we're too busy navel gazing and speaking an insider's only language. So writers out there, is your work filled with inside jokes that no one gets? Just wondering.