concerns of bad apples, people who don't get it, and general fandom dregs aren't really all that significant if you know how to cultivate an circle of peers whose thoughts, opinions, and ideas you respect and acknowledge.

you can't be called a gatekeeper if you do this as well because you're not really stopping anyway from discussing the particular object of devotion.