I have a feeling I'm rambling a bit, but what the heck ...
Yup, if you mean the attitude of those groups who go about trying to define as Literature the fiction they value while disparaging what others value. I recall an article many years ago in which a poet (whose name escapes me, and who I hadn't heard of before the article) ranted about how money was being wasted on bad fiction like The Demolished Man rather than on "good" works. Still, there's also a snob factor in sf/f/h, as in,
or,
Sorry, Psikey and Swank, but ever since I became acquainted with fandom, there's been an obvious (sometimes in written tantrums equivalent to jumping up and down while shouting) look-down-your-nose attitude to non-science fiction, even though many sf/f/h readers read voraciously in other genres. (And believe me, I'm not saying that attitude is never earned. Bad "literary" fiction is as bad as any other kind of bad fiction because it's bad.)
The intent and execution thereof behind much of "literature" and much of sf/f/h probably doesn't qualify any of it as Literature -- which is constituted of works that continue to have resonance with generation after generation of readers. Up until late in the 20th century it was a rare genre writer recognized in her/his own lifetime as good and worth reading by a wider audience -- I'm thinking Dashiell Hammett, Raymond Chandler, Elmore Leonard, Ray Bradbury, Ursula K. Le Guin, Samuel Delany, Stephen King (who is probably the ultimate example of fame in the writer's lifetime). Beyond them, I think is a finite list. For the rest, unfortunately, their work is often judged by critical views of genre writing as a whole. ("Critical" is not used to indicate professional critics, at least some of whom value good genre writing -- I'm thinking critics like John Leonard, Michael Dirda and even Harold Bloom, who had good things to say about Le Guin and John Crowley among others, regardless that he's famous in genre circles for his disdain for King.) That's not how we judge "literary" writers; no one measures the work of Hemingway or Joyce Carol Oates by the standards set by Nora Roberts, Danielle Steele or James Patterson ("Oh the collected works of Jacqueline Susann. The novels of Harold Robbins..." "Ah, the "Giants".)
At least some of the work of the s.f./f/h writers I mentioned above seem likely to earn or retain some degree of renown as literature -- I'd toss in Peter Straub, Ramsey Campbell, Tananarive Due and Joanna Russ as possible contenders for that status, as well. If they maintain their recent standard of achievement, Silvia Moreno-Garcia and Stephen Graham Jones might make it, too. Of one I feel pretty sure, and that's H. G. Wells, who has already attained that stature. His early adventure/satires from The Time Machine and The War of the Worlds through The Island of Dr. Moreau and The Invisible Man already appear to be indelible entries in our conception of Literature, their fame enhanced by attempts to film them, thus keeping the titles in public view.