You guys got me thinking, perhaps it's the objective distancing that SF prefers that puts me off.
The wish fulfillment aspect being interacting with one's environment. To talk to trees and people and animals. To be understood, or able to fight for understanding.
Perhaps I don't care for SF because I do relate to it, and prefer fantasy because I want to learn how to relate to my world better.
Then, may I suggest some different sf? Have you tried
Doomsday Book, by
Connie Willis? Time travel novel which dealing with huge social events, but in relation to personal interactions and their environment. There's also
Ursula K LeGuin's classic
The Left Hand of Darkness, basically a travel novel through a wintery planet, the intrepid adventurer exploring issues of society and gender as he goes; and the novels of
Nancy Kress and
Octavia Butler, who write beautifully, and often about people in environments - some like our own, others not so much. You could also check out the new kids on the block,
Becky Chambers, and our own
Jo Zebedee (she's not so much nature-orientated, although there is some, but definitely centres on people).
Just some of my preferred authors.
But, if you prefer to read fantasy, then nor is there anything wrong with that.
EDIT: I like both and, although I tend to read more sci-fi, I don't think of it as an either/or choice. Sometimes, it just depends upon my mood. Sometimes, I read romance, or poetry, or detective fiction. Even magazines in the dentist's waiting room.