What have maps to do with anything?
I think I was the person who mentioned maps; I said I liked them (whether fictional or otherwise). I don't think they are a precondition of good SFF, and no one has said so in this thread. And no one has said, as far as I've noticed, that we should put world-building above story. What a lot of people have said is that they expect the author to get his world straight in his head so that, as AGS has mentioned, dense elves don't become weightless (and so suggest that the author is even denser than his creations).
What I read fiction for is the story; I expect it to be coherent: the plotlines should make sense; the characters should behave in a way that makes them seem real; the environment should operate so that it has internal consistency. Is this too much to ask? Not in a good book, which should meet all of these criteria. Do I expect tens of thousands of words explaining the tiniest detail of everything I see? No.
For my own part, I have provided maps in my stories (all works in progress); they are there as much to suggest the worlds I've built are more complete than I've had space in the text to describe. I also have diagrams that help me understand where things are and how they might work; I have never thought that these would be, or ought to be, published, any more than an outline, synopsis or treatment would be.