I'm not sure I understand. People are buying books they don't really like? For reasons of greed or ideology, publishers aren't providing customers what they want? I don't buy it.
People aren't buying books they don't really like; they're buying books they don't really
love. Publishers are providing customers with what they want
enough to buy. My point was that I can offer ten people "really idiosyncratic novel A" and one of them will love it. The rest may hate it. As a publisher, I have to come up with ten "really idiosyncratic novels" to sell the ten books to the ten people. Or, as a publisher, I can offer ten people "pretty standard fare" and most of them will buy it because it's close enough. That's a lot easier, assured of success, looks good on the quarterly bottom-line, etc. I'm not saying publishers are pushing utter crap and people are buying stuff they don't want - I'm saying an easy broad-based middle is being aimed at and hit. But this also leads to almost everyone being a little or a lot dissatisfied. How many people bounce off of SFF who we never even know about because they bought something and thought it was okay (or not) and drifted off to other things? How many would have been captivated by something else if it were more widely available? How many long-time fans read less than they otherwise would or drift away themselves? And how many stay and seem to buy a lot of books and like it all enough to be engaged but wonder why things aren't better?
I mean, SFF is "growing" even today in a certain sense - there are more movies and comic-book-based TV shows and so on than ever. So maybe this is all to the good. But they seem to almost all be a certain kind of thing and maybe it's just hollow and will evaporate tomorrow after raking in the billions today.
If there is an unmet market for short, self-contained SF novels, we need some kind of explanation why someone hasn't stepped up to address that demand and make money.
That's in everything I said in the last post and this one: a publisher has no interest in satisfying a relatively niche demand (per book, not in terms of the audience as a whole) to make a little money - they want to make a lot of money easily. They want a prefab product that is guaranteed to sell, that's predictable, or can be turned into such a thing. Insofar as they're looking for anything "new," they're looking for the next Big thing, not the next Good thing. The next thing to make old. There
are publishers who step up and make some money - the small presses. Who make that money off people who can afford $40 hardcovers vs. $8 paperbacks. But, while some of these things may win awards, they don't really shape the genre or create large numbers of happy fans.
I mean, sure, this thesis may be all wrong, but I'm not saying "people are buying stuff they don't want" and "publishers are refusing to make money." That wouldn't even be worth advancing theoretically.
But there may be a point where this is wrong and you're right: maybe there isn't much of a demand for short self-contained novels. First the stories go away, replaced by novels. Then the novels go away, replaced by series. Then the series that ever end or whose components are even short are replaced by a never-ending stream of 1000 page segments. Maybe that is truly popular and what people want as their first and only choice rather than as something tolerable enough that they'll settle for. But then it seems to me to be a kind of laziness - an unwillingness to engage with new characters, new worlds, new situations and just gliding through the thousands of pages on autopilot with nothing but comforting familiarity.
I'd hope the morally, aesthetically vacuous corporation playing its semi-conscious, semi-determined part in the rise and fall of a genre was the true explanation if given a choice between those two alternatives. But there are many other possibilities. Who knows?