This is a rant, not at individuals, but the industry. Apologies in advance.
It is beginning to look as if you first need to be an expert in the industry, then become technically competent, then come up with a brilliant novel idea.
I fear I have done things the other way around and do not have enough lifetime left to achieve the rest. I had this strange idea that the story was the important part and the rest was just the practicalities. That is how it is in the business world, but obviously not in author-land.
In business you come up with a brilliant idea, raise the finance (the easy part) then put it into production. The idea is the key, the concept is the important part of the business.
I must admit that I thought it was the editor's job to turn a less than perfectly expressed idea into a saleable novel, now it seems I have to do it all. The editor will judge how well I have learned the technicalities and gives not a damn for the idea, concept or story.
Everything I have seen and read in SFFC seems to be telling me I need to become technically perfect and the story is actually unimportant. Come to think of it - that is exactly what the books I see in shops today offer. Beautifully written, technically perfect drivel. The number of SF books I have got half way through is a great sadness and reflection on the publishing industry.
Obviously there are exceptions, but becoming one of those seems to depend more upon luck than any skill or technical expertise.
Thank you all for your help and advice, but it sounds to me as if I am better just writing for fun.
I will try to address some of the observational concerns based upon my limited experience.
For almost four years I worked as an editor for a small SF/Fantasy magazine/ezine (the magazine shut down about 7 years ago). We only paid 1/2 penny per word. Despite this, we had a constant stream of submissions. We averaged about 8 or 9 added to the queue each day (weekends and Mondays were particularly heavy), and published we around stories 75 per year. I mainly read slush, providing comments on those I okayed/passed up the line for further consideration.
Yes, a quality story was vital. One wouldn't get published without it no matter how perfect the grammar, punctuation and formatting was. That said, if the story idea was great, but the writing was a wreck, meaning there would be a lot of editorial work to get it ready, that was a mark against it. We had far more stories sent to us than we could ever hope to publish. While many were not of sufficient quality, we still had far more quality works that would appeal to our readership than we could publish. Given that, if two stories under final consideration were of equal quality and length and other factors, but one would require far more editorial work to prepare it for publishing, the choice was easy to make. If one would take two or three times the editorial work (meaning more hours of time spent), and more communications with the author, for clarification or similar concerns...the choice between the two was easy.
An author that followed the submission guidelines suggested that they might be easier to work with (never 100% correlation), and while the quality of the story was more important, personally opening one that was oddly formatted and I had to fix up prior to reading left me in a less open minded frame of mind (fair or not) for that story, especially if there were two dozen more awaiting my attention, and knowing that there would be more in the next few days.
We would get stories sent to us that weren't even close to fitting our market/readership, just shotgunned to us apparently, or far past our word count limit, or a host of other items that didn't make what was sent a good fit. Either the authors didn't bother to take the time to look into our needs, or they know what was expected of them as an author submitting work.
I think there is a luck factor involved. For example, I've spoken with editors at Tor and Baen, and others, and served on panels with them at conventions. Sometimes they pass on a quality manuscript because there isn't room in the publishing schedule for it, or they have one already contracted that is too similar, or whatever. But if you produce a quality story idea, and write it/relay it in the best fashion you're able, I think you set yourself up for the luck to possibly benefit you.