Authors have responsibility for the path their career takes. Delegating certain tasks to a publisher does not absolve you of this responsibility; you have chosen to allow someone else to make certain marketing and artistic choices in your name, but you are still ultimately responsible for the development of your personal brand.
You are not, however, responsible for how your work is received. We do not create art. We create the opportunity for art. Meaning and content is supplied in the reading and consumption of your work; the reader brings their own expectations with them, and has a positive or negative experience based on what they do with the material you provide them. It's only through the fusion of the words you've written and the context they find in the mind of the reader that literature takes shape.
A lazy writer will use this truth to absolve themselves of responsibility. A good writer will try to shape a reader's expectations before they even read page one through the choice of title, cover art, and other marketing considerations. If you have allowed yourself to be removed from marketing considerations by way of submitting to a publisher's will (depending on contract), then you have agreed to relinquish the right to shape the way readers come to your books.
Ultimately, though, unless you are literally writing for-hire, you have the responsibility, you answer to yourself, and there's no one else to blame or praise.