Orson Wells as a director. Others might disagree. But for me he made Citizen Kane and could never live up to it afterwards. I think it dogged his career and other people's opinions for the rest of his life.
In film, I think it really hard to be a one-hit-wonder unless you really do come from left-field or are a kid and choose not to carry on.
Positive o-h-w Carrie Henn [Aliens, 1986]. Tried acting once and decided not to go on.