Hmmm... nice lists, but I wouldn't quite agree with either entirely. "The Hound", for instance, suffers from being overwritten, more than slightly over the top, quite likely intentionally, judging from the origins of the story as well as certain things included in the text. Fun, but by no means his best. "The Evil Clergyman" isn't actually a story -- hence its rather rough form -- but rather is taken from a letter of Lovecraft's and published as a new piece of fiction by him following his death. "The Temple" tends to be rather turgid at times, and the plethora of supernatural events don't tie together at all well, which makes it much less successful as a whole. However, each of these has its proponents, and you may be one who would greatly enjoy them, so....
My suggestion would be simply to pick up the Barnes & Noble
H. P. Lovecraft: The Complete Fiction, which collects together all his original* fiction. It is a very affordable book, and also one of the most textually sound, eliminating long-standing errors in most editions of Lovecraft, as well as replacing portions of text (sometimes quite substantial) which have, inadvertently or intentionally, been excised from his work over the years. Be sure, however, to get the printings of 1911 and after, as earlier printings suffered from an unbelievable number of typos. Below is a link which will take you to the edition I mean:
http://www.barnesandnoble.com/w/bar...lassics-hp-lovecraft-h-p-lovecraft/1106658815
My own list of his best would include:
At the Mountains of Madness
"The Colour Out of Space"
The Case of Charles Dexter Ward
"The Shadow Out of Time"
"The Shadow Over Innsmouth"
"The Call of Cthulhu"
"The Music of Erich Zann"
"Polaris"
"The Strange High House in the Mist"
"The Whisperer in Darkness"
though I have several others which are also among my favorites....
*that is, neither his few collaborative works nor those he ghost-wrote or revised for others