I always find it interesting and somewhat curious that those who "diss" Joseph Smith never quite get around to admitting that he was a remarkable and (many -- both Mormon and non believers feel) -- a very influential guy - in fact, one of the most influential people of the 19th Century.
While it's certainly true that he had many faults, NOBODY is a one-dimensional character, and Joseph Smith is no different; those who only see him in single, monochromatic terms, miss a great deal: He was a complicated, fascinating character.
Joseph Smith is a little like those psychological ink-blot tests: He seems to bring out of each individual, whatever is within THEM -- everyone sees whatever they WANT to see in him. Many LDS overly idealize and sentimentalize him, while knowing little of his real character or accomplishments; and many non (or ex) LDS demonize him, while making the very same mistake -- they know little of the real man, or his very real accomplishments.
in my opinion, Joseph Smith was a fascinating, flawed, and very gifted, human being. He could be gullible, impetuous, capricious, prideful, egotistical and vain. He had a tendency to let his hormones run wild and over-rule any good judgment he might have possessed; and a strange need to collect more females than any five men could ever need or want. He had frequent poor judgement in people and a tendency to make too-fast friendships with men he should have known better than to trust -- even to (briefly) prefer them over his more faithful, tried-and-true friends. He articulated many great and noble values -- until they happened to interfere with reality -- what he wanted or didn't want....
Even during his own lifetime, many of his followers admitted that he behaved and spoke less like a Prophet than a backwoodsman. Many thought his brother Hyrum seemed more like (their idea of) a "Prophet", because Joseph had a playful and animated, even child-like, spirit about him.
But it is as wrong to *demonize* a man as it is to "deify" him. Many have made the mistake of doing exactly what they seem to dislike about his followers -- focusing on the elements of his personality that are of most interest to (and prove) THEIR prejudices, and being pretty much blind to anything else.
That's just as wrong in understanding and appreciating (and i'm using that term in a very wide sense) the man.
The truth is that Smith was a very human, flawed individual -- but he could also be remarkably, even amazingly compassionate, warm, friendly, open, playful, charismatic, convincing, and deeply, profoundly spiritual and mystical.
In fact, Joseph Smith was a remarkable Mystic - and anyone who wants to be fair must view him in that light. By the reports of those who actually knew and were close to him, he frequently launched into extended visions -- some of which were simultaneously SHARED and reported by those around him. Now i s'pose that someone might call that "mass hysteria" if they absolutely cannot bring themselves to imagine that a very flawed, fallible, rough human being could possibly also have a spiritual-mystical side -- but then that's their issue, isn't it.
Maybe as a psychologist i'm able to understand and appreciate paradox and contradiction in people (and issues) a bit -- because i see it all the time, and i think it's incredibly unfair to judge a man and his entire life by a few very limited (and solely negative) issues or traits.
Do you know of any person who is either all good or all bad??? Very few really are.
One more note, just cause i think (hope) some here may be able to appreciate this point:
I believe it's a sign of maturity and wisdom to *resist* either deifying or demonizing a person. To the degree that we can do so, i think it demonstrates that we've come to some peace about our OWN very complicated Shadows and Brightness.

Blessings to all --
~Gaia