The charm mechanic is really interesting because it completely changes the way the game is played. With that said, I think enchanter could be an awesome character.
However, up until lvl 36 his dps isn't very good (even with an elite dagger) and doesn't have a single source of healing (mystic rune doesn't do much). I was trying too much to chain abusing charm, that double edged sword of never leaving combat might have done more harm than good.
Also, the whole armor penalty thing in general is just brutally unfair to casters, the only difference between cloth and plate is armor and in reality the stats are the important thing. This means casters will always have worse gear than their counterparts because they get to choose from a quarter of the gear pool. I'd hate to see every class being able to use only one type of armor but the current system is pretty brutal.