The fact that the drum was very hard to remove isn't very out of the ordinary, they are quite often very hard to remove. Even without the key the drum was probably not spinning if the tapers were dry and the drum was well seated. As for the non turning drive shaft, you never mentioned if the opposite half shaft was rotating at the same time. Unless the other shaft is restrained, the drive shaft won't rotate, spinning one side will just cause the other side to spin in the opposite direction.