I just bought a horse that wants to kill me, how do I make friends?

Try facing it close enough you can "activate" it and holding block and tapping the interact button several times, then sheath your weapon and it should be cool.