Can I get my stuff back from a follower after he has left my service?

The cleanest way to get your equipment back is to complete the current quest. Nobody dies, gets a bounty or tries to kill you. You're in a very unusual situation, possibly the only such situation in the game where an NPC who could be a follower temporarily has the follower tag removed as part of a quest.