What do I need to do to get the ability to portal back to town?

You get Town Portal early in Act I, after retrieving Leoric's Crown (a quest on the main quest line).