Is it possible to pan the map in QGIS composer?
If I interpret your issue correctly, you are looking for the move item content tool which is the rightmost tool button you can see in the toolbar @Joseph posted.
Location of the move item content tool in QGIS 3:
If I understand you correctly, you are looking for the pan function:
