Removing border of symbol in QGIS?

You could try: Layer properties -> Style -> Change -> And set the border color to something else.

Your another option is to use Old Symbology where you can create graduated symbols too. There are outline options available: see the screenshot.