How to use TeX Gyre Pagella in pdflatex for arXiv

If you remove the lines you quote and add

\usepackage{mathpazo}

then you will be using a different but more or less similar Palatino clone usable in pdftex.

You could use the newpxtext and newpxmath font packages, which provide Palatino clone text and math fonts.

\documentclass{article}
\usepackage[T1]{fontenc}
\usepackage[utf8]{inputenc}
\usepackage{newpxtext,newpxmath} % Palatino clones
\usepackage{bm} % "bold math"
\begin{document}
$\alpha\beta\chi\bm{\chi}\delta\omega\sum \displaystyle\sum$
\end{document}

My suggestion for what it's worth is to use the Pagella package :

\usepackage{tgpagella} % alternative to MinionPro
\usepackage[utf8]{inputenc} 
\usepackage[T1]{fontenc}
\usepackage[centertags, intlimits, sumlimits, namelimits]{amsmath} 
\usepackage{amssymb}
\usepackage{microtype}

The result should also deal with all the math notation and greek letters.