Pair correlation for the Riemann zeros and $(\zeta^\prime(s)/\zeta(s))^\prime$

I believe the comments of joro and Carlo Benakker right under your question is to the point. Since the zeroes close to $s$ will be the ones that contributes in the sum, the zeroes close to s must be computed first and in order to do that several values of the zeta-function must certainly be calculated and the time for each such computation (and zero) will certainly not be less than computing any other particular value of $\zeta(s)$ or $\zeta'(s)$.

As for calculating a particular value $\zeta(s)$ the recent method of Ghaith Hiary http://arxiv.org/abs/0711.5005 "Fast methods to compute the Riemann zeta function" (published in Annals of Mathematics 2011) contains the fastest method known. He shows a method that calculates the value of $\zeta(1/2+it)$ with an error term less than $|t|^{-N}$ in time $O_{\varepsilon,N}(t^{4/13+\varepsilon})$. The method of Odlyzko and Schönhage "Fast algorithms for multiple evaluations of the Riemann zeta function", doi:10.2307/2000939 is faster if sufficiently many values of $t$ needs to be calculated, i.e. it can calculate $\sqrt T$ values in the range $[T,T+\sqrt T]$ in time $O_\varepsilon(T^{1/2+\varepsilon})$.

Now, In Hiary's paper it might look like he only considers the critical line. However in fact his method works for any value in the critical strip. Indeed in part of his argument he considers just the line Re$(s)=0$, but then he writes "It is clear that the restriction $\sigma=0$ is not important and a similar conclusions can be drawn for other values of $\sigma$" (page 6, second to last paragraph in Hiary's paper). It is true that his main interest is the critical line, but the algorithm holds for any $s$ in any vertical strip such as the critical strip.

Now to calculate $\zeta'(s)$ up to error of order $t^{-N}$ it is sufficient to calculate $\zeta(s+ih)$ and $\zeta(s-ih)$ with error less than $t^{-3N/2-1/4}$ for $h=t^{-N/2-1/4}$ and consider the difference quotient $(\zeta(s+ih)-\zeta(s-ih))/h$ by also using that $\zeta'''(s) =O(\sqrt t)$ in the critical strip and some version of the mean value theorem inequality. It is simple to use finite difference quotients to calculate $\zeta^{(k)}(s)$ up to any desired degree of accuracy. Thus we can certainly use this method to calculate for example $$ \frac d {ds} \frac{\zeta'(s)}{\zeta(s)}= \frac{\zeta''(s)\zeta(s)-\zeta'(s)^2}{\zeta(s)^2} $$ by this method. This method should not be computionally wasteful.