Dyer-Lashof algebra and Steenrod algebra "duality"
The original paper on Koszul algebras, [Stewart Priddy, Koszul resolutions. Trans. Amer. Math. Soc. 152 (1970) 39–60], was, in essence, written to explain this example. Well almost: he was considering the Steenrod algebra and the Lambda algebra. The Dyer Lashof algebra is pretty much the Lambda algebra with some unstable side conditions.
Haynes Miller makes the connection very explicitly in [Miller, Haynes, A spectral sequence for the homology of an infinite delooping. Pacific J. Math. 79 (1978), no. 1, 139–155]. This influenced other papers of his, and also my work on the Whitehead conjecture.
An alternative delooping spectral sequence was defined in my paper [The McCord model for the tensor product of a space and a commutative ring spectrum. Categorical decomposition techniques in algebraic topology (Isle of Skye, 2001), 213–236, Progr. Math., 215, Birkhäuser, Basel, 2004.] The geometric objects involve the Lie operad, and the associated cohomology operations lead to Steenrod operations.
Dually, a looping spectral sequence was studied here: [Kuhn, Nicholas; McCarty, Jason, The mod 2 homology of infinite loopspaces. Algebr. Geom. Topol. 13 (2013), no. 2, 687–745.] Now the geometric objects involve the commutative operad, and the associated homology operations lead to Dyer-Lashof operations.
The geometric underpinnings of this sort of situation have been studied by Arone and Ching.
So yeah, you have heard right.
This is not the duality that was asked for in the question, but it does show a way in which the Steenrod algebra structure is related to the Dyer-Lashof algebra structure. The Dyer-Lashof algebra can act both on the homology of infinite loop spaces and $E_{\infty}$ ring spectra. If I consider the latter and look at $H_*(F(X,S^0);\mathbb{F}_p)$ then this has an action of the Dyer-Lashof algebra. It also happens to be isomorphic to the cohomology of $X$ as an algebra. In fact, the action of the Dyer-Lashof algebra "is" the action of the Steenrod algebra (there is an op that needs to be thrown in).
I learned this from chapter 3 of http://www.math.uchicago.edu/~may/BOOKS/h_infty.pdf.