Viewing DLNA servers' contents from Windows
Windows Media Player is a DLNA client, that can play music, video and display photos.
In Library mode, look at the left side of the screen, and you should see your device under "Other Libraries". You an further filter down the content, by selecting the media type, either from the tree, or at the top screen navigation (the arrow next to "Library" will drop down).
If I may suggest adirection, I have a DLink NAS that's a DLNA server and I found that it tends to disregard certain folder names (especially those containing spaces, or with long names).