Convert Wireless ADSL Modem Router into a Wireless Access Point, possible?

Yes. Simply disable NAT and DHCP service. You want it to be just a bridge, with wireless AP mode on.

Use one of the LAN Ethernet ports to connect it into your home LAN (e.g. into a LAN port of your upstream router).