How can I combine several individual .ico files into a single file?

You need to build a DLL that contains multiple icons as resources. That can be done from Visual Studio via these instructions. Other Windows development tools that can create a DLL should be able to do the same thing.

This could even been done with the resource compiler (rc.exe) that is included in the Windows SDK and manually creating a resource file.

Looks like this will work as well.