I found some flat headed screws from Remembrance and also my little compartment box. I was able to push the hard drive up against the IDE backplane. I am still not sure it is connected. I need to boot to the BIOS to check that. I will have to boot to the BIOS to set the boot device anyways.
I did hook the server up to a monitor and started it up. The computer tried to find bootable media.
Sure enough the computer started and showed 2 GB of RAM. This means the RAM is working too. The RAM cost about 60$ from an ebay seller.