Only your CD-ROM,s and Hard drives connect to your IDE controllers,the floppy has it's own controller which is a little smaller then a standard IDE connector.If you need another drive there are a few options you can look into.

1.)Get a PCI IDE controller card-they are pretty cheap now a days and allow you to connect 4 additional IDE devices i currently use one in my PC works like a charm.
2.)Get a PCI Sata controller card-if you want to move towards the newer Sata hard drives.
3.)Get an external USB hard drive enclosure-Probally the easiest option of the 3 if you already have a spare hard drive.