PC Freezes at startup, Constant beeping...

I had tried plugging something in my mothers USB port on the back of her computer. It seems as if the port either got loose once I plugged this in, Or was already loose and me plugging it in had done whatever damage it's stuck doing now. The PC constantly beeps and freezes at start up, Meaning it's not possible to get to any sort of menu, So I took a look on the mother board and the USB Ports are attached to the mother board (In a silver like container thing); This means that if it's possible to remove this (I don't know how this works) we'd lose the internet port (We do have another ethernet card to replace this if thats what it comes to). Regardless, Can anyone steer me in the direction of how to fix this, Or more so whats going on and if its fixable? (So this way I can bring it to a technission of someone I know)

Jam it back in, in the dark.

Thanks for the help everyone, But I cannot disable anything at all; It loads up and in this PC's case a "HP" Screen comes up and says "Press F8" for Bios Menu (Atleast I think it's F8) and thats when the beeping happens and it stays at this screen not allowing you to do anything.

There's nowhere I can't reach.