If you get this while doing non intensive windows tasks, I would first contact the manufacturer about the problem.  It's not uncommon for a laptop to have had a silent recall on warranty work for this type of issue.

1-800-HP-INVENT

If this were an older laptop, I would do a complete teardown of the unit to reseat/regrease the CPU and ensure that there isn't any blockage at the cooling vents/fan.  Excessive dirt often cannot be cleaned out just using canned air.  This is NOT recommended for the home novice.

paste might help, BUT if the comp is in a dusty environment then definitely try a clean of the heat exchanger, the worst that can happen is no improvement unless you do a dis-assemble of the comp, then the worst is no work, and the best is a decrease of operating temps, and I also think that the temps are a BIT high for a lappie, and my guess for the palm rest heat would be the hard drive.

harpo

Those are normal temps.  Idle temps around 50-60C are decent operating conditions.  Put it under load and see how it does.

Typically, the working temp range on Intel chipsets ends at 100C(at which temperatures, cpu's should last a decade plus).  If you're busting 200F in an air conditioned environment with the laptop positioned for full ventilation access, it's time to do some corrective work and clean that sucker out.  180F under load is a pretty typical result for a laptop.  That said, four tabs in chrome and a music player doesn't seem like it should count as under load.  I call that idle.

You may have other problems, spyware, etcetera.  Your system is about a third the speed of mine, but that should still be pretty damn near idle.  I've got a lot more than that running right now and I'm running at 0-3% on the cpu front.

From my experience all HP laptops do this when the cpu is loaded. I went through 3 different models of HP laptops all with the same heat problem. My last one the fan would run constantly and programs would run real slow. It would get so hot it would shut down I couldn't start it up again until it cooled down. Recently I bought a Toshiba Satellite it is so quite and after hours of use it's still cool to the touch.

I know this doesn't help but always using HP laptops to me it seems like a common thing.

Why not write to support at HP...or maybe they have something in their Forums? 

On the lighter side, until you have an answer...

I previously had a HP laptop i3 340m also, same heating problem would run ~100ºC in a normal room conditions. It's not uncommon so if you're still under warranty get something done about it. Otherwise as others suggested making sure fans/ducts are clear of dust. I wouldn't reapply any new paste. Also invest in a good laptop cooling pad. I would recommend the coolermaster u3. I bought this for £25 earlier this year and saw dramatic drops in temperature of around 10ºC which was a pretty big improvement compared to several others I bought prior and managing only a few degrees drop in temperature. I like the fact you can relocate each fan on the cooling pad rather than having it be static it allows to reposition each fan for optimal cooling.

You know I was looking for some serious help. Guess I should have known better. 

A loose port could mean bad casing design, poor quality of manufacture, or just that it isn't seated/secured properly inside the casing.  Repeatedly using it could break something, might not, but if it is under warranty you should get it looked at.

Something that I'm not sure has been mentioned yet, laptops usually come with software which optimises your power usage and temperature control.  It could be worth looking at this to see if you're running the optimised plan, which should help keep it cool without unnecessarily draining your battery, or keep it cool actively with the fan when you're using AC power.

A Damaged USB Port can be resolved in a number of ways, but it comes down to how that USB port was designed into the unit.

Answers
1. USB is Soldered and part of the system board; Replace the system board.  Not Cheap or Easy (for non-techie)
2. USB is on a daughter board (smaller circuit board that is separate from the system board.  Cheap, but requires disassembling the laptop
3. Damaged USB Port is just one of many USB ports available.  Cover with Electrical Tape so it doesn't get used.  Cheap and Easy.