I notice this big time. When at the drag strip, I'll let the car sit with the hood up after a run or two. Once I start the car back up I look at the temps and they spike upwards to 130F+. Once I hit the strip and let the air hit it, it will usually drop to around 80-90F.
I too plan to get the intercooler as soon as it's financially wise to do so. But dammit friggin $800 for the setup. Sometimes I think I should have gone for the IC instead of the COBB Catback. Oh well, the IC will come soon enough. Oh and the fact I have the Injen Intake doesn't truly help in terms of heatsoak. It does a damned good job, but knowing what I know, people should go with the COBB or stay with stock for the best performance. (even if it is stupidly a negligible difference)