CDS/Cloudfront integration thoughts?

Anyone have any ideas on how to implement a Content Delivery Network system like Cloudfront?  I'm specifically thinking of the icons, which can really slow down the site if each is served individually.  However, the icon rendering seems to go through some logic and I can quite figure out how to change that (nor if I should.)  Thoughts?