Icons for PDF files in Windows Explorer

I'm a bit puzzled as to why I sometimes see a nice icon for a PDF file in Explorer which shows me a miniature first page of my document. This is incredibly useful. Some applications which produce a pdf file seem to do this and others do not. For instance if I use Microsoft Office to create the file I do not get the picture, just the standard PDF twirl symbol which is the same for every file....