ThumbView is an awesome, free (gpl) Windows software, that is part of the category Software utilities with subcategory Task Bar Start Menu & Explorer (more specifically Explorer & Shell Enhancements).