Here are just a few fixes for anyone receiving unwanted duplicates in their MS Outlook

http://support.microsoft.com/kb/885870/en-us

http://support.microsoft.com/kb/314578/en-us

http://support.microsoft.com/kb/321174/en-us

There are many more at support.microsoft.com and you can also do a google search for "duplicate outlook email"