1. Open Windows Live Mail, go to Tools > Accounts...

2. Choose your email account and then click on "Properties"

3. Click on the "Advance" tab

4. Then check on "Leave a copy of message on server"

5. Then click on the Save button

NOTE: If you would like to remove the mail after several days, you can check on "Remove from server after ? day(s)"