If you want to use baseAddressPrefixFilters in web.config, you must setup IIS (6) too. This helped me:
1/ In IIS find your site. 2/ Properties / Web site (tab) / IP address -> Advanced button 3/ Add new host header on the same port which you will use in web.config.