We have a problem with empty sitemap. In web.config we have <sitemap enable="true" includeProducts="false" enableCache="true" />
We use url prefix and I think that might be related, the local url for the site is http://site.localhost/se
Not sure if robots and sitemap should be below /se or not, but this is what I tried:
The robots.txt should always be in the root folder so the url for that should always be /robots.txt and that will match the domain name with the one that is created in the globalization.
The sitemap-record that will be included in robots.txt file will point to /sitemap.axd and when browsing the /sitemap.axd file it should include all pages for the websites for all the channels that is connected to the same domain name.
/se/robots.txt and /se/sitemap.axd should return in 404 responses.
Domain name need to match the domain name that is created in the globalization area. If they not match no channels will be found and then no items. Also ensure that the pages in the website is accessible by the Everyone user.
I’m not sure what you mean with “Domain name need to match the domain name that is created in the globalization area”, but I will try to explain, we have the problem on the production site: