Tagged Questions
2
votes
1answer
29 views
what should be my initial address for sitemap and robots.txt if I'm using redirection
What should be my initial adress when using this site: http://www.xml-sitemaps.com?
I have a folder inside my root where I have all my files.
For example I have domain.com and my start directory is ...
2
votes
2answers
205 views
Network unreachable: robots.txt unreachable
I am trying to add a valid sitemap to Google Webmaster. Yet, it says:
Network unreachable: robots.txt unreachableWe were unable to crawl
your Sitemap because we found a robots.txt file at ...
3
votes
3answers
110 views
SEO consideration for duplicate sites
I am building a brochure-ware website for a company that sells products all across the world. They need the site to ask the user what region they are in before using the site; there are 5 regions. ...
3
votes
1answer
87 views
Handling SEO for Infinite pages that cause external slow API calls
I have an 'infinite' amount of pages in my site which rely on an external API. Generating each page takes time (1 minute). Links in the site point to such pages, and when a users clicks them they are ...
0
votes
1answer
245 views
How to secure robots.txt file?
I would like for User-agents to index my relative pages only without accessing any directory on my server.
As initial thought, i had this version in mind:
User-agent: *
Disallow: */*
Sitemap: ...
5
votes
1answer
333 views
Do I reference all my *.xml.gz sitemap files in robots.txt
I have a website with over 1 million url's. As such, I have 1 sitemap.xml file which acts as an index to many sitemap0000.xml.gz, sitemap0001.xml.gz ... sitemap0030.xml.gz etc. files.
My question is: ...
0
votes
2answers
1k views
How to control what appears on google search results?
So I have just built a site and all is well... but I want to control what appears on google search results.
Lets say I google for "thefwa", first what comes is the link to www.thefwa.com, then ...
3
votes
1answer
365 views
Can a sitemap index contain other sitemap indexes?
I have a bi-lingual website with a sitemap index for each language that links to several different sitemaps (one for videos, one for static content, and one for articles). I would like to introduce ...
