This question already has an answer here:
I have the following situation: I had a blog (made using Joomla) that in some month was pretty indexed by Google.
For some technical problem I have delete it and I have newly created using WordPress (so it is a different site, only the URL it is the same) and I have reinserted manually all the articles.
Looking at my statistics I can see that there are many visitors that try to visit the old page (that now don't exist in the new site that have a different structure)
The problems are the following one: it seems to me that Google Bot try to visit only the old pages (that don't exist) but it is ignoring the new pages of the new site (consequently not the indexes)
Some day ago, I find that I have enabled the settings to deter search engines to index your site so I have change it and now, in theory, Google have to visit these pages and index it...
Why this is not happening? How can I solve it?
The URL of my site is: http://www.scorejava.com/
and this is my robots.txt content:
# If the Joomla site is installed within a folder such as at # e.g. www.example.com/joomla/ the robots.txt file MUST be # moved to the site root at e.g. www.example.com/robots.txt # AND the joomla folder name MUST be prefixed to the disallowed # path, e.g. the Disallow rule for the /administrator/ folder # MUST be changed to read Disallow: /joomla/administrator/ # # For more information about the robots.txt standard, see: # http://www.robotstxt.org/orig.html # # For syntax checking, see: # http://www.sxw.org.uk/computing/robots/check.html User-agent: * Disallow: /administrator/ Disallow: /cache/ Disallow: /cli/ Disallow: /components/ Disallow: /images/ Disallow: /includes/ Disallow: /installation/ Disallow: /language/ Disallow: /libraries/ Disallow: /logs/ Disallow: /media/ Disallow: /modules/ Disallow: /plugins/ Disallow: /templates/ Disallow: /tmp/
The strange think is that in the robots.txt comment makes reference to Joomla and WordPress...maybe is still use the old robots.txt file of the previous website (that was in the same space)?