Today I was looking at what googles shows in relation to my site and I discovered something which I wasn't expecting.
Here is what my site map looks like.
?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"> <url> <loc>http://domain.com/pub</loc> <lastmod>2013-06-06</lastmod> <changefreq>weekly</changefreq> </url> </urlset>
So to get an idea at /pub I have a number of articles which are doFollow (checked that) and everyone of the articles has a canonical link in the header
<link rel="canonical" href="http://domain.com/pub/article/327" />
Now I've discovered that google indexed only the /pub directory, without following the links to the articles. I read somewhere that it is not a requirement to have every article's link in the sitemap. In my case it is user generated content so I can't be updating that on a weekly basis it has to be automated in some way.
What am I doing wrong? I need to get that content indexed.