You can add a dollar sign to the end of the string which means it will only match exactly that entry:
This will only block the mage file if it come straight after the root domain:
If there are any other preceding directories, you must add these o the entry. So to block the file located below:
Google offers a fetch as Googlebot option as part of Google Webmaster Tools.
Use that tool to fetch your pages from Google's servers. That will show you if it is a problem with connectivity from Google or with the Googlebot user agent as opposed to downtime of your website when nobody can reach it periodically.
The way you/Magento are doing it is correct. As long as you have breadcrumb markup Google will display the category chain in SERP. In the case of multiple categories, the chain displayed depends on which category has most relevance for the keyword. When clicking the SERP you will be taken to the direct canonical page for the item, ie domain.tdl/product-name....
Yes, regardless of how this is being added, a 301 redirect of
should solve the issue without it affecting your SEO. Make sure you get the redirect correct so that you don't end up with a circular redirection.
Note: if the same page is listed twice in Google then Google will view one as duplicate ...
I have used Screaming Frog, today in fact, and I really love that tool. You get a lot of information in quite a short amount of time. You'll get the metadata in a csv and you can manipulate it easily in Excel. Export everything and then use filters for each column to only display text/html and not images or CSS files.
I am doing that for a site migration ...
Doesn't matter what directory you run the command in, however it will save the sql dump file into the folder your currently in if using SSH to run the command. If you would like to save the file in an alternative path or should you be running it using a cron job then simply edit the last string with the full path you'd like to save the file too, i.e DBNAME &...
When you search for site:www.example.com images on Google, you're looking for pages on www.example.com that contain the word images. Try searching for site:www.example.com on Google Image Search.
I've seen 16x16 pixel icons on Google Image Search, so your image size shouldn't be a problem.
tl;dr I think your images are indexed OK, but you are simply not able to see all the images that Google has indexed.
i did search in google image search and counted the number of images. it was around only 500.
Curious, I see considerably more when performing a site: search for your real site on Google Image search.
But there are more than 500 images in ...
This is the Time to First Byte and is determined by how long it takes the application to return any information. You would need to provide more information on the system you are using for specifics but I would look first at the application setup rather than the hosting for optimisation.
For example Magento can be a very "heavy" application without some form ...
The original question asked how to 'check'. This could mean a few different things, such as what modules are installed, which are active, so on. Another thing to check would be version number, to see if there are updates out for your modules.
Many modules write their own management tools to save this hassle, but many do not- for those cases I find it ...
There is one big problem. Google never wants to index a page of search results in its own search results. Your site search pages should be blocked from Googlebot with robots.txt or you risk getting your site penalized from the Google index.
As a content manager, I understand your issue to keep your content online even if the product is no longer available because it's good for SEO (more pages, more content thus more keywords...). The mention Item no longer available is also good for customers to being noticed of unavailability of the product.
However, if there are to many pages with the ...
It seems Google wasn't able to create a title from the Danish inside your title tag, so used the contents of your H1 tag, which matches the title that Google displayed instead.
(Note that the contents of the H1 tag were edited out of this answer - see version number 1 of this answer for more details.)
You might consider supplying a title in English when ...
Google gives you that message when it finds out that many pages on your site that it had been indexing are now all blocked in robots.txt. Whether or not that message is legitimate for you depends on whether you actually want those blocked pages crawled.
I'm not specifically familiar with Magento, but the following blocked URLs seem like they might ...
Sounds like you have not taken into consideration that Google crawls sites all across the globe but primary these crawls do occur more often in .US data centers. You could override this by using a user agent detect script that allows the Googlebot regardless of its GEO location, however you should also take into note that Google doesn't view this solution as ...
...you can control the frequency of AhrefsBot visiting your site by specifying the minimum acceptable delay between two [consecutive] requests from our bot as follows (in robots.txt):
where the value of Crawl-Delay parameter is time in seconds (you can use fractional seconds too)
Google and other search engines generally value content where they are embedded and not where they are physically hosted. It's common for companies and bloggers to use content delivery networks without using their domain name i.e Amazon.com, Rackspace.co.uk and so forth. Unless you care about branding which in your examples you do not you shouldn't need to ...
It did not take two seconds to lookup the DNS in the image to posted, seems like it took about 0.65. Getting it to zero is not possible, the only way for the DNS lookup to be zero is if the client has cached it already.
If you want to increase the performance of your DNS you should look at purchasing a DNS solution from a provider with Anycast. I'm using ...
As i understand, the problem you have is (mostly) of financial art:
whether you are ready to pay more for more hardware (server/CPU/RAM) to run more sophisticated and cushy software (Magento), which will save you your time resources (installing, coding and customizing of gazillions of wordpress plugins).
it's a lot more expensive
You mean hardware ...
I received this answer from CPanel
This is not a feature that is supported in the WHM or cPanel frontend, however it is possible to change the ip address of an addon domain by manual editing.
Here is link to tutorial:
Export from command line if you have having issues with exporting from phpMyAdmin.
backup/export: # mysqldump -u root -p[root_password] [database_name] > dumpfilename.sql
restore: # mysql -u root -p[root_password] [database_name] < dumpfilename.sql
Similar question on StackOverflow
As W3dk says in the comments, a more correct robots.txt file would be:
But your biggest problem is most likely that you didn't redirect your old URLs to your new ones. You say:
There is a slight change in URL structure in my website, but I don't have problem if the old url shows '...
What I understood is that you have a Magento website on https://www.example.com and a Wordpress website on https://www.example.com/blog
You want to keep Disallow: /*? but at the same time allow the files with this pattern to be crawled in your Wordpress website under /blog
Your robots.txt should be like this
# Do not index session ID
Disallow: /*?SID= ...
Give it a bit of time, your rankings of before should come back within days (or weeks at most). The drop is likely caused by the change from HTTP to HTTPS.
However, according to the Moz plugin, your page authority is 32 with 280 links, and your domain authority is 19 with 25K links. Your PA and DA are very low for such a number of links. You probably want ...
There could be many issues. First of all without the real URLs and a lock in your Webmaster Central we could not be sure what the exact issue is. May be you have an wrong implementation of the canonical tag or other problems like, additional noindex, other indexing issues...
Beyond that small/fresh/penalized sites will be crawled less often and it actually ...
If you are looking at the auto-generated rewrites in Magento's 'URL Rewrite Management' page then all of those URL re-writes are actually necessary in order for Magento to serve your products/categories at search engine friendly URL's.