VirtueMart Forum

VirtueMart 2 + 3 + 4 => Security (https) / Performance / SEO, SEF, URLs => Topic started by: fabioweb on June 05, 2015, 00:13:51 AM

Title: Duplicated url and robots.txt
Post by: fabioweb on June 05, 2015, 00:13:51 AM
Hello!
I have thousand GWT urls duplicated with this scheme:

/byordering/results1-15/7.html
/byp.product_sku/dirDesc/results1-15/7.html
etc..

Could be a valid solution to block them in robots?

Disallow: /*byordering
Disallow: /*byp.product_sku

Thank you!
Title: Re: Dulicated url and robots.txt
Post by: jjk on June 05, 2015, 13:13:48 PM
Should work. But did Google actually index them? You could find out by typing this into a Google search: allinurl:yoursitename byordering
Title: Re: Dulicated url and robots.txt
Post by: jessica_watson on June 18, 2015, 12:16:38 PM
Yes you can disallow the URLs, but make sure the correct URL does not become disallow and that is indexed by google.
Title: Re: Dulicated url and robots.txt
Post by: jyoti457 on June 20, 2015, 09:13:09 AM
Where was the robots.txt file located in the original download folder and where should it be in the file structure on the server?
Title: Re: Dulicated url and robots.txt
Post by: PRO on June 20, 2015, 15:38:42 PM
these are common url variations for eccomerce sites.

I put a no-follow tag on my ordering links.

BUT! they also have a canonical tag , so i would not really worry
Title: Re: Dulicated url and robots.txt
Post by: fabioweb on September 07, 2015, 23:14:03 PM
Thanks to all,
allinurl:yoursitename byproduct_name
allinurl:yoursitename byproduct_sku
etc... are all indexed!!

Where do you insert no-follow tag?

Thank you..

Title: Re: Dulicated url and robots.txt
Post by: PRO on September 08, 2015, 18:58:08 PM
Quote from: fabioweb on September 07, 2015, 23:14:03 PM
Thanks to all,
allinurl:yoursitename byproduct_name
allinurl:yoursitename byproduct_sku
etc... are all indexed!!

Where do you insert no-follow tag?

Thank you..




views/category/tmpl/default.php

before this
<div class="orderby-displaynumber">


add this
<?php $this->orderByList['orderby'] = str_replace( 'href=', 'rel="nofollow" href=', $this->orderByList['orderby'] ); ?>
Title: Re: Dulicated url and robots.txt
Post by: fabioweb on September 08, 2015, 21:04:16 PM
Thank you i've just made an override:
/templates/mytheme/html/com_virtuemart/category/default.php

here i've just delete this code about two monts ago..

<div class="floatleft vm-order-list">
      <?php echo $this->orderByList['orderby']; ?>
      <?php echo $this->orderByList['manufacturer']; ?>
</div>


So why are indexed..
Thank you!