News:

Looking for documentation? Take a look on our wiki

Main Menu

Duplicated url and robots.txt

Started by fabioweb, June 05, 2015, 00:13:51 AM

Previous topic - Next topic

fabioweb

Hello!
I have thousand GWT urls duplicated with this scheme:

/byordering/results1-15/7.html
/byp.product_sku/dirDesc/results1-15/7.html
etc..

Could be a valid solution to block them in robots?

Disallow: /*byordering
Disallow: /*byp.product_sku

Thank you!

jjk

Should work. But did Google actually index them? You could find out by typing this into a Google search: allinurl:yoursitename byordering
Non-English Shops: Are your language files up to date?
http://virtuemart.net/community/translations

jessica_watson

Yes you can disallow the URLs, but make sure the correct URL does not become disallow and that is indexed by google.

jyoti457

Where was the robots.txt file located in the original download folder and where should it be in the file structure on the server?

PRO

these are common url variations for eccomerce sites.

I put a no-follow tag on my ordering links.

BUT! they also have a canonical tag , so i would not really worry

fabioweb

Thanks to all,
allinurl:yoursitename byproduct_name
allinurl:yoursitename byproduct_sku
etc... are all indexed!!

Where do you insert no-follow tag?

Thank you..


PRO

Quote from: fabioweb on September 07, 2015, 23:14:03 PM
Thanks to all,
allinurl:yoursitename byproduct_name
allinurl:yoursitename byproduct_sku
etc... are all indexed!!

Where do you insert no-follow tag?

Thank you..




views/category/tmpl/default.php

before this
<div class="orderby-displaynumber">


add this
<?php $this->orderByList['orderby'] = str_replace( 'href=', 'rel="nofollow" href=', $this->orderByList['orderby'] ); ?>

fabioweb

Thank you i've just made an override:
/templates/mytheme/html/com_virtuemart/category/default.php

here i've just delete this code about two monts ago..

<div class="floatleft vm-order-list">
      <?php echo $this->orderByList['orderby']; ?>
      <?php echo $this->orderByList['manufacturer']; ?>
</div>


So why are indexed..
Thank you!