X-Cart:Setting up robots.txt - Revision history

Mouse at 14:03, 22 July 2020

2020-07-22T14:03:36Z

Aim: /* Dynamic version (without HTML catalog) */

2020-02-13T09:03:00Z

‎Dynamic version (without HTML catalog)

Aim: /* Static version (using HTML catalog) */

2020-02-13T09:02:38Z

‎Static version (using HTML catalog)

Aim: Disallow: /printable=Y https://xcn.myjetbrains.com/youtrack/issue/XC4-148833

2019-06-10T13:57:34Z

Disallow: /*printable=Y* https://xcn.myjetbrains.com/youtrack/issue/XC4-148833

Aim: Disallow: /printable=Y removed https://xcn.myjetbrains.com/youtrack/issue/XC4-148833

2019-06-10T13:56:52Z

Disallow: /*printable=Y* removed https://xcn.myjetbrains.com/youtrack/issue/XC4-148833

Aim at 14:33, 14 November 2017

2017-11-14T14:33:59Z

Aim at 13:56, 14 November 2017

2017-11-14T13:56:23Z

Aim: Allow: .js Allow: .css Allow: .jpg Allow: .gif Allow: *.png added

2017-11-14T13:38:02Z

Allow: *.js Allow: *.css Allow: *.jpg Allow: *.gif Allow: *.png added

Dohtur at 12:29, 19 October 2017

2017-10-19T12:29:14Z

Aim: https://xcart.slack.com/archives/C04BAKZ82/p1491313586906119

2017-04-04T14:16:23Z

https://xcart.slack.com/archives/C04BAKZ82/p1491313586906119

@@ Line 11: / Line 11: @@
 {{Note|The description below is based on the default location of X-Cart files and folders. For customized stores, the configuration may vary slightly.}}
-Configuring a store to make it properly visible to search engines takes placing a special text file named [http://en.wikipedia.org/wiki/Robots.txt robots.txt] into your website's root folder. Please note that the file cannot reside in a sub-folder, such as <u>/store</u>; see https://developers.google.com/webmasters/control-crawl-index/docs/robots_txt?hl=en#file-location--range-of-validity for more info. The file can be created with any plain-text editor (like Notepad) and uploaded using an FTP client or an online file manager available at your hosting control panel. If your store is located in a sub-folder (for example, http://example.com/store/home.php), the folder /store must be specified for all the Disallow directives:
+Configuring a store to make it properly visible to search engines takes placing a special text file named [https://en.wikipedia.org/wiki/Robots.txt robots.txt] into your website's root folder. Please note that the file cannot reside in a sub-folder, such as <u>/store</u>; see https://developers.google.com/webmasters/control-crawl-index/docs/robots_txt?hl=en#file-location--range-of-validity for more info. The file can be created with any plain-text editor (like Notepad) and uploaded using an FTP client or an online file manager available at your hosting control panel. If your store is located in a sub-folder (for example, http://example.com/store/home.php), the folder /store must be specified for all the Disallow directives:
 <pre>
 Disallow: /store/admin/
@@ Line 18: / Line 18: @@
 * Dynamic store, generated on the fly from the database.
-* Static store, based on a static [http://www.x-cart.com/search.html?query=html+catalog HTML catalog].
+* Static store, based on a static [https://www.x-cart.com/search.html?query=html+catalog HTML catalog].
 Further below you will find a working example for each of the above-said cases.
@@ Line 284: / Line 284: @@
 == See also ==
-* [http://www.robotstxt.org/wc/norobots.html A Standard for Robot Exclusion]
+* [https://www.robotstxt.org/wc/norobots.html A Standard for Robot Exclusion]
-* [http://www.google.com/support/webmasters/bin/topic.py?topic=8475 Using the robots.txt analysis tool]
+* [https://www.google.com/support/webmasters/bin/topic.py?topic=8475 Using the robots.txt analysis tool]
-* [http://www.searchtools.com/robots/robots-txt.html#checkers Robots.txt Checkers]
+* [https://www.searchtools.com/robots/robots-txt.html#checkers Robots.txt Checkers]
 [[Category:X-Cart user manual]]

@@ Line 96: / Line 96: @@
 Disallow: /error_message.php
 Disallow: /featured_products.php
 Disallow: /giftcert.php
 Disallow: /get_block.php

@@ Line 247: / Line 247: @@
 Disallow: /shop_closed.html
 Disallow: /shop_registration.php
 Disallow: /slabel.php
 Disallow: /smarty.php

@@ Line 162: / Line 162: @@
 <pre>
 User-agent: Googlebot
 Disallow: /*js=*
 Disallow: /*print_cat=*

@@ Line 41: / Line 41: @@
 <pre>
 User-agent: Googlebot
 Disallow: /*js=*
 Disallow: /*print_cat=*

@@ Line 86: / Line 86: @@
 Disallow: /change_password.php
 Disallow: /check_requirements.php
 Disallow: /cleanup.php
 Disallow: /cmpi_popup.php
 Disallow: /config.php
 Disallow: /cron.php
@@ Line 94: / Line 97: @@
 Disallow: /error_message.php
 Disallow: /featured_products.php
 Disallow: /get_block.php
 Disallow: /get_info.php
 Disallow: /giftreg_manage.php
 Disallow: /https.php
 Disallow: /image.php
 Disallow: /init.php
 Disallow: /install.php
 Disallow: /magnifier_xml.php
 Disallow: /message.html
 Disallow: /order.php

@@ Line 47: / Line 47: @@
 User-agent: *
 Disallow: /admin/
 Disallow: /catalog/
@@ Line 143: / Line 148: @@
 Disallow: /amazon_checkout.php
 Disallow: /VERSION.CLOUD_SEARCH
 </pre>
@@ Line 163: / Line 162: @@
 User-agent: *
 Disallow: /admin/
 Disallow: /customer/
@@ Line 258: / Line 262: @@
 Disallow: /amazon_checkout.php
 Disallow: /VERSION.CLOUD_SEARCH
 </pre>

@@ Line 15: / Line 15: @@
 Disallow: /store/admin/
 </pre>
-The content of robots.txt can vary to meet your specific needs. For X-Cart based stores, the main differences occur in two cases:
+The content of robots.txt may vary to meet your specific needs. For X-Cart based stores, the main differences occur in two cases:
 * Dynamic store, generated on the fly from the database.
 * Static store, based on a static [http://www.x-cart.com/search.html?query=html+catalog HTML catalog].
-Here is a working example for each case.
+Further below you will find a working example for each of the above-said cases.
 == Dynamic version (without HTML catalog) ==

@@ Line 45: / Line 45: @@
 Disallow: /customer/
 Disallow: /files/
 Disallow: /include/
 Disallow: /mail/
@@ Line 155: / Line 154: @@
 Disallow: /customer/
 Disallow: /files/
 Disallow: /include/
 Disallow: /mail/