+ Reply to Thread
Results 1 to 3 of 3

Thread: Restrict crawlers

  1. #1
    Client pdunton's Avatar
    Join Date
    Apr 2006
    Location
    Tucson, Arizona
    Posts
    557
    Squirrelcart version
    v3.4.1

    Question Restrict crawlers

    I am offering free pdf manuscripts for my customers via the Squirrelcart Download module.
    Some of these documents are quite large.

    I am seeing LOTS of downloads that appear to be crawlers like Googlebot that are downloading the docs "Not Logged In."

    This is using a lot of bandwidth. I have searched for a setting or Rule I can use to block downloads "Not Logged In" but haven't found one that I recognize.

    Is there something I can do besides blocking the crawlers at the OS level? I obviously don't want to block Google completely (or any other indexing service for that matter.)

  2. #2
    Squirrelcart Staff Jamie's Avatar
    Join Date
    May 2002
    Posts
    6,829
    Squirrelcart version
    v3.3.7
    You can control when a download is available via rulesets, at either the Download Section or Download record level. The easiest way is to add a rule of type "Customer" to the download section that checks to make sure the username isn't blank.
    example.png

  3. #3
    Client pdunton's Avatar
    Join Date
    Apr 2006
    Location
    Tucson, Arizona
    Posts
    557
    Squirrelcart version
    v3.4.1

    Got It!

    Thanks Jamie.
    I see I really need to spend some quality time with the Rules Sets.

    Logged 64 "Not Logged In" downloads, not good.

    Should stop now.

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

     

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts