Results 1 to 4 of 4
  1. #1
    AussieDave's Avatar
    AussieDave is offline Public Member
    Join Date
    November 2005
    Location
    from the land downunder
    Posts
    3,900
    Blog Entries
    1
    Thanks
    1,563
    Thanked 1,774 Times in 1,009 Posts

    Thumbs up Preventative site scraping/havesters GPL script located!

    Hi,

    As I'm sure most of you are aware our industry seems to be a favourite target for dubious webmaster who site scrape and basically steal content to use and claim as their own.

    Granted sites such as Copyscape offer services that monitor but that don't provide preventative measures.

    Over the last 6 month or so I've taken a keen interest in researching ways to possibly make my sites less attractive to site scrapers; which seems to be the general way in which these rogues are stealing content.

    Right now I've found a GPL php program that can be used to stop rogue bots, scrapers, harvesters and other rogues in there tracks.

    The problem is that using this on a static web site simple wont work...

    If you have php then it's not an issue, it's pretty easy to install.

    I haven't really taken a lot of time to look into this script for ways to address static (html) pages issues. However, there is nothing stopping people from renaming their static pages to php extensions and using your .htaccess files (must be using Unix box) to get this script operational.

    For those interested the URL to the script:
    http://www.homelandstupidity.us/soft...vior-download/

    I'm going to test this out over at slotsgallery.com I'll use this thread to keep a running journal on my progress.



    Cheers

    Dave
    ---
    Compliance: a code word for control

    ---
    Do the right thing, even when no one is looking. It's called integrity.
    ---

    It's your right to be treated honestly: fairness for all igaming affiliates - doch.news

  2. #2
    chalkoutline's Avatar
    chalkoutline is offline Private Member
    Join Date
    June 2002
    Location
    UK
    Posts
    5,107
    Thanks
    4
    Thanked 77 Times in 70 Posts

  3. #3
    Paolino's Avatar
    Paolino is offline Security/Membership Team
    Join Date
    October 2002
    Posts
    2,594
    Blog Entries
    1
    Thanks
    264
    Thanked 334 Times in 258 Posts

    Default

    Sounds great, thanks for posting Dave
    -----------------------------------------
    Paolo

    Online Gambling Guide - casinoimpact.com.
    I sell Cheap Web Hosting.

  4. #4
    pgaming's Avatar
    pgaming is offline Public Member
    Join Date
    July 2005
    Posts
    2,854
    Thanks
    414
    Thanked 215 Times in 164 Posts

    Thumbs up AussieDave

    Hey AussieDave I appreciate your efforts. Maybe if you agree in the New Year give me the opportunity to test it out. I have a few bots ready to go, plus some other things. I would tell you what, when, how, and why. In turn we could really see what is an effective approach to blocking bad bots.

    There already exists vast amounts of information on how to do it none seem to work.

    Greek39

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •