1. You are viewing our forum as a guest. For full access please Register. WindowsBBS.com is completely free, paid for by advertisers and donations.

Resolved Web Site Access Question

Discussion in 'General Internet' started by virginia, 2018/04/09.

  1. 2018/04/09
    virginia Lifetime Subscription

    virginia Geek Member Thread Starter

    Joined:
    2002/01/07
    Messages:
    1,093
    Likes Received:
    25
    I recently set up a website to host a genealogy program. I looked at the access list today and saw a number of hits from "...accessed by crawl-66-249-69-82.googlebot.com..." Is this a normal activity for a website. I'm always concerned when I hear the term "bot".

    This may not be the proper place for this question as it's not about Windows. If not, could someone straighten me out please. Thanks.
     
    virginia,
    #1
  2. 2018/04/09
    retiredlearner

    retiredlearner SuperGeek WindowsBBS Team Member

    Joined:
    2004/06/25
    Messages:
    7,157
    Likes Received:
    501
    retiredlearner,
    #2


  3. to hide this advert.

  4. 2018/04/10
    Steve R Jones

    Steve R Jones SuperGeek Staff

    Joined:
    2001/12/30
    Messages:
    12,285
    Likes Received:
    249
    Crawler bots are a good thing "IF" you want you site to be popular...aka get seen via Google searches.

    I believe there are ways to distract them by entering certain information in an INI file.
     
    Steve R Jones,
    #3
  5. 2018/04/10
    TonyT

    TonyT SuperGeek Staff

    Joined:
    2002/01/18
    Messages:
    9,068
    Likes Received:
    396
    TonyT,
    #4
  6. 2018/04/10
    virginia Lifetime Subscription

    virginia Geek Member Thread Starter

    Joined:
    2002/01/07
    Messages:
    1,093
    Likes Received:
    25
    Thanks for all the responses. Tony - Last evening I hit on the link you provided so that had pretty well eased my mind. I didn't mention that this website is hosted on "Simply Hosting" and the software package I am using is "The Next Generation". It was a fairly simple process in that the web hosting site actually loaded the software package onto the website for me so all I had to do is upload the genealogy files.

    I suppose a follow up question or questions would be:
    1) Are there any security measures I should be taking or is that something that only the hosting site can address?
    2) As I review the access files of people/programsbots that are nosing around at the site, are there any things that should be noted?
     
    virginia,
    #5
  7. 2018/04/10
    TonyT

    TonyT SuperGeek Staff

    Joined:
    2002/01/18
    Messages:
    9,068
    Likes Received:
    396
    The Web host will have its own security in place, probably on a hardware level, such as routers/managed switches/firewalls devices which prevent Denial of Service attacks, spam control, etc. Unless you have access to the server using FTP or other protocol, the host manages everything. If you do have FTP access and the host is using Apache Web server then you can use an .htaccess file to control how some bots will crawl the site. Keep in mind that "bad bots" will ignore the rules in the .htacess file anyway. Other than using a real strong password to login to your host, the host will take care of security. What's the site URL?
     
    TonyT,
    #6
  8. 2018/04/10
    virginia Lifetime Subscription

    virginia Geek Member Thread Starter

    Joined:
    2002/01/07
    Messages:
    1,093
    Likes Received:
    25
    virginia,
    #7
  9. 2018/04/10
    TonyT

    TonyT SuperGeek Staff

    Joined:
    2002/01/18
    Messages:
    9,068
    Likes Received:
    396
    Thanks, nice site.
    I see you have relatives in my hometown, Reading, Berks County, PA.
    Going there tonite as a matter of fact.
     
    TonyT,
    #8

Share This Page

  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Accept Learn More...