The Adventures of "Google [Bot]" and this Forum -off topic-

Discuss the translation of Eien no Aselia - Kono Daichi no Hate de.
Post Reply
myrtas
Posts: 38
Joined: Tue Mar 30, 2010 5:32 am

The Adventures of "Google [Bot]" and this Forum -off topic-

Post by myrtas » Sun Apr 04, 2010 7:13 am

Whats up with Google [Bot] and this forum ?? Ive been seeing it hanging around here a lot lately :o

Is this normal for a forum or what ? See pictures below

1st ofApril
Image
Eariler today
Image
Not to mention on and off several more times today ... Excuse my end of day ramblings :|
Image

teiglin
Posts: 25
Joined: Sat Jan 03, 2009 2:19 pm

Re: The Adventures of "Google [Bot]" and this Forum -off top

Post by teiglin » Sun Apr 04, 2010 7:35 pm

It means that one of Google's webcrawlers has visited the forum recently. Basically they index pages, and follow links from those pages to index more pages. That's how Google gathers the information it uses for search results. I guess it's just displayed to distinguish such bots from actual guest users?

myrtas
Posts: 38
Joined: Tue Mar 30, 2010 5:32 am

Re: The Adventures of "Google [Bot]" and this Forum -off top

Post by myrtas » Mon Apr 05, 2010 4:24 am

I see their crawler accessing this forum atleast twice a day. Are you telling me that google has enough resources to crawl the world wide web with its billions of websites and mine its data on a daily basis??? Seriously, they can do that ? Or are they priotizing US based servers ?
Image

RexRox
Posts: 10
Joined: Fri Apr 02, 2010 12:22 pm

Re: The Adventures of "Google [Bot]" and this Forum -off top

Post by RexRox » Mon Apr 05, 2010 5:24 am

This is Google, they often have recent 4chan threads on their search engine (though they never cache for legal reasons). They're the gods of search.

teiglin
Posts: 25
Joined: Sat Jan 03, 2009 2:19 pm

Re: The Adventures of "Google [Bot]" and this Forum -off top

Post by teiglin » Mon Apr 05, 2010 8:14 pm

There are heuristics for webpages that get updated more often (among other things) to keep their search up to date, so since this forum has high activity now it will get scanned more often. I don't have any hard data for you on total google web activity, but I suspect you'd be surprised at the amount of resources they spend on it.

Atvaark
Posts: 1
Joined: Mon May 31, 2010 7:55 pm

Re: The Adventures of "Google [Bot]" and this Forum -off top

Post by Atvaark » Mon May 31, 2010 7:57 pm

google bot is often accompanied by his trusty friend Yahoo bot as well. i'm sure there's more bots around, but it's not like they're doing any harm. it's probably because of them that i even discovered Eien no Aselia in the first place...

Ghaleon
Posts: 92
Joined: Sat May 15, 2010 7:08 pm

Re: The Adventures of "Google [Bot]" and this Forum -off top

Post by Ghaleon » Tue Jun 01, 2010 12:36 am

I've seen it a few times here as well, and never anywhere else. So I'm hesitant to believe that we coincidently saw it here like that. Maybe other sites don't even list it at all?

Post Reply