I am curious, robot

JT

JT

Chair Wrangler
2A Bourbon Hound 2024
2A Bourbon Hound OG
Benefactor
Vendor
Life Member
Supporting Member
Multi-Factor Enabled
Joined
Mar 4, 2018
Messages
6,026
Location
Wilson NC
Rating - 100%
40   0   0
I've noted this before, and wondered about it. What are the robots? Where are they from? Why are there more robots than people? Inquiring minds want to know.

From the bottom of the "Members Online Now" side panel:

Total: 120 (members: 41, guests: 17, robots: 62)
 
JT said:
Is that ratio typical?
Click to expand...
Not sure. The robots don’t sleep, so that count might not fluctuate much. I don’t know that I’ve paid much attention to it based on time of day and/or count of others online.
 
BigWaylon said:
Not sure. The robots don’t sleep, so that count might not fluctuate much. I don’t know that I’ve paid much attention to it based on time of day and/or count of others online.
Click to expand...
Thanks for the info. We don't seem a very rich data mine, but what do I know?
 
I, for one, welcome out robotic overlords...


Sent from my iPhone using Tapatalk
 
  • Like
Reactions: JT
Bots crawl the web for search engines and other reasons. This is normal. If they didnt your searches wouldn't work very well. When i worked in a Datacenter years ago we hosted web sites, i had a call from a guy complaining that his web hits were way to low. He said he used to have thousands of people surfing his site, but now nothing. I asked him if he paid a company to pump up his web hits and he said yes. These are just bots, programs running on computers all over the world, usually infected with some malware and used for creating fake hits, nowadays Virtual machines in datacenters all over probably do it too. Anyway, he stopped paying the company and the fake web visits ended. I did a deep dive into his web server logs. The previous week all the pitiful traffic he thought he was was getting were bots. Web crawlers from Yahoo, Google, AOL, all the search engines. He had no real humans connect to his site other than myself and him the previous week. Back then our web tracking analytics software didn't know the difference in bots and people.... Now they do. There are lots of search engines and web crawlers for companies out there. Each web site is supposed to create a robot.txt file that tells bots how to search a site and also can stop bots. Legit web crawlers respect the robot.txt file but they don't all follow the rules.

robot.txt
https://moz.com/learn/seo/robotstxt
 
You must log in or register to reply here.
Back
Top Bottom