Bonanza
Search
Shop by Category
Women's Fashion
CATEGORIES
DEALS
TOP BRANDS
Men's Fashion
CATEGORIES
DEALS
TOP BRANDS
Home & Garden
CATEGORIES
TOP BRANDS
Health & Beauty
CATEGORIES
TOP BRANDS
Collectibles & Art
CATEGORIES
Handbags
TOP BRANDS
Jewelry
CATEGORIES
Coupons
More Categories
CATEGORIES
More Ways to Shop
More
What are web crawlers and bots?
Upvote this question 0 Downvote this question

What are web crawlers and bots? Why track them if they are not real (potential)buyers.

asked almost 12 years ago

StrappyStyles
Reputation: 21
See StrappyStyles' booth

1 Comment

StrappyStyles says: August 13, 2013

Thanks TexasTre asures,

3 Answers
Upvote this answer 3 Downvote this answer

Both are computer software programs that scan or crawl pages on the web for many purposes. Most are for indexing into search engines. Some are used for marketing purposes and to determine new trends. Google’s crawler is called Googlebot; you can read about it here.
[URL removed]
I would imagine that a webmaster would want to make sure his/her site is crawled frequently and by as many bots as possible.

answered almost 12 years ago

MyTexasTreasures
Reputation: 1244
See MyTexasTreasures' booth
Upvote this answer 2 Downvote this answer

From [URL removed] A Web crawler is an Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing. Web search engines and some other sites use Web crawling or spidering software to update their web content or indexes of others sites’ web content. Web crawlers can copy all the pages they visit for later processing by a search engine that indexes the downloaded pages so that users can search them much more quickly.

answered almost 12 years ago

irishonebac
Reputation: 238
See irishonebac's booth
Upvote this answer 0 Downvote this answer

what are crawlers? *

answered almost 12 years ago

StrappyStyles
Reputation: 21
See StrappyStyles' booth
Question Vitals

Viewed: 1933 times

Asked: almost 12 years ago

Latest response: almost 12 years ago

To Answer Brilliantly

Remember these tips:

  • Use links to other sources to support your opinions
  • Use examples where possible
  • Put yourself in the inquirers shoes: what extra info would be helpful?

Should I post a comment or an answer?

You can only post one answer, so make it count. Maybe your reply is more fitting as a comment instead?

Post an answer for:

  • Replies that directly and specifically answer the original question

Post a comment for:

  • "Thanks," "Me too," "I agree," or "Works for me" types of replies
  • When you would like the original poster to provide more details
  • When you have more to add to someone else's question or answer

See also our Roundtable FAQ.

Formatting

Community help posts follow certain formatting guidelines, which may impact the look of your post. If you're interested in tweaking the format, instructions are available here.