Results 1 to 5 of 5

Thread: What are Spiders, Robots and Crawlers and what are their functions?

  1. #1
    Junior Member
    Join Date
    Feb 2017
    Location
    East Patel Nagar
    Posts
    19
    Thanks
    0
    Thanked 0 Times in 0 Posts

    What are Spiders, Robots and Crawlers and what are their functions?

    What are Spiders, Robots and Crawlers and what are their functions?

  2. #2
    Member
    Join Date
    Mar 2017
    Posts
    39
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Spider , Crawler , or Bot are all terms used to describe a tool ( software ) to crawl for search engines - Search Engine , collectively called Web Crawler . This software is designed to be able to browse websites on the World Wide Web a systematic way , with the purpose of collecting information on those sites for search engines ( crawl data ) , aims to save indexing those sites to the database of Search engine. At the same time , help the search engines that offer the most accurate assessment of data collection website .

  3. #3
    Junior Member
    Join Date
    Sep 2016
    Location
    Mexico
    Posts
    11
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Spiders, Robots and Crawlers all are same these are software programme search engine use to stay up to date with web activities and finding new links and information to index in their database. Search engines created some automated programmes to keep their database updated which goes from site to site and find the new data for search engine also collects the information about the web page what is the page all about.

  4. #4
    Member
    Join Date
    Apr 2013
    Posts
    99
    Thanks
    0
    Thanked 0 Times in 0 Posts
    -Spiders create a text-based summary of content and an address (URL) for each webpage.
    -Crawler is a program that automatically follows all of the links on each web page.
    -Robots is An automated computer program that visit websites & perform predefined task.

  5. #5
    Senior Member RH-Calvin's Avatar
    Join Date
    Apr 2015
    Location
    Forum
    Posts
    303
    Thanks
    0
    Thanked 1 Time in 1 Post
    They are all the same with different names. They are search engine automated programs that are responsible to read through webpage source and provide information to search engines.
    Cheap VPS | $1 VPS Hosting
    Cheap Windows VPS | Remote Desktop Access
    Cheap Dedicated Server | Free Setup and IPMI

Similar Threads

  1. Reusable Functions
    By beingchinmay in forum Web Programming
    Replies: 0
    Last Post: 02-25-2017, 08:13 AM
  2. How do you link a C++ program to C functions?
    By beingchinmay in forum Internet Marketing Discussions
    Replies: 0
    Last Post: 01-23-2017, 11:01 AM
  3. What is the difference between Spiders, Robots and Crawlers?
    By Patelsharp in forum Off Page / On Page SEO
    Replies: 4
    Last Post: 09-30-2016, 05:56 AM
  4. How do you link a C++ program to C functions?
    By beingchinmay in forum Web Programming
    Replies: 0
    Last Post: 02-13-2016, 08:40 AM
  5. [WSO] – My Secret Web For Catching Google Spiders
    By manish in forum Freebie downloads
    Replies: 0
    Last Post: 07-01-2013, 10:55 AM

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •