Crawler software belonging to the Google search engine which, a bit like a spider, goes around all the various accessible web pages and explores them to view, classify, and compile their content in its index. Googlebot does not just have the capacity to crawl and index websites, it can also extract information from other kinds of files (PDF, XLS, DOC…).
The crawling process it employs is algorithmic: software programs define which websites need to be crawled and the frequency and number of pages to be explored at each one. There are two versions of the Google robot, DeepBot and FreshBot.
Other internet
related terms
A
- Above the fold →
- Aggregator →
- Alexa →
- Algorithm →
- Alt attribute →
- AMP (Accelerated Mobile Pages) →
- Anchor text →
- Anonymous FTP →
- Anti-spam and antivirus filter →
- Apache →
- API →
- App →
- App invasion →
- ARIA →
- Artificial intelligence →
- ASO →
- Atom →
- Auto-responders →
- Avatar →
B
- B2B e-commerce →
- Back-end →
- Back-end web development →
- Baidu →
- Bitcoin →
- Blockchain →
- Blog →
- Blogger →
- Blogosphere →
- Blogroll →
- Bluetooth →
- Bookmarklet →
- Bootcamp →
- Botnet →
- Breadcrumbs →
- Breakpoint →
- Brick and mortar →
- Broken link →
- Browser →
C
- Cache →
- Captcha →
- Catch-all →
- Chief Information Security Officer →
- Click and mortar →
- Clickbait →
- Cloud computing →
- Clustering →
- CMS →
- Collaborative economy →
- Compulsory fields →
- Container →
- Conversion form →
- Cookies →
- Copyleft →
- Copyright →
- Copywriter →
- Corporate website →
- Creative Commons →
- Crowdfunding →
- CSS →
- Customer Data Platforms →
- Customer experience →
- Cyber security →
- Cybermule →
- Cybersquatting →
D
- Darknet →
- Data center →
- Dedicated server →
- Deep web →
- Digitalization →
- Direct traffic →
- Disk space →
- Domain →
- Dot-com →
- Dot-com bubble →
- Drone →
- Drop shipping →
- Drupal →
- Duplicated content →
E
F
- Facebook →
- Facebook Live →
- FAQ →
- Favicon →
- Favourites →
- Footer →
- Free software →
- Front-end web development →
- FTP →
G
- Google →
- Google Alerts →
- Google Earth →
- Google Maps →
- Google My Business →
- Google Plus →
- Google review →
- Google Sitemaps →
- Google Street View →
- Google Translate →
- Googlebot →
H
- H1 →
- Happy path →
- Hashtag →
- Hater →
- Hick's Law →
- Hoax →
- Hosting →
- Housing →
- HTML →
- HTML5 →
- HTTP →
- HTTP header →
- HTTP/2 →
- Hyperlink →
I
- ICT →
- Infinite scroll →
- Infographics →
- Infoxication →
- Instagram →
- Insurtech →
- Intranet →
- IoT →
- IP address →
J
j
K
- Keyline →
- Keylogger →
- Keyword prominence →
- Keyword proximity →
- Killer app →
- KISS →
- Knowledge representation →
L
M
- M2M →
- Magento →
- Mailing list →
- Mashup →
- Meme →
- Menéame →
- Menéame effect →
- Meta description →
- Meta refresh →
- Metatag →
- Microblog →
- Microsite →
- Moore's Law →
- Multi-agent system →
- MySQL database →
N
O
P
- P2P →
- PaaS →
- Pagejacking →
- Panda →
- Pay per view →
- Paypal →
- PDF →
- Periscope →
- Permalink →
- Pervasive computing →
- Phishing →
- Ping →
- Pingback →
- Pinterest →
- Pixel →
- Plugin →
- Podcast →
- Points or 'pts' →
- POP3 →
- Portal →
- Post →
- Prestashop →
- Privacy Policy →
- Proprietary software →
- Pure play →
Q
R
S
s
S
- Search engine →
- Semantic web →
- SEO copywriter →
- Server →
- Session →
- Shared server →
- Shopbot →
- Shopping cart →
- Siri →
- Site tree →
- Sitemap →
- Smartphone →
- Smishing →
- SMTP →
- Snapchat →
- Social networks →
- Spam →
- Splinternet →
- SSL →
- Stakeholder →
- Startup →
- Streaming →
- Structured data →
- Style sheet →
- Subdomain →
- Syndication →
T
- Technorati →
- Thank you page →
- Time on page →
- Token →
- Tools for webmasters →
- Trackback →
- Traffic Manager →
- Traffic sources →
- Trending topic →
- Troll →
- Tumblr →
- Tweet →
- Twitter →
- Twitter Ads →
- Twitter Media Studio →
- Typosquatting →
U
- Unique Selling Proposition →
- Unique visitor →
- Up-time →
- URL →
- Usability →
- User experience →
- User flow →
- User interface →
V
W
- W3C →
- WAP →
- WapMail →
- Wearable →
- Web 2.0 →
- Web copywriter →
- Web crawler →
- Webinar →
- WebMail →
- Webmaster →
- Whois →
- Widget →
- Wiki →
- Woocommerce →
- WordPress →
- WPO (Web Performance Optimization) →
- Wysiwyg →
X
Y