{"id":30786,"date":"2022-04-26T11:37:00","date_gmt":"2022-04-26T09:37:00","guid":{"rendered":"https:\/\/perseus.de\/webcrawler\/"},"modified":"2026-09-01T15:29:42","modified_gmt":"2026-09-01T13:29:42","slug":"webcrawler","status":"publish","type":"post","link":"https:\/\/perseus.de\/nl\/webcrawler\/","title":{"rendered":"Webcrawler"},"content":{"rendered":"\t\t
\n\t\t\t\t
\n\t\t\t\t\t
\n\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Webcrawler<\/h1>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t
\n\t\t\t\t\t
\n\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Webcrawler betekent “crawler door het internet”. Webcrawlers zijn computerprogramma’s die onafhankelijk het internet doorzoeken en websites analyseren.<\/p>

<\/h4>

Wat betekent webcrawler in detail?<\/h4>

Webcrawlers zijn bots<\/a> \u2013 computerprogramma’s die automatisch en onafhankelijk bepaalde taken uitvoeren. De figuurlijke term “web crawler” is afgeleid van de manier waarop deze bots werken. Ze “crawlen” van link naar link via het internet. Zo komen ze van website naar website. Zoekmachines gebruiken webcrawlers om websites te analyseren en aan hun directory toe te voegen. Elke zoekmachine gebruikt zijn eigen webcrawlers. Je bedrijfswebsite wordt bezocht door Googlebot, Bingbot en de webcrawlers van andere zoekmachines.<\/p>

Webcrawlers kunnen worden gebruikt om automatisch gegevens van websites te verzamelen en te analyseren. Daarom worden ze bijvoorbeeld ook gebruikt voor prijsvergelijkingswebsites om de laagste prijzen voor bepaalde producten te vinden.
Maar webcrawlers worden ook gebruikt voor dubieuze of illegale doeleinden. Bijvoorbeeld om automatisch e-mailadressen te verzamelen , waarnaar<\/a> spam wordt gestuurd.<\/p>

<\/h4>

Waar kom ik het onderwerp “webcrawlers” tegen in mijn dagelijkse werk?<\/h4>

Indirect kom je het elke keer tegen wanneer je een zoekmachine gebruikt. De zoekresultaten zijn het resultaat van het werk van de webcrawlers. Ongebruikelijke e-mailadresinformatie op websites zoals “info(at)unternehmen(dot)com” komt ook door webcrawlers. Dit formaat is bedoeld om het e-mailadres onleesbaar te maken voor dubieuze webcrawlers. Echter, e-mailadressen die op deze manier worden opgegeven zijn niet langer toegankelijk en kunnen ze niet meer worden gebruikt, bijvoorbeeld voor mensen met ernstig verminderd zicht. Bovendien zijn veel dubieuze webcrawlers nu geprogrammeerd om dergelijke alternatieve spellingen te herkennen.<\/p>

<\/h4>

Wat kan ik doen om mijn beveiliging te verbeteren?<\/h4>

Bescherm e-mailadressen die toegankelijk zijn op je bedrijfswebsite tegen dubieuze webcrawlers. Er zijn verschillende manieren om dit te doen. Twee voorbeelden:<\/p>

  • Vervang e-mailadressen door contactformulieren. Contactformulieren zijn niet bruikbaar voor bots, maar ze kunnen ontworpen worden om toegankelijk te zijn voor mensen.<\/li>
  • Vervang e-mailadressen door een doorverwijzing via HTTP-omleiding. Dit maakt het e-mailadres toegankelijk via een omweg die voor bots onbegrijpelijk is. Neem contact op met je IT-afdeling om je website te identificeren en te implementeren met behulp van best practices.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t
    \n\t\t\t\t\t
    \n\t\t\t\t
    \n\t\t\t\t
    \n\t\t\t\t\t\t\t
    \n\t\t\t\n\t\t\t\t\t\t<\/span>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"

    Webcrawler Webcrawler betekent “crawler door het internet”. Webcrawlers zijn computerprogramma’s die onafhankelijk het internet doorzoeken en websites analyseren. Wat betekent webcrawler in detail? Webcrawlers zijn bots \u2013 computerprogramma’s die automatisch en onafhankelijk bepaalde taken uitvoeren. De figuurlijke term “web crawler” is afgeleid van de manier waarop deze bots werken. Ze “crawlen” van link naar link […]<\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[80],"tags":[],"class_list":["post-30786","post","type-post","status-publish","format-standard","hentry","category-cyber-lexicon"],"acf":[],"yoast_head":"\nWebcrawler - Perseus Technologies<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/perseus.de\/nl\/webcrawler\/\" \/>\n<meta property=\"og:locale\" content=\"nl_NL\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Webcrawler - Perseus Technologies\" \/>\n<meta property=\"og:description\" content=\"Webcrawler Webcrawler betekent “crawler door het internet”. Webcrawlers zijn computerprogramma’s die onafhankelijk het internet doorzoeken en websites analyseren. Wat betekent webcrawler in detail? Webcrawlers zijn bots \u2013 computerprogramma’s die automatisch en onafhankelijk bepaalde taken uitvoeren. De figuurlijke term “web crawler” is afgeleid van de manier waarop deze bots werken. Ze “crawlen” van link naar link […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/perseus.de\/nl\/webcrawler\/\" \/>\n<meta property=\"og:site_name\" content=\"Perseus Technologies\" \/>\n<meta property=\"article:published_time\" content=\"2022-04-26T09:37:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-09-01T13:29:42+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/perseus.de\/wp-content\/uploads\/2025\/05\/Headerbild-Glossary-Page.png\" \/>\n\t<meta property=\"og:image:width\" content=\"800\" \/>\n\t<meta property=\"og:image:height\" content=\"800\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Anastasia Pamoukis\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Geschreven door\" \/>\n\t<meta name=\"twitter:data1\" content=\"Anastasia Pamoukis\" \/>\n\t<meta name=\"twitter:label2\" content=\"Geschatte leestijd\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minuten\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/perseus.de\\\/nl\\\/webcrawler\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/perseus.de\\\/nl\\\/webcrawler\\\/\"},\"author\":{\"name\":\"Anastasia Pamoukis\",\"@id\":\"https:\\\/\\\/perseus.de\\\/nl\\\/#\\\/schema\\\/person\\\/6c87a2feea6439d0ead16c8f0f07e40b\"},\"headline\":\"Webcrawler\",\"datePublished\":\"2022-04-26T09:37:00+00:00\",\"dateModified\":\"2026-09-01T13:29:42+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/perseus.de\\\/nl\\\/webcrawler\\\/\"},\"wordCount\":341,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/perseus.de\\\/nl\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/perseus.de\\\/nl\\\/webcrawler\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/perseus.de\\\/wp-content\\\/uploads\\\/2025\\\/05\\\/Headerbild-Glossary-Page-300x300.png\",\"articleSection\":[\"Cyber Lexicon\"],\"inLanguage\":\"nl-NL\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/perseus.de\\\/nl\\\/webcrawler\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/perseus.de\\\/nl\\\/webcrawler\\\/\",\"url\":\"https:\\\/\\\/perseus.de\\\/nl\\\/webcrawler\\\/\",\"name\":\"Webcrawler - Perseus Technologies\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/perseus.de\\\/nl\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/perseus.de\\\/nl\\\/webcrawler\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/perseus.de\\\/nl\\\/webcrawler\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/perseus.de\\\/wp-content\\\/uploads\\\/2025\\\/05\\\/Headerbild-Glossary-Page-300x300.png\",\"datePublished\":\"2022-04-26T09:37:00+00:00\",\"dateModified\":\"2026-09-01T13:29:42+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/perseus.de\\\/nl\\\/webcrawler\\\/#breadcrumb\"},\"inLanguage\":\"nl-NL\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/perseus.de\\\/nl\\\/webcrawler\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"nl-NL\",\"@id\":\"https:\\\/\\\/perseus.de\\\/nl\\\/webcrawler\\\/#primaryimage\",\"url\":\"https:\\\/\\\/perseus.de\\\/wp-content\\\/uploads\\\/2025\\\/05\\\/Headerbild-Glossary-Page-300x300.png\",\"contentUrl\":\"https:\\\/\\\/perseus.de\\\/wp-content\\\/uploads\\\/2025\\\/05\\\/Headerbild-Glossary-Page-300x300.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/perseus.de\\\/nl\\\/webcrawler\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/perseus.de\\\/nl\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Webcrawler\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/perseus.de\\\/nl\\\/#website\",\"url\":\"https:\\\/\\\/perseus.de\\\/nl\\\/\",\"name\":\"perseus-web.de\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/perseus.de\\\/nl\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/perseus.de\\\/nl\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"nl-NL\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/perseus.de\\\/nl\\\/#organization\",\"name\":\"perseus-web.de\",\"url\":\"https:\\\/\\\/perseus.de\\\/nl\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"nl-NL\",\"@id\":\"https:\\\/\\\/perseus.de\\\/nl\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/perseus.de\\\/wp-content\\\/uploads\\\/2025\\\/03\\\/PerseusTechnologie_Color-2.png\",\"contentUrl\":\"https:\\\/\\\/perseus.de\\\/wp-content\\\/uploads\\\/2025\\\/03\\\/PerseusTechnologie_Color-2.png\",\"width\":536,\"height\":172,\"caption\":\"perseus-web.de\"},\"image\":{\"@id\":\"https:\\\/\\\/perseus.de\\\/nl\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/perseus.de\\\/nl\\\/#\\\/schema\\\/person\\\/6c87a2feea6439d0ead16c8f0f07e40b\",\"name\":\"Anastasia Pamoukis\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"nl-NL\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/88febef1895859fc3a543c774ae6bc44cde0f02199f7f792af67eaf196406342?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/88febef1895859fc3a543c774ae6bc44cde0f02199f7f792af67eaf196406342?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/88febef1895859fc3a543c774ae6bc44cde0f02199f7f792af67eaf196406342?s=96&d=mm&r=g\",\"caption\":\"Anastasia Pamoukis\"},\"sameAs\":[\"https:\\\/\\\/perseus.de\"],\"url\":\"https:\\\/\\\/perseus.de\\\/nl\\\/author\\\/anastasia-pamoukis\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Webcrawler - Perseus Technologies","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/perseus.de\/nl\/webcrawler\/","og_locale":"nl_NL","og_type":"article","og_title":"Webcrawler - Perseus Technologies","og_description":"Webcrawler Webcrawler betekent “crawler door het internet”. Webcrawlers zijn computerprogramma’s die onafhankelijk het internet doorzoeken en websites analyseren. Wat betekent webcrawler in detail? Webcrawlers zijn bots \u2013 computerprogramma’s die automatisch en onafhankelijk bepaalde taken uitvoeren. De figuurlijke term “web crawler” is afgeleid van de manier waarop deze bots werken. Ze “crawlen” van link naar link […]","og_url":"https:\/\/perseus.de\/nl\/webcrawler\/","og_site_name":"Perseus Technologies","article_published_time":"2022-04-26T09:37:00+00:00","article_modified_time":"2026-09-01T13:29:42+00:00","og_image":[{"width":800,"height":800,"url":"https:\/\/perseus.de\/wp-content\/uploads\/2025\/05\/Headerbild-Glossary-Page.png","type":"image\/png"}],"author":"Anastasia Pamoukis","twitter_card":"summary_large_image","twitter_misc":{"Geschreven door":"Anastasia Pamoukis","Geschatte leestijd":"2 minuten"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/perseus.de\/nl\/webcrawler\/#article","isPartOf":{"@id":"https:\/\/perseus.de\/nl\/webcrawler\/"},"author":{"name":"Anastasia Pamoukis","@id":"https:\/\/perseus.de\/nl\/#\/schema\/person\/6c87a2feea6439d0ead16c8f0f07e40b"},"headline":"Webcrawler","datePublished":"2022-04-26T09:37:00+00:00","dateModified":"2026-09-01T13:29:42+00:00","mainEntityOfPage":{"@id":"https:\/\/perseus.de\/nl\/webcrawler\/"},"wordCount":341,"commentCount":0,"publisher":{"@id":"https:\/\/perseus.de\/nl\/#organization"},"image":{"@id":"https:\/\/perseus.de\/nl\/webcrawler\/#primaryimage"},"thumbnailUrl":"https:\/\/perseus.de\/wp-content\/uploads\/2025\/05\/Headerbild-Glossary-Page-300x300.png","articleSection":["Cyber Lexicon"],"inLanguage":"nl-NL","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/perseus.de\/nl\/webcrawler\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/perseus.de\/nl\/webcrawler\/","url":"https:\/\/perseus.de\/nl\/webcrawler\/","name":"Webcrawler - Perseus Technologies","isPartOf":{"@id":"https:\/\/perseus.de\/nl\/#website"},"primaryImageOfPage":{"@id":"https:\/\/perseus.de\/nl\/webcrawler\/#primaryimage"},"image":{"@id":"https:\/\/perseus.de\/nl\/webcrawler\/#primaryimage"},"thumbnailUrl":"https:\/\/perseus.de\/wp-content\/uploads\/2025\/05\/Headerbild-Glossary-Page-300x300.png","datePublished":"2022-04-26T09:37:00+00:00","dateModified":"2026-09-01T13:29:42+00:00","breadcrumb":{"@id":"https:\/\/perseus.de\/nl\/webcrawler\/#breadcrumb"},"inLanguage":"nl-NL","potentialAction":[{"@type":"ReadAction","target":["https:\/\/perseus.de\/nl\/webcrawler\/"]}]},{"@type":"ImageObject","inLanguage":"nl-NL","@id":"https:\/\/perseus.de\/nl\/webcrawler\/#primaryimage","url":"https:\/\/perseus.de\/wp-content\/uploads\/2025\/05\/Headerbild-Glossary-Page-300x300.png","contentUrl":"https:\/\/perseus.de\/wp-content\/uploads\/2025\/05\/Headerbild-Glossary-Page-300x300.png"},{"@type":"BreadcrumbList","@id":"https:\/\/perseus.de\/nl\/webcrawler\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/perseus.de\/nl\/"},{"@type":"ListItem","position":2,"name":"Webcrawler"}]},{"@type":"WebSite","@id":"https:\/\/perseus.de\/nl\/#website","url":"https:\/\/perseus.de\/nl\/","name":"perseus-web.de","description":"","publisher":{"@id":"https:\/\/perseus.de\/nl\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/perseus.de\/nl\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"nl-NL"},{"@type":"Organization","@id":"https:\/\/perseus.de\/nl\/#organization","name":"perseus-web.de","url":"https:\/\/perseus.de\/nl\/","logo":{"@type":"ImageObject","inLanguage":"nl-NL","@id":"https:\/\/perseus.de\/nl\/#\/schema\/logo\/image\/","url":"https:\/\/perseus.de\/wp-content\/uploads\/2025\/03\/PerseusTechnologie_Color-2.png","contentUrl":"https:\/\/perseus.de\/wp-content\/uploads\/2025\/03\/PerseusTechnologie_Color-2.png","width":536,"height":172,"caption":"perseus-web.de"},"image":{"@id":"https:\/\/perseus.de\/nl\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/perseus.de\/nl\/#\/schema\/person\/6c87a2feea6439d0ead16c8f0f07e40b","name":"Anastasia Pamoukis","image":{"@type":"ImageObject","inLanguage":"nl-NL","@id":"https:\/\/secure.gravatar.com\/avatar\/88febef1895859fc3a543c774ae6bc44cde0f02199f7f792af67eaf196406342?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/88febef1895859fc3a543c774ae6bc44cde0f02199f7f792af67eaf196406342?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/88febef1895859fc3a543c774ae6bc44cde0f02199f7f792af67eaf196406342?s=96&d=mm&r=g","caption":"Anastasia Pamoukis"},"sameAs":["https:\/\/perseus.de"],"url":"https:\/\/perseus.de\/nl\/author\/anastasia-pamoukis\/"}]}},"_links":{"self":[{"href":"https:\/\/perseus.de\/nl\/wp-json\/wp\/v2\/posts\/30786","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/perseus.de\/nl\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/perseus.de\/nl\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/perseus.de\/nl\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/perseus.de\/nl\/wp-json\/wp\/v2\/comments?post=30786"}],"version-history":[{"count":1,"href":"https:\/\/perseus.de\/nl\/wp-json\/wp\/v2\/posts\/30786\/revisions"}],"predecessor-version":[{"id":30787,"href":"https:\/\/perseus.de\/nl\/wp-json\/wp\/v2\/posts\/30786\/revisions\/30787"}],"wp:attachment":[{"href":"https:\/\/perseus.de\/nl\/wp-json\/wp\/v2\/media?parent=30786"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/perseus.de\/nl\/wp-json\/wp\/v2\/categories?post=30786"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/perseus.de\/nl\/wp-json\/wp\/v2\/tags?post=30786"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}