WordPress.org

Tagalog

Get WordPress
WordPress.org

Plugin Directory

Tag ng Plugin: crawler

Tag ng Plugin: crawler

  • Email Address Encoder

    (159 kabuuang ratings)

    A lightweight plugin that protects email addresses from email-harvesting robots, by encoding them into decimal and hexadecimal entities.

    Till Krüss 100,000+ (na) aktibong installation Sinubukan sa 6.7.4

  • Robots.txt Editor

    (8 kabuuang ratings)

    Robots.txt for WordPress

    Processby 10,000+ (na) aktibong installation Sinubukan sa 5.6.16

  • Better Robots.txt optimizer (+ XML Sitemap) – Boost SEO, Traffic & Rankings

    (102 kabuuang ratings)

    AI-ready virtual robots.txt & XML Sitemap. Control crawl, speed up indexing, improve SEO – no file editing.

    Pagup 7,000+ (na) aktibong installation Sinubukan sa 6.8.3

  • Spider Analyser – WordPress搜索引擎蜘蛛分析插件

    (1 kabuuang ratings)

    Spider Analyser是一款用于跟踪WordPress网站各种搜索引擎蜘蛛爬行日志的插件，并进行详细的蜘蛛爬行数据统计、蜘蛛行为分析、蜘蛛爬取分析及伪蜘蛛拦截等。

    wbolt.com 5,000+ (na) aktibong installation Sinubukan sa 6.8.3

  • No-Bot Registration

    (26 kabuuang ratings)

    Prevent bots from creating accounts by blacklisting domains and usernames and present people with a human friendly security question.

    Arnan de Gans 2,000+ (na) aktibong installation Sinubukan sa 6.8.3

  • Robots.txt rewrite

    (2 kabuuang ratings)

    Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

    Eugen Bobrowski 1,000+ (na) aktibong installation Sinubukan sa 4.7.31

  • Advanced Robots.txt Optimizer & Editor

    (2 kabuuang ratings)

    The "Advanced Robots.txt Optimizer & Editor" WordPress plugin enhances website functionality, SEO and traffic management by allowing use …

    aleemiqbal 900+ (na) aktibong installation Sinubukan sa 6.7.4

  • Marquee image crawler

    (1 kabuuang ratings)

    Marquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right.

    gopiplus 800+ (na) aktibong installation Sinubukan sa 6.1.9

  • Crawl Optimization

    (2 kabuuang ratings)

    The Crawl Optimization Plugin is designed to help optimize your website’s crawl rate by removing unnecessary links and information from your HTTP head …

    aleemiqbal 800+ (na) aktibong installation Sinubukan sa 6.7.4

  • Mass Ping Tool for SEO – WordPress ping list to get indexed faster on Google, Yandex, …

    (3 kabuuang ratings)

    Mass ping tool for SEO plugin is one of the fastest ways to get indexed by Google. After pinging, Google bots, crawlers will visit your website and in …

    Pagup 700+ (na) aktibong installation Sinubukan sa 6.8.3

  • Block Archive.org via WordPress robots.txt

    (0 kabuuang ratings)

    Blocks the archive.org bots through the WordPress virtual robots.txt file.

    apasionados 500+ (na) aktibong installation Sinubukan sa 6.7.4

  • DB Robots.txt

    (3 kabuuang ratings)

    DB Robots.txt is an easy-to-use plugin for generating and configuring the file robots.txt that is essential for SEO (search engine optimization).

    Denis Bisteinov 500+ (na) aktibong installation Sinubukan sa 6.7.4

  • Stop and Block bots plugin Anti-bots

    (2 kabuuang ratings)

    Real-Time Bot Protection. Anti Bots (robots), crawlers and spiders also from botnets. Increase security and avoid server overload and bandwidth.

    Bill Minozzi 400+ (na) aktibong installation Sinubukan sa 6.8.3

  • bodi0`s Bots visits counter

    (5 kabuuang ratings)

    Counts the visits from web spiders, crawlers and bots in your blog, with ability to get the blog rankings.

    Budiony Damyanov 100+ (na) aktibong installation Sinubukan sa 6.1.9

  • Block Chat GPT via robots.txt

    (1 kabuuang ratings)

    Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file

    apasionados 100+ (na) aktibong installation Sinubukan sa 6.3.7

  • Block eCommerce Assets via robots.txt

    (0 kabuuang ratings)

    Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt

    apasionados 100+ (na) aktibong installation Sinubukan sa 6.3.7

  • Block Feed and Comments via robots.txt

    (0 kabuuang ratings)

    Blocks some Feed and Comment resources in order to avoid spam bots

    apasionados 70+ (na) aktibong installation Sinubukan sa 6.3.7

  • Findkit – Site Search

    (0 kabuuang ratings)

    Powerful cloud based search engine for your website. Search as you type, real-time index updates, and embeddable UI. Free for small websites.

    Findkit Team 60+ (na) aktibong installation Sinubukan sa 6.7.4

  • Warmer

    (3 kabuuang ratings)

    Automatically warm up your WordPress site's cache by crawling pages to ensure optimal performance for your visitors.

    Atakan Oz 50+ (na) aktibong installation Sinubukan sa 6.8.3

  • Block Common Crawl via robots.txt

    (0 kabuuang ratings)

    Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file

    apasionados 30+ (na) aktibong installation Sinubukan sa 6.3.7