Cloudflare’in arkasında bir WooCommerce mağazası (Kanada/ABD kitlesi) işletiyorum. Aşağıda özel güvenlik kurallarım ve robots.txt dosyası bulunmaktadır. Teknik SEO deneyimi olan herhangi biri, bunlardan herhangi birinin taramaya, dizine eklemeye, Google Alışverişe veya bağlantı önizlemelerine zarar verip vermeyeceğini kontrol edebilir mi? Bir Atlama kuralında doğrulanmış botları ve Googlebot çeşitlerini atladım.
Engellemek:
(http.user_agent contains "python-requests") or (http.user_agent contains "Scrapy") or (http.user_agent contains "curl") or (http.user_agent contains "Go-http-client") or (http.user_agent contains "SemrushBot") or (http.user_agent contains "AhrefsBot") or (http.user_agent contains "GPTBot") or (http.user_agent contains "ClaudeBot") or (http.user_agent contains "meta-externalagent") or (http.user_agent contains "meta-webindexer") or (http.request.uri.path contains "/wp-json/oembed/") or (http.user_agent contains "Lightpanda") or (http.user_agent contains "secret-scanner") or (not ip.src.country in {"US" "CA"} and not cf.client.bot and not http.request.uri.path contains "/wc-api/" and not http.request.uri.query contains "wc-api=") or (http.request.method eq "GET" and http.request.uri.query contains "remove_item" and not http.cookie contains "woocommerce_items_in_cart") or (http.user_agent contains "facebookexternalhit") or (http.user_agent contains "facebookcatalog") or (ip.src.asnum eq 32934) or (ip.src.asnum in {27323 23033})
Atlamak:
(cf.client.bot) or (http.user_agent contains "Googlebot") or (http.user_agent contains "Google-InspectionTool") or (http.user_agent contains "AdsBot-Google") or (http.user_agent contains "Storebot-Google") or (http.user_agent contains "Google-Shopping") or (http.user_agent contains "FeedFetcher-Google")
Yönetilen Zorluk:
(http.request.uri.query contains "filter_cat=" and http.request.uri.query contains ",") or (http.request.uri.query contains "filter_cat=" and http.request.uri.query contains "%2C") or (http.request.uri.query contains "filter_cat=" and http.request.uri.query contains "%2c") or (http.request.uri.query contains "add-to-cart") or (http.request.uri.query contains "add-to-compare") or (not http.referer contains "example.com" and http.request.uri.path eq "/cart/" and http.request.uri.query contains "remove_item") or (not http.referer contains "example.com" and http.request.uri.path eq "/cart/" and not http.cookie contains "woocommerce_items_in_cart") or (http.request.uri.path contains "/page/" and http.request.uri.query contains "filter_cat=")
Atlamak:
(http.request.uri.path contains "/wp-json/")
Atlamak:
(http.request.method eq "GET" and http.request.uri.path contains "/wp-content/uploads/" and http.referer contains "example.com")