Google is indexing most of the pages in my website. But I’ve realised that Bing, Yahoo and DuckDuckGo are no longer indexing my site. I’m confident they were before I moved to Kirby, but they aren’t now.
I’ve signed up to Bing Webmaster Tools and done a “Live URL” Inspection of a few pages. I get the following error messages:
URL cannot be indexed by Bing The Inspected URL returned HTTP 403 error when we tried to fetch the content. Please make sure that this is intentional. If you have moved the page to a new location, please use proper redirects.
With the following HTTP Response
HTTP Response - 403
Cache-Control : private, no-cache, no-store, must-revalidate, max-age=0
Date : Sun, 04 Jun 2023 15:14:21 GMT
Pragma : no-cache
Content-Length : 699
Content-Type : text/html
alt-svc : h3=“:443”; ma=2592000, h3-29=“:443”; ma=2592000, h3-Q050=“:443”; ma=2592000, h3-Q046=“:443”; ma=2592000, h3-Q043=“:443”; ma=2592000, quic=“:443”; ma=2592000; v=“43,46”
My .htaccess file does have redirects. Redirecting http to https and non www to www. I’ve updated my .htaccess code half an hour ago to the following. But Bing still can’t crawl the page.
Could this be a problem with my redirects?