Google will stop supporting noindex in robots.txt soon
July 10, 2019
Now you can’t hide your website from Google behind robots.txt file. Google bot will not follow the robots.txt rule. You can use an alternative to hide from Google bot. This changes will effective from September 1.
Google’s official tweet:
Today we’re saying goodbye to undocumented and unsupported rules in robots.txt 👋