.Google.com confines robots.txt support to 4 areas, clarifying its own posture on unsupported directives.Google.com just sustains four particular robots.txt areas.Unsupported ordinances in robots.txt will certainly be overlooked.Look at auditing your robots.txt reports due to this improve.