Groups

    SEO robots.txt query

    Hi

    My robots.txt file looks like this:

    User-Agent: *
    Allow: /
    sitemap: mysite.com/sit…xml


    Is the version below correct if I want to exclude one web page and allow everything else?

    User-Agent: *
    Disallow: /mypage.htm
    sitemap: mysite.com/sit…xml

    Is it correct to remove the "Allow: /" ?

    Thanks

    2 Comments

    Looks fine :thumbsup:

    Original Poster

    Thanks
    Post a comment
    Avatar
    @
      Text
      Top Discussions
      1. What do these 2 men have in common1014
      2. Just heard this...2 ★★★★★★★★★★★★★★ congrats to all on 392k ★★★★★★★★★★★★★★7764216
      3. How dangerous is Donald trump?31138
      4. ❅☁☁❅ I want☼to talk☼about the☔WEATHER☔no politics☃no religion❅☁☁❅18846168

      See more discussions