SEO robots.txt query - HotUKDeals
We use cookie files to improve site functionality and personalisation. By continuing to use HotUKDeals, you accept our cookie and privacy policy.
Get the HotUKDeals app free at Google Play

Search Error

An error occurred when searching, please try again!

Login / Sign UpSubmit

SEO robots.txt query

£0.00 @
Hi My robots.txt file looks like this: User-Agent: * Allow: / sitemap: http://www.mysite.com/sitemap.xml Is the version below correct if I want to exclude one web page and allow everythin…
tgbyhn10 Avatar
7y, 1m agoPosted 7 years, 1 month ago
Hi

My robots.txt file looks like this:

User-Agent: *
Allow: /
sitemap: http://www.mysite.com/sitemap.xml


Is the version below correct if I want to exclude one web page and allow everything else?

User-Agent: *
Disallow: /mypage.htm
sitemap: http://www.mysite.com/sitemap.xml

Is it correct to remove the "Allow: /" ?

Thanks
tgbyhn10 Avatar
7y, 1m agoPosted 7 years, 1 month ago
Options

All Comments

(2) Jump to unreadPost a comment
Comments/page:
#1
Looks fine :thumbsup:
#2
Thanks

Post a Comment

You don't need an account to leave a comment. Just enter your email address. We'll keep it private.

...OR log in with your social account

...OR comment using your social account

Looking for Twitter login?
Thanks for your comment! Keep it up!
We just need to have a quick look and it will be live soon.
The community is happy to hear your opinion! Keep contributing!