Jump to content
DMT Exchange Blog DMT Cryptocurrency Blog

Best Change



Sign in to follow this  
smithmary01

what is robots.txt file?

Recommended Posts

Robots. txt file is also known as the robots exclusion protocol which is a text file and tells web robots which pages on your site to crawl. It is very important to have as it tells them to not crawl the parts of your site that aren't displayed to the public.

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
Sign in to follow this  

×
×
  • Create New...