Skip to main content

Should I allow AIs train on my website or not?

So I have been wondering if I should allow AIs to train on my content and website or not in robots.txt.

Should I use general allowance for all kinds of agents?

User-Agent: * Allow: /

I did research I found mixed responses, some say for info based sites agents and train bots must be disallowed and for some it doesn't matter, what do you think?

submitted by /u/thenamo
[link] [comments]

from Search Engine Optimization: The Latest SEO News https://ift.tt/e4yEdPz
Labels:

Comments

Post a Comment

Popular posts from this blog

Legit Reviews

The google review thing is insane I have gotten 2 legit verified reviews that i ask client to screenshot and observe goolge not post them, pretend like they never happened and when i sent them the image a policy message was sent . As I was browsing through the google forum a lot of ppl are getting hit with legit reviews being removed. While all this is going on i have observe a company go from 12 reviews to 65 reviews in a two month period with some stuff that dont make sense on some of them. Seems like a new business or profile is being limited while aged accounts can have a free for fall but who really knows. Still waiting for a resolution on a if any. submitted by /u/Ok-Bowl-6167 [link] [comments] from Search Engine Optimization: The Latest SEO News https://ift.tt/zkbfgDH
Post a Comment
Read more

Local seo vs. natiowide seo?

I've done SEO for local businesses but I recently got my first client that sells an item nation wide. ​ Any suggestions for doing nationwide SEO? ​ I am used to making geopages for local towns. I was going to do the same with some input from the client about what cities or towns he would like to show up in? submitted by /u/Letmeinterviewyou [link] [comments] from Search Engine Optimization: The Latest SEO News http://bit.ly/2JHy0k0
Post a Comment
Read more