Author: ph10 Date: To: Phil Pennock CC: pcre-dev Subject: Re: [pcre-dev] Proposal: robots directive, vcs.pcre.org
On Sun, 5 Feb 2017, Phil Pennock wrote:
> Folks,
> anyone have any objections to my editing the header template to include
> this line?
>
> <meta name='robots' content='index, nofollow'/>
>
> My intention: anything in SVN is fair game for showing up in search
> engines, if it's linked to from outside, but don't follow the internal
> links and spider the entire source tree, on every branch, etc etc.
>
> Sound good? Any better proposals?
Sounds good to me. Thanks for noticing and dealing with it.
