[pcre-dev] Proposal: robots directive, vcs.pcre.org

Αρχική Σελίδα
Delete this message
Συντάκτης: Phil Pennock
Ημερομηνία:  
Προς: pcre-dev
Αντικείμενο: [pcre-dev] Proposal: robots directive, vcs.pcre.org
Folks,

Some robots are hitting the PCRE viewvc pages fairly heavily; does
anyone have any objections to my editing the header template to include
this line?

<meta name='robots' content='index, nofollow'/>

My intention: anything in SVN is fair game for showing up in search
engines, if it's linked to from outside, but don't follow the internal
links and spider the entire source tree, on every branch, etc etc.

Sound good? Any better proposals?

-Phil