Keeping ColdFusion pages from being full-texted searched

Keeping search engines from full-text indexing CF Pages

Page 1 of 1

1 Replies - 916 Views - Last Post: 10 December 2008 - 07:29 AM Rate Topic: -----

#1 nbrooks427  Icon User is offline

  • New D.I.C Head

Reputation: 0
  • View blog
  • Posts: 4
  • Joined: 16-October 08

Keeping ColdFusion pages from being full-texted searched

Post icon  Posted 16 October 2008 - 09:55 AM

Hello All,

I am new to this site and was wondering if anyone else has had an issue with needing to keep search engines from full-text indexing your CF pages. The only thing I've been able to find is code to keep robots from indexing and following links.

Does anyone have any ideas??

Thank you.
Is This A Good Question/Topic? 0
  • +

Replies To: Keeping ColdFusion pages from being full-texted searched

#2 Craig328  Icon User is offline

  • I make this look good
  • member icon

Reputation: 1926
  • View blog
  • Posts: 3,471
  • Joined: 13-January 08

Re: Keeping ColdFusion pages from being full-texted searched

Posted 10 December 2008 - 07:29 AM

Well, you can use the robots.txt file that most major spiders will respect.

However, that relies on them respecting your wishes. The only other way for certain would be to do what you mentioned...write code that specifically verifies the identity of a bot or spider and then give it nothing to look at.

That part isn't as big a pain in the ass as it sounds. There are listings on the web of bots/spiders you can check against the cgi.HTTP_USER_AGENT value. You'd probably want to make that a UDF or method of a CFC function and then simply CFABORT when the function gets a hit.
Was This Post Helpful? 0
  • +
  • -

Page 1 of 1