Home | Contact Us | FAQ | Search & Site Map | Link to Us
Sign In | Join | Other 45 Sites in Network
HomeAnnouncementsFree MagazinesWhite PapersSubmit Content
Discussion GroupsASP.NETWindows FormsLanguages.NET FrameworkVisual Studio.NET
Articles.NET FrameworkASP.NETToolsWindows Forms
.NET DirectoryOpen Source ProjectsUser GroupsWeb Resources
Related Topics
Visual Basic 6SQL ServerMS AccessOther DB ProductsMS Server ProductsMore Topics ...

.NET Forum / ASP.NET / General / March 2008

Tip: Looking for answers? Try searching our database.

404, SEO, robot.txt?

Thread view: 
Enable EMail Alerts  Start New Thread
Thread rating: 
David Lozzi - 05 Mar 2008 14:24 GMT
Howdy,

A lot of my sites are data driven pages pulling from SQL using url
rewriting. Works great. some sites that i have changed are getting hits on
the old pages that no longer exist from search engine bots. I have my site
setup so that if someone tries to get to a page that isn't in the database i
redirect them to a friendly page, oops.aspx. Unfortunately some search
engines are cataloging this page as the content of the original pages, so it
thinks engineering.aspx is oops.aspx. What is the best way to handle this? I
could add oops.aspx to robot.txt and technically the search engine won't
catalog it. Can I someone send the bot a 404 code so that it doesn't look
for this page anymore? My other option is to manually enter in all of the
pages being hit into my urlrewriting, but i'm hoping not to.

Thanks!

Signature

David Lozzi
Product Development Manager
Delphi Technology Solutions
www.delphi-ts.com - www.lozzi.net

bruce barker - 05 Mar 2008 16:44 GMT
using the user agent string you can try to identify the request a bot
request, then respond with a 404 instead of 301.

-- bruce (sqlwork.com)

> Howdy,
>
[quoted text clipped - 11 lines]
>
> Thanks!
David Lozzi - 05 Mar 2008 16:48 GMT
how does one respond with a 404?

Signature

David Lozzi
Product Development Manager
Delphi Technology Solutions
www.delphi-ts.com - www.lozzi.net

> using the user agent string you can try to identify the request a bot
> request, then respond with a 404 instead of 301.
[quoted text clipped - 21 lines]
>>
>> Thanks!

Rate this thread:







Free Magazines

Get these publications absolutely FREE for up to 12 months. There are no hidden fees and no obligation. Simply choose a title, complete the application form and submit it. Read more ...

Oracle MagazineNetwork ComputingComputer WorldBio-IT WorldeWeekInformation WeekInfosecurity
 
Sign In
Join
My Latest Posts
My Monitored Threads
My Blog
My Photo Gallery
My Profile
My Homepage

Start New Thread
Enable EMail Alerts
Rate this Thread



©2008 Advenet LLC   Privacy Policy - Terms of Use
This website includes both content owned or controlled by Advenet as well as content owned or controlled by third parties.