 |
 | Home | Contact Us | FAQ | Search & Site Map | Link to Us |
 | Sign In | Join | Other 45 Sites in Network |
.NET Forum / ASP.NET / General / March 2008q: How to get search engines crawl data
How to get search engines crawl data I have a web application that uses user controls and pulls data directly from database and shows it to users in the internet. So there is not html that has the data, if I need to get Google or other search engines to crawl these pages, what are my options? > How to get search engines crawl data > I have a web application that uses user controls and pulls data directly > from database and shows it to users in the internet. So there is not html > that has the data, if I need to get Google or other search engines to > crawl > these pages, what are my options? If the data is displayed as default then the search engine will read it as html, if your users have to click on a button for example to get the data then of cause it will not be indexed Thanks for the reply. Data will be displaying via page_load, it is not in html, is there any workaround? > > How to get search engines crawl data > > I have a web application that uses user controls and pulls data directly [quoted text clipped - 6 lines] > html, if your users have to click on a button for example to get the data > then of cause it will not be indexed >> If the data is displayed as default then the search engine will read it >> as >> html, if your users have to click on a button for example to get the data >> then of cause it will not be indexed > > Data will be displaying via page_load Any default data which is displayed during Page_Load will be picked up by a crawler... > it is not in HTML. Pretty much everything displayed on a web page is HTML in one form or another - exceptions obviously include things like Flash etc, but this doesn't apply in your case...  SignatureMark Rae ASP.NET MVP http://www.markrae.net Thanks for the reply. I am talking about the data coming from database, on the fly, I am still not clear how a search engine would crawl it while the data is simply on the client’s browser basically. Can you give me more detail please? > >> If the data is displayed as default then the search engine will read it > >> as [quoted text clipped - 11 lines] > another - exceptions obviously include things like Flash etc, but this > doesn't apply in your case... You have to understand how search engine crawlers work. They load a page, index it. In the process they look for links ("A" tag) in the page. Then they proceed to load each linked page and they repeat the process. It does not matter *Where* your content is coming from. Hope that helps. -- Peter Site: http://www.eggheadcafe.com UnBlog: http://petesbloggerama.blogspot.com Short Urls & more: http://ittyurl.net > Thanks for the reply. I am talking about the data coming from database, on > the fly, I am still not clear how a search engine would crawl it while the [quoted text clipped - 16 lines] > > another - exceptions obviously include things like Flash etc, but this > > doesn't apply in your case... Thanks Peter. I think it is getting more clear but just to make sure I do not miss anything; The data grid has the data shown to a user base on criteria in page_load in code behind, let’s say search engine somehow crawled this page successfully at that specific time while page is loaded just because somebody has access that page. When the user close the page, input criteria is lost, data is not available anymore on the screen. Now are we saying that since search engine has crawled this page it will be able to include that page into other people’s search result? If yes, the search engine should be keeping those data somewhere, where would that be? > You have to understand how search engine crawlers work. They load a page, > index it. In the process they look for links ("A" tag) in the page. Then they [quoted text clipped - 25 lines] > > > another - exceptions obviously include things like Flash etc, but this > > > doesn't apply in your case... > Thanks Peter. I think it is getting more clear but just to make sure I do > not [quoted text clipped - 11 lines] > other people’s search result? If yes, the search engine should be keeping > those data somewhere, where would that be? The crawler will load the page as if it is a client, it will simply follow a URL. what ever loads no mater where it comes from will be indexed. It does no matter what users are using the page at the time. the crawler is the user, how it loads when the crawler follows the links is what will be indexed >> You have to understand how search engine crawlers work. They load a page, >> index it. In the process they look for links ("A" tag) in the page. Then [quoted text clipped - 33 lines] >> > > this >> > > doesn't apply in your case...
Free MagazinesGet these publications absolutely FREE for up to 12 months. There are no hidden fees and no obligation. Simply choose a title, complete the application form and submit it. Read more ...
|
Reply to this Message
|
 Sign In
 Join
 My Latest Posts My Monitored Threads My Blog My Photo Gallery My Profile My Homepage Start New Thread Enable EMail Alerts Rate this Thread
|
©2008 Advenet LLC Privacy Policy - Terms of Use
This website includes both content owned or controlled by Advenet as well as content owned or controlled by third parties.