It seems to me that capital 'S' and lower case 's' makes a difference.
All good requests have a capital 'S' in a beginning of the SessionID
/Application/(S(oqe1gv45d4gxfy45ee1ateuh))/start.aspx?hp=3
The only bad request has a lower case 's'
/Application/(s(oqe1gv45d4gxfy45ee1ateuh))/start.aspx
You can reverse IP address it came from. Most likely it came from "bad"
robot. "Bad" in terms of poorly written. That converts URLs to lower case
at will...
Second option is that someone has published link to your site somewhere with
a SessionID and lowercase 's' Hence bunch of robots like Google, Yahoo
trying to follow that link....
Solution: do not pay attention :)
George.
> It seems to me that capital 'S' and lower case 's' makes a difference.
> All good requests have a capital 'S' in a beginning of the SessionID
> /Application/(S(oqe1gv45d4gxfy45ee1ateuh))/start.aspx?hp=3
>
> The only bad request has a lower case 's'
> /Application/(s(oqe1gv45d4gxfy45ee1ateuh))/start.aspx
Thanks for spotting that. I'll have to go back and check I didn't just
screw that up while anonymising the post, but you're right, it does
look different.
> You can reverse IP address it came from. Most likely it came from "bad"
> robot. "Bad" in terms of poorly written. That converts URLs to lower case
[quoted text clipped - 3 lines]
> a SessionID and lowercase 's' Hence bunch of robots like Google, Yahoo
> trying to follow that link....
I know that we do have some links from elsewhere that may have these
things. It would help a lot if bots would set the Referer header (so
we could find the duff sites and let the owners know)
> Solution: do not pay attention :)
>
> George.
Thanks George. Not paying attention is a good strategy, but our error
reporting sends messages to our helpdesk, who raise incidents, that I
have to close and give reasons on :-( I can try to get our error
reporting system to ignore these errors specifically, but it'll mean
having to pull apart exception messages to find what path is being
accessed :-(
George Ter-Saakov - 17 Mar 2008 12:44 GMT
My website sends me an email every time unexpected exception happens too.
I just learned to ignore those messages. If some BOT gives me to many errors
I just ban it's IP address...
I guess you will have to do the same to avoid to many fake incidents from
help desk
George.
On Mar 14, 3:23 pm, "George Ter-Saakov" <gt-...@cardone.com> wrote:
> It seems to me that capital 'S' and lower case 's' makes a difference.
> All good requests have a capital 'S' in a beginning of the SessionID
> /Application/(S(oqe1gv45d4gxfy45ee1ateuh))/start.aspx?hp=3
>
> The only bad request has a lower case 's'
> /Application/(s(oqe1gv45d4gxfy45ee1ateuh))/start.aspx
Thanks for spotting that. I'll have to go back and check I didn't just
screw that up while anonymising the post, but you're right, it does
look different.
> You can reverse IP address it came from. Most likely it came from "bad"
> robot. "Bad" in terms of poorly written. That converts URLs to lower case
[quoted text clipped - 4 lines]
> a SessionID and lowercase 's' Hence bunch of robots like Google, Yahoo
> trying to follow that link....
I know that we do have some links from elsewhere that may have these
things. It would help a lot if bots would set the Referer header (so
we could find the duff sites and let the owners know)
> Solution: do not pay attention :)
>
> George.
Thanks George. Not paying attention is a good strategy, but our error
reporting sends messages to our helpdesk, who raise incidents, that I
have to close and give reasons on :-( I can try to get our error
reporting system to ignore these errors specifically, but it'll mean
having to pull apart exception messages to find what path is being
accessed :-(
Damien - 17 Mar 2008 13:01 GMT
> On Mar 14, 3:23 pm, "George Ter-Saakov" <gt-...@cardone.com> wrote:> It seems to me that capital 'S' and lower case 's' makes a difference.
> > All good requests have a capital 'S' in a beginning of the SessionID
[quoted text clipped - 6 lines]
> screw that up while anonymising the post, but you're right, it does
> look different.
I've now verified that it does seem to be dropping everything into
lowercase. (So when I anonymised, I should have had "application")
> > You can reverse IP address it came from. Most likely it came from "bad"
> > robot. "Bad" in terms of poorly written. That converts URLs to lower case
[quoted text clipped - 7 lines]
> things. It would help a lot if bots would set the Referer header (so
> we could find the duff sites and let the owners know)
I've now further analysed the ones that seem to fall into this
pattern. I don't think it's a bot, because it can happen even quite
late on in our sequential process. But the following seems to be one
pattern:
Client does a GET on a particular aspx page, gets a good response.
Resources for that page (CSS, JS, Images) then get loaded. Then
there's the weird request for the page again, all in lowercase. No
User Agent, no Referer. Then, usually, the client goes on to do a
postback on the page. So it looks like the second request (the one in
lowercase) isn't necessarily being shown to the user. Is there some
kind of popup-blocker, security software or something similar that
might perform additional requests to URLs like this?
I honestly don't know what to look at next. Problem is, our error
system is fairly aggressive, and after an error occurs, the session
gets abandoned. So the subsequent postback can't be dealt with nicely
anyway.
Thanks in advance again, and thanks again to George and Bruce for
helping me make some sense of this.
Damien