I don't know if there is a way to directly accomplish what
you want.

But you can create a class to manage the caching for you
based on settings in your web.config file. Then you can
disable caching in your web config. But this requires you
to use the caching class rather going directly to the
cache. So if you have a lot of code already, you would
have to change it to interact with this caching class.

Here is a code from MSFT for doing this:
http://msdn.microsoft.com/library/default.asp?
url=/library/en-us/dnaspp/html/aspnet-
createcacheconfigobject.asp