I've tried restarting apache and the cached pages still appear, so there must be a folder someplace. I don't have a 'public/cache', so what other places should I look? Is there a URL flag that could trigger this effect as well?
You need to touch a file to have phusion clear out, like:
touch /webapps/mycook/tmp/restart.txt
See the docs