Not sure if this will help any:
http://paulbourke.net/miscellaneous/povexamples/
Near the end is some info about making Quicktime navigable objects.
Maybe if you just run an animation and use photo stitching software on the
resulting string of renders, that will be faster?