>>What am I doing wrong? How can I remove the solid black shadow as shown in>>image2.jpg and have caustics show up there?
You can get the effect you want by lowering the ior from your interior,
I'm not sure if POV ior is really one for one acurate with RL ior numbers.
(1.01 would work ok)