Nice long posting. :-D
Have you ever heard of the Hutter Prize? http://prize.hutter1.net/
The initiators of that prize also claim that good (lossless) compression
is strongly related to AI and learning neuronal networks. :-)
Perhaps you've got some ideas how to beat the current best record?
Lars R.
