Shannon language tests

[gusl]

A project idea I've written down on my notebooks: Shannon language tests, to automatically generate tests to measure language ability. The prediction task is similar to the way Shannon measured the entropy of English.

Comments

[mathemajician.livejournal.com]

Sounds like a "Cloze Test" or a "C-Test" to me. Also related: somebody suggested using a compression test in the place of a Turing test to measuring AI performance. I don't have the refs with me here at home.