Side channel attacks can be very effective, resulting in a break in as little as 65 ms. See http://www.wisdom.weizmann.ac.il/~tromer/papers/cache.pdf and http://cr.yp.to/papers.html#cachetiming
See http://www.cnss.gov/Assets/pdf/cnssp_15_fs.pdf for details of approval for use.