Since the Augment virus eliminated the ridges in some Klingons, I'd guess cartilage. But I haven't seen that episode, so feel free to disregard me.
Come to think of it I don't think that it has ever been stated so your guess is as good as ours.
It appears to be bone. http://en.memory-alpha.org/wiki/File:Klingon_anatomy_small.jpg