Is cave diving dangerous?

Terribly dangerous.  Only those trained specifically for cave diving should attempt this.  

Never enter a cave, or wreck or any thing else for that matter that does not give you direct access to the surface unless you have been trained in that specific kind of diving.  Your life is worth more than the view from 'inside' a wreck or cave.