The hole in the beach after low tide may be the hole of sea centipede. Sea centipede is a kind of marine life. They usually dig holes on the beach to hide. These holes may be exposed at low tide, leaving a deep impression on people.
It should be noted that if you find similar caves on the beach, don't try to explore them by hand, because these caves usually lead to the ocean and may be dangerous.