Buddhism doesn't mean fortune telling, but drawing lots. It is equivalent to drawing lots and taking chances.
Taoism takes the Tao Te Ching as their sutra, not a fortune-telling book, so they can't.
Fortune-telling books, from the Book of Changes, were originally held by Huang bureaucrats, but now they are held by the people.