Where did Elijah stay at Mount Horeb?

Answer: A cave

Elijah went into a cave and spent the night there.

“There Elijah entered a cave and spent the night. And the word of the LORD came to him, saying, “What are you doing here, Elijah?””— 1 Kings 19:9 (BSB)