I watched The Shawshank Redemption countless times. This question occurred to me tonight for the very first time.
When the Warden opened the safe at the end of the movie, Andy's Bible was there. Norton then dropped it on the floor and went to his desk.
How did the Bible get in the safe? The night before, Andy had to wait for Norton to open the safe so he could put the other ledger in.