Put some trail cams out (or move existing ones) and see if you can tell what direction he is coming from.
He might be bedded down nearby by, and as you say, he might make a mistake and come out earlier than what he has normally been doing.
(but don't hunt 'on the fenceline')
Keep the wind in mind and Good Luck!
I gave up Hunt'n + Fish'n...It was the worst 15 Minutes of My Life!!