Just because he’s not on camera during the day don’t mean he don’t come through the area during the day. A lot of older bucks never even step foot near a feeder. If it’s a tight wooded area they’ll come within distance to look for does. If open they will stay in wood lines. When you do get a shot at taking them it won’t be for long unless there’s a doe around. Just my experience
This^^^
Where we hunt we have an area in the middle of the lease we call "no mans land" and nobody goes into that area even in the off season except right after deer season, or to trail a deer.
It's our deer sanctuary (75 acres) and it seems to have worked for the past several years. Going into that area and spreading your scent around is a sure way to drive the deer into the neighbors property, and if the deer aren't comfortable in an area they will leave and find a place that isn't disturbed.
The rut is when those bucks that are camera/feeder shy will show up, and you just have to be there when they show.