That probably means the harvest standards differ from one guy to the next. You've opened a channel of communication, which is a very good thing in itself and something that can be built upon. Such relationships are usually slow and take years to develop as each season passes. Hopefully, one of you will end up taking a nice buck, the knowledge of which can be shared as an example of what can be achieved through good management practices. Just as knowing your neighbors shoot anything that moves can impact your harvest decisions, knowing they are holding back and getting good results will do the same.
You can also drop small points, such as how you keep seeing more deer as the pressure is increased on the places around you. There's no question that a lot of shooting on one property will cause deer to move next door where things are much more quiet. And nothing can make a hunter re-think his ways than learning his neighbors are seeing lots of deer when he sits in the stand all day and sees nothing. Just go slow, check in periodically, and keep an attitude that good things will result if we work together as the backdrop,.