Gunwriter John Barsness has often written that he always begins testing with a new .30-06 with 58 grs of IMR4350 behind most any 165 gr bullet. If the rifle won't shoot that load accurately, then it is unlikely to get better with any load. For most hunting situations, he finds that 58.5 to 59 grs will be about right.
I normally start at 57 grs myself and usually end up at around 59 with the 165 Nosler PT or AB. I'm also quite fond of Re-19 and the obsolete H-205 at about the same loading. Velocity will be somewhere above 2900 fps.
"For every complex problem there is an answer that is clear, simple.....and wrong." H. L. Mencken