I've been shooting the 25-06 for some time - it's a great caliber and plenty for deer. However, I have found that most 25-06 guns can be very finicky with ammo. So, find out what works best with your gun and stick with it. Especially when you go over 100gr with the 25-06, depending on your gun, some funky things begin to happen.
For example, my gun will shoot ANY 80-100gr cartridge with extreme accuracy, and I can switch from ammo to ammo brand/bullet with virtually no zero drift at 100 yards. However, once I get to the 115-120gr ammo, my gun has issues grouping. Not bad, but it is definitely there. With 120gr core-lokt, I could not get groupings tighter than 4-5", even when the gun was bolted down in a rest. I had mixed results with 115-117gr ammo.
For MY gun, the HSM Berger VLD round has been excellent, with consistent 1/4" groupings from 100-200 yards. The VLD bullet packs a wallop too - and have taken several animals in the 200-300lb range - some big axis or hogs for example. However, this round is not without issues.
The 25-06 moves so fast, that the VLD or ballistic silver tips rounds have a tendency to do "funky" things at SHORT distances, like 50-90 yards. I have had the Berger VLD do complete pass-thru at 80 yards and not expand. Also had them richochet off shoulder/scapulas at short range. On the other hand, at 250+ yards - they penetrate well and cause massive hydrostatic shock (think animal falls over dead without a step). But you don't want meat shots at longer distances - for example, a shoulder shot with a Berger VLD at 200 yards will mean there is no shoulder left on the opposite side.