S Mac,back in the 80's,early 90's I was hard after handgun hunting. For almost 10 years,that's all I hunted with. As far as "benchwork" goes.....
The rest first.... then optics..... then cross training.
Optics; I know you're using a scope but try the blacked shooting glass's lense trick with the little peep hole. Just like a baseball cap brim,pulled down,tight to the top of sight picture in the field,the aperture increases depth of focus. Get it right and its magic.
The rest is only limited by your resources and willingness to try different setups. In the field; this is where I first started using two arrows lashed together,with surgical hose over the top 5" or so. Which then lead to a different bench setup. A welded up, Y with the lowest vert piece made from 3/4" section of allthread. The upper legs are 5/16" covered with...... wait for it.....surgical hose. Jam nut top and bttm of the center post as it passes through a heavy wood base. More than a "2X10" here.... it needs to be flat. 3 layers of 3/4" ply is about right,make it 12" wide. As long as it takes to serve as a rifle cleaning station when you aren't blasting handguns.
Cross training is the doodoo. The problem is grip and eyesight. Chopping wood with a maul is one very good method. Many excersizes can be worked into your daily routine that has or pays,benny's for handgun work. This is what separates OK shooters from guys who can really wring out a handgun. Welding skills translate well here too. Holding an extremely tight Tig "bead" makes holding a pistol,uhhhh easy? Many approaches to this that don't involve sending lead down range. In my prime,from a bench.... could rival,and beat ransom rests on occasion. A python,series 70 Colt GC, DW 744,and a #14 Smith.... all with highly tuned loads,was plenty of "tell the truth" (your skill test) weaponry. Good luck,try the Y post thing,it's magic.