I think most shooters would be satisfied with the groups you are getting from a factory rifle. I am also on a few other forums where much time has been spent discussing/cussing why we can't get smaller groups. A lot of time is spent delving into equipment etc, etc. I speak for myself, over the years I find the one thing that I find to be the biggest thing is the person behind the rifle; as mentioned by Bret4207. Those days where the planets are all lined up properly, the sun is shining just right, wind conditions are perfect and the fella behind the gun is in the "groove" as they say- those days don't come along as frequently as we desire. My mentor had me keep meticulous records when I started shooting, and it has paid dividends over the years. One thing that is kept in the records is shooter attitude. Ever have those days when things just don't feel right, not really relaxed, other things that you have to do are also on your mind. How do you look at the target when you are looking through the scope/sights. Don't be satisfied when looking at the target through the scope/sight and looking at the target center, but focus on the center of the X ring and visualize the bullet hitting the center of the X as you gently squeeze that trigger- works for me. Enough ramblings. Main thing- always have a good time at the range.
I haven't shot anything for teeny tiny groups in a LONG time. But back when I was, one I was shooting was a Win M70 in 300 Win Mag. AND it, at least, really really liked the Speer Hot Cor 180 pb hunting bullet. I have two 3 shot groups with that gun/bullet - 1x is ~.4" and one is ~.7". Two diff powders, one a min load and one a max load. I have always been happy with Speers.