Wow! My Machinist Toolbox program tells me that Tool Steel H10 (there is no P20 in the list) with HB 325 to 375 has a suggested SFM of 405 when using an carbide insert.The material is Uddeholm Impax Supreme (P20 Modified) tool steel, hardened to HB 310. 5" diameter, 250rpm.
Turning at 250 RPM my calculator tells me that the rate of the surface passing the cutter is 327 SFM.
With a 0.080" depth of cut it tells me 314 RPM and 0.0154 IPR. So I'd guess you aren't quite near the max.
Good show!