Hammond averages 50 against O Reilly with 4 hundreds and that's the only ATG bowler he got to face really, if you count Grimmett (I wouldn't) then he averages 53 against him with 6 hundreds.
Regardless, the only true arguably elite pace man of the time was Harold Larwood, who was viewed as superior to both Lindwall and Trueman in the 1950s all the way to the 1970s and was, by all accounts, an excellent paceman and Hammond averages 46 against him, after 1927 so around when he was picked for International Cricket, he also dominated Larwood with a 50+ average and multiple hundreds, many of them alongside Larwood's bodyline patner and a very good bowler in his own right, Bill Voce.
Hammond had his weaknesses, I think he had more weaknesses than IVA Richards of course but he was also a master at capitalising, once he got going...he didn't really stop, this is shown by 9 of his hundreds being scores above 150, him having by far the best double ton rate in history of the sport barring Donald Bradman and so forth.
another thing that makes me think he'd have been fine against pace other than Larwood was, Denis Compton was viewed unanimously and universally as a less skillful batsman than Walter Reginald Hammond and Compton still averaged 50+ against the Invincibles lineup and the following 50s Australian lineup which are up there as some of the best lineups ever concieved, now unless everyone was wrong in regards to Hammond being superior to Compton easily, Hammond should be able to replicate what Compton did at the very least.
remember, even in the victory tests when Hammond was truly and completely pass it, He still smacked around Keith Miller, and in the final Ashes where he was an arthritis ridden old man who was out of shape, Lindwall and Miller still never got him, Lindwall got him once, he was still capable of surviving the spells even when he was so, so far from what he once was.
All in all, I think it's definitely a debateable matter, I just think Hammond's output is more impressive, and that he would've done fine against pace considering how his inferiors did, but if one has Richards higher, I do not mind or anything.