Yup. My guess is, they reached out to his agent, his agent went "here's the price", they balked and walked away from the table.
Wish they would have just asked Troy himself. With how bummed he was (he said he was "gutted") in not being asked, I am guessing he might have been willing to work out a more affordable price.
But what really irritates me with Namco Bandai is they could have afforded Baker, they probably just didn't want to. Which, maybe a smaller aspect (VO) compared to the rest of the game, it's not making (paying) the extra step to make sure it's done correctly.