Nigel Farage left UKIP for that very reason. The Brexit party is fairly moderate and would be described as center-right, just shy of the conservatives.
The Brexit Party was just a face-saving rebrand for UKIP. It didn't take long for the mask to start slipping, with the party's founder resigning after retweeting racist posts from far-right figures.
Of course, Farage himself may denounce such things:
> I set the party up, she was the administrator that got it set up.
Friendly reminder that it's very easy, and very common, for racists to disavow their racism when it's expedient to do so (e.g. an extreme example https://youtu.be/zcoYKuoiUrY?t=1568 )