RuntimeError: probability tensor contains either inf, nan or element < 0

[eternal8080]

I use llava-onevision-72B, when I run the inference on H800，it is OK. When I run inference on A6000, it occurs the error above？ How can I solve it

[eternal8080]

when inference on A6000*4， it occurs error above；while inference on H800 it is OK.
And I fing when I run llava-onevision-7B on multipile gpus， it also produce error above， but with just 1 gpu there is no problem