Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

本地进行qwen2-vl-2b-instruct推理,增加max_pixels,但是占用内存依然不变 #1336

Open
hm123450 opened this issue Dec 13, 2024 · 0 comments

Comments

@hm123450
Copy link

hm123450 commented Dec 13, 2024

hellohello,我想问个问题,我在本地进行qwen2-vl-2b-instruct的多图推理,我把max_picels设置成3000x28x28之后,占用内存11g(我用的是3090)。但是回答的很不好,之后我想着显存还够,可以继续增大。于是我把3000改成5000,但是占用内存依然不变,而且回答结果也不变,这是啥原因呀?好奇怪,因为我图像的分辨率很高可能有10000x28x28那样,按理说应该会显存会继续增大,并且回答的会更好呀?
8f056643390ef9a01caf94a6e20144a
我用的是jupyterlab。我不太懂这个问题的可能原因,有没有人可以帮帮我,非常感谢。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant