Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

多模态大模型推理问题。 #134

Open
waterpeople opened this issue Dec 9, 2024 · 2 comments
Open

多模态大模型推理问题。 #134

waterpeople opened this issue Dec 9, 2024 · 2 comments

Comments

@waterpeople
Copy link

我使用python来构建了多模态大模型(minicpm)推理的代码,
` rkllm_input = create_rkllm_input(RKLLMInputType.RKLLM_INPUT_MULTIMODAL,
prompt=prompt,
image_embed=image_embeddings)

    inference_start_time = time.time()
    
    run(handle, rkllm_input, infer_param, None)`

经过我的测试,即使我使用相同的prompt和image_embeddings推理,程序在运行一段时间也会报错,并且我无法解决这个bug。请问是什么问题?
我遇到的bug是这个:SystemError: null argument to internal routine
SystemError: null argument to internal routine
SystemError: null argument to internal routine
感谢你们的回复!!!

@waydong
Copy link
Collaborator

waydong commented Dec 11, 2024

hi,建议检查下是否是因为推理返回的text是空导致的此问题。

@waterpeople
Copy link
Author

hi,建议检查下是否是因为推理返回的text是空导致的此问题。

你好,我测试的时候把我的prompt和image_embedding都固定住了,重复的让模型进行推理。刚开始他还是能够成功输出回答,然后在1个小时左右,他就会报这个错误。所以这个是为什么?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants