We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
我使用python来构建了多模态大模型(minicpm)推理的代码, ` rkllm_input = create_rkllm_input(RKLLMInputType.RKLLM_INPUT_MULTIMODAL, prompt=prompt, image_embed=image_embeddings)
inference_start_time = time.time() run(handle, rkllm_input, infer_param, None)`
经过我的测试,即使我使用相同的prompt和image_embeddings推理,程序在运行一段时间也会报错,并且我无法解决这个bug。请问是什么问题? 我遇到的bug是这个:SystemError: null argument to internal routine SystemError: null argument to internal routine SystemError: null argument to internal routine 感谢你们的回复!!!
The text was updated successfully, but these errors were encountered:
hi,建议检查下是否是因为推理返回的text是空导致的此问题。
Sorry, something went wrong.
你好,我测试的时候把我的prompt和image_embedding都固定住了,重复的让模型进行推理。刚开始他还是能够成功输出回答,然后在1个小时左右,他就会报这个错误。所以这个是为什么?
No branches or pull requests
我使用python来构建了多模态大模型(minicpm)推理的代码,
` rkllm_input = create_rkllm_input(RKLLMInputType.RKLLM_INPUT_MULTIMODAL,
prompt=prompt,
image_embed=image_embeddings)
经过我的测试,即使我使用相同的prompt和image_embeddings推理,程序在运行一段时间也会报错,并且我无法解决这个bug。请问是什么问题?
我遇到的bug是这个:SystemError: null argument to internal routine
SystemError: null argument to internal routine
SystemError: null argument to internal routine
感谢你们的回复!!!
The text was updated successfully, but these errors were encountered: