Skip to content

v0.0.6

Compare
Choose a tag to compare
@csunny csunny released this 21 May 10:12
· 2671 commits to main since this release

Multi llm model support:

  • model_adapter for load multi models
  • chat_adapter for chat with models.
    Supports multiple large language models, currently supporting Vicuna (7b, 13b), ChatGLM-6b (int4, int8)

多模型支持:

  • 新增Model Adapter 以及Chat Adapter, 后续可以通过实现adapter接入更多大模型
  • 只是库支持ChatGLM-6b