langchain

langchain

使用源码部署

运行环境安装

使用conda

创建环境

conda create -n chatchat python=.9 

拉取源码

git clone .git

进入主目录

cd  Langchain-Chatchat/libs/chatchat-server/

配置环境变量

export CHATCHAT_ROOT=/parth/to/chatchat_data

初始化配置

python chatchat/cli.py init

运行后会在配置的环境变量目录中生成配置文件

basic_settings.yaml # 基本配置信息，包括数据目录、服务器配置等
kb_settings.yaml # 知识库相关配置项
model_settings.yaml # 模型相关配置项
prompt_settings.yaml # prompt 模板
tool_settings.yaml # 工具相关配置项

需要内网中其他设备访问需要修改·basic_settings.yaml 以下配置

# basic_settings.yaml 
# WEBUI 服务器地址
WEBUI_SERVER:
  host: 0.0.0.0
  port: 8501

可自定义模型加载平台，默认使用xinference

'xinference', 'ollama', 'oneapi', 'fastchat', 'openai', 'custom openai'

在model_settings.yaml 配置

  - platform_name: xinference
    platform_type: xinference
    api_base_url: http://127.0.0.1:9997/v1 # 修改为自定义的配置
    api_key: EMPTY
    api_proxy: ''
    api_concurrencies: 5
    auto_detect_model: true
    llm_models: []
    embed_models: []
    text2image_models: []
    image2text_models: []
    rerank_models: []
    speech2text_models: []
    text2speech_models: []

启动服务

python chatchat/cli.py start -a

langchain-chatchat启动后报错

2024-12-20 16:40:15.222 | ERROR    | chatchat.webui_pages.utils:get:64 - TypeError: error when get /tools: __init__() got an unexpected keyword argument 'proxies'
2024-12-20 16:40:15.221 | ERROR    | chatchat.webui_pages.utils:get:64 - TypeError: error when get /tools: __init__() got an unexpected keyword argument 'proxies'
2024-12-20 16:40:15.227 | ERROR    | chatchat.webui_pages.utils:get:64 - TypeError: error when get /tools: __init__() got an unexpected keyword argument 'proxies'
2024-12-20 16:40:15.21 | ERROR    | chatchat.webui_pages.utils:get:64 - TypeError: error when get /tools: __init__() got an unexpected keyword argument 'proxies'
2024-12-20 16:40:15.22 | ERROR    | chatchat.webui_pages.utils:get:64 - TypeError: error when get /tools: __init__() got an unexpected keyword argument 'proxies'
2024-12-20 16:40:15.22 | ERROR    | chatchat.webui_pages.utils:get:64 - TypeError: error when get /tools: __init__() got an unexpected keyword argument 'proxies'
2024-12-20 16:40:15.2 | ERROR    | chatchat.webui_pages.utils:to_json:2 - AttributeError: API未能返回正确的JSO。'oneType' object has no attribute 'json'
2024-12-20 16:40:15.2 | ERROR    | chatchat.webui_pages.utils:to_json:2 - AttributeError: API未能返回正确的JSO。'oneType' object has no attribute 'json'
2024-12-20 16:40:16.266 | ERROR    | chatchat.webui_pages.utils:get:64 - TypeError: error when get /tools: __init__() got an unexpected keyword argument 'proxies'
2024-12-20 16:40:16.270 | ERROR    | chatchat.webui_pages.utils:get:64 - TypeError: error when get /tools: __init__() got an unexpected keyword argument 'proxies'
2024-12-20 16:40:16.271 | ERROR    | chatchat.webui_pages.utils:get:64 - TypeError: error when get /tools: __init__() got an unexpected keyword argument 'proxies'
2024-12-20 16:40:16.275 | ERROR    | chatchat.webui_pages.utils:to_json:2 - AttributeError: API未能返回正确的JSO。'oneType' object has no attribute 'json'
2024-12-20 16:40:18.400 | ERROR    | chatchat.webui_pages.utils:get:64 - TypeError: error when get /tools: __init__() got an unexpected keyword argument 'proxies'
2024-12-20 16:40:18.406 | ERROR    | chatchat.webui_pages.utils:get:64 - TypeError: error when get /tools: __init__() got an unexpected keyword argument 'proxies'
2024-12-20 16:40:18.406 | ERROR    | chatchat.webui_pages.utils:get:64 - TypeError: error when get /tools: __init__() got an unexpected keyword argument 'proxies'
2024-12-20 16:40:18.407 | ERROR    | chatchat.webui_pages.utils:to_json:2 - AttributeError: API未能返回正确的JSO。'oneType' object has no attribute 'json'

httpx版本问题过高的问题

将httpx版本降级

pip install httpx==0.27.2

启动成功访问，访问服务http://127.0.0.1:8501

参考

.md

.md