服务部署

k8s中部署应用

联系运维部署k8s基础环境（包括CoreDNS和NFS动态持久化挂载）
手动按照以下命令进行安装

#创建并进入工作目录
sudo mkdir -p /home/deploy && sudo chmod 777 /home/deploy && cd /home/deploy
#拉取最新部署资源
git clone https://gitee.com/kl-large-model-platform/deploy/k8s-resource-large-model.git
#部署应用服务
cd k8s-resource-large-model && sh deploy.sh

服务手动配置

java-media

#修改底层使用的阿启视地址
kubectl edit deployments.apps java-media
...
        - name: aqs.apiServer
          value: http://192.168.2.116:9882
...

java-storage

#修改文件服务对外暴露的下载文件基础路径
kubectl edit deployments.apps java-storage
...
       - name: magic.storage.application.external-url
          value: http://10.10.8.3:32300/storage
...

research-lm-video-server

该服务连接mysql时默认密码太复杂不支持，所以手动创建一个专属账号

#创建用户
CREATE USER 'lm_video'@'%' IDENTIFIED WITH mysql_native_password BY 'PassW0rd';
#授权用户数据库权限
GRANT ALL PRIVILEGES ON *.* TO 'lm_video'@'%';

该服务连接mysql时默认密码太复杂不支持，所以手动创建一个专属账号还需手动创建large_model_alarm数据库从其他环境参考复制结构 nacos手动增加以下配置

Data ID：video_server
Group：DEFAULT_GROUP
配置格式：json

{
  "config": {
    "http": {
      "port": 9098,
      "thread_num": 20
    },
    "grpc": {
      "port": 5000
    },
    "video_service": {
      "max_decode_num": 40,
      "model_num": 1,
      "models": [
        "koala-mm"
      ],
      "koala-mm": {
        "rpc_address": "192.168.2.59:50052"
      }
    },
    "repository": {
      "connection": "lm_video:PassW0rd@common-store-sql-mysql:3306/large_model_alarm",
      "file_store_url": "http://java-storage:8080/storage/api/v1/files",
      "file_store": {
        "store": "http://java-storage:8080/storage/api/v1/files",
        "remove": "http://java-storage:8080/storage/api/v1/files/delete"
      }
    },
    "logger": {
      "level": "debug",
      "size": 500,
      "count": 10,
      "error_count": 5
    }
  }
}

research-data-vista-plugin-server

nacos手动增加以下配置

Data ID：data_vista
Group：DEFAULT_GROUP
配置格式：json

{
  "sql_model": "sqlcoder",
  "db_name": "large_model_alarm",
  "db_user": "root",
  "db_password": "Koala_MySQL#20Xx..A..",
  "db_host": "common-store-sql-mysql",
  "db_port": 3306,
  "use_table": [
    "kl_lm_alarm"
  ]
}

research-text-task-dispatcher-server

nacos手动增加以下配置

Data ID：assistants
Group：DEFAULT_GROUP
配置格式：json

{
  "tools": [
    "data_vista",
    "docx_generator"
  ],
  "intent_model": "gpt-3.5-turbo-1106",
  "back_model": [
    "gpt-3.5-turbo-1106",
    "ernie-bot-turbo",
    "gpt-3.5-turbo-16k",
    "koala-mm",
    "ernie-bot-4"
  ]
}

research-docx-generator-plugin-server

nacos手动增加以下配置

Data ID：docx_generator
Group：DEFAULT_GROUP
配置格式：json

{
  "database": "mysql+pymysql://root:Koala_MySQL#20Xx..A..@common-store-sql-mysql:3306/large_model_alarm",
  "file_store": {
    "store": "http://java-storage:8080/storage/api/v1/files",
    "remove": "http://java-storage:8080/storage/api/v1/files/delete"
  },
  "solution_model": "ernie-bot-turbo",
  "back_model": [
    "gpt-3.5-turbo-1106",
    "ernie-bot-turbo",
    "gpt-3.5-turbo-16k",
    "koala-mm",
    "ernie-bot-4"
  ]
}