📁 配置文件更改: - 🔄 重命名 default_config.yaml → env.example - 📝 采用环境变量配置格式 - 🔑 支持9个主流中国LLM的API配置 - 🛡️ 更新.gitignore忽略.env文件 🚀 新增功能: - 📖 创建根目录README.md - ⚙️ 添加详细配置指南文档 - 🔧 更新安装和配置说明 - 🌟 完整的支持模型列表 ✨ 改进体验: - 🎯 清晰的环境变量配置流程 - 📋 各大厂商API密钥获取指南 - 🔗 便捷的配置文档链接 - 🛠️ 性能调优配置选项 这次更新让用户配置更加简单和安全!
ComfyUI-DeepSeek-Toolkit Technical Documentation
1. Project Introduction
ComfyUI-DeepSeek-Toolkit is a custom node package for ComfyUI that enables users to leverage powerful AI large language models (LLMs) from various Chinese providers, such as DeepSeek, Qwen, and others. The toolkit aims to make these advanced models accessible to a wider audience, even those with limited computational resources.
The project was inspired by the emergence of impressive LLMs like DeepSeek and Qwen. It seeks to bridge the gap between cutting-edge AI technology and everyday users by providing a lightweight and API-driven solution for integrating these models into ComfyUI workflows.
The mission of ComfyUI-DeepSeek-Toolkit is to empower developers and creatives to accomplish tasks that would typically require significant computational power on readily available hardware, such as older laptops. The project envisions a future where AI is democratized and accessible to all.
2. Functionality
This toolkit supports calling a diverse range of Chinese AI large language models, including:
- DeepSeek
- 通义千问 (Qwen)
- 豆包 (Doubao)
- 星火 (Spark)
- 智谱清言 (GLM)
- 月之暗面 (Moonshot)
- 百川 (Baichuan)
- MiniMax
- 阶跃星辰
For detailed instructions on how to call each model, please refer to the LLM API 调用指南(中国版).
The toolkit includes modules for:
- LLM Loading: Nodes for loading and configuring different LLMs.
- Image Generation: Nodes for generating images using LLMs.
- Image Understanding: Nodes for analyzing and understanding images using LLMs.
- Model Loading: Nodes for loading various models required for different tasks.
- OpenAI Compatible Loading: Nodes for loading models compatible with the OpenAI API.
- Image Preprocessing: Nodes for preprocessing images before feeding them into LLMs.
These modules can be seamlessly integrated into ComfyUI workflows, allowing users to create complex and customized AI-powered applications.
3. Technical Stack
- Programming Language: Python
- Dependencies:
- git+https://github.com/deepseek-ai/Janus.git
- torch
- numpy
- Pillow
- aiohttp
- transformers
The toolkit utilizes an API-centric approach to interact with the various LLMs. The API details, including base URLs and API key acquisition instructions, can be found in the LLM API 调用指南(中国版).
4. Target Audience
ComfyUI-DeepSeek-Toolkit is designed for:
- ComfyUI users: Those who want to integrate powerful LLMs into their workflows.
- AI developers: Those who want to experiment with and build applications using Chinese LLMs.
- Researchers: Those who want to study and analyze the capabilities of different LLMs.
- Creatives: Those who want to use AI to enhance their creative process.
The toolkit is suitable for users with a basic understanding of ComfyUI and Python. Familiarity with AI concepts and LLMs is helpful but not required.
5. Next Steps
The project roadmap includes the following planned features and improvements:
- Expanding support for more LLMs: Continuously adding support for new and emerging Chinese LLMs.
- Optimizing performance: Improving the efficiency and speed of the toolkit.
- Adding more pre-built workflows: Providing more ready-to-use workflows for common tasks.
- Improving documentation: Creating more comprehensive and user-friendly documentation.
- Adding more image processing nodes: Expanding the image processing capabilities of the toolkit.
6. Humanistic Conception
ComfyUI-DeepSeek-Toolkit is driven by a vision of democratizing AI and making it accessible to everyone. The project aims to empower developers and creatives, especially those with limited resources, to leverage the power of AI to create innovative solutions and express their creativity.
The project's humanistic conception is rooted in the belief that AI should be a tool for empowerment, not a source of inequality. By providing a lightweight and accessible solution for integrating powerful LLMs into ComfyUI workflows, ComfyUI-DeepSeek-Toolkit strives to make AI a more inclusive and equitable technology.