128 lines
2.5 KiB
Markdown
128 lines
2.5 KiB
Markdown
# Gemini Image Generation Research Notes
|
|
|
|
## Available Models
|
|
|
|
| Model | Use Case | Features |
|
|
|-------|----------|----------|
|
|
| `gemini-2.5-flash-image` | Fast, general image generation | Lower cost, faster |
|
|
| `gemini-3-pro-image-preview` | Professional asset production | Higher quality, 1K/2K/4K output |
|
|
|
|
## API Endpoint
|
|
|
|
```
|
|
POST https://generativelanguage.googleapis.com/v1beta/models/{model-id}:generateContent
|
|
```
|
|
|
|
## Request Format
|
|
|
|
### 关键：启用图像生成
|
|
|
|
必须在 `generationConfig` 中指定 `responseModalities`:
|
|
|
|
```json
|
|
{
|
|
"contents": [{
|
|
"parts": [
|
|
{"text": "Generate an image of a cat"}
|
|
]
|
|
}],
|
|
"generationConfig": {
|
|
"responseModalities": ["TEXT", "IMAGE"]
|
|
}
|
|
}
|
|
```
|
|
|
|
### 带图片输入的请求（图片编辑/参考）
|
|
|
|
```json
|
|
{
|
|
"contents": [{
|
|
"parts": [
|
|
{"text": "Edit this image to add a hat"},
|
|
{
|
|
"inline_data": {
|
|
"mime_type": "image/png",
|
|
"data": "base64_encoded_image_data"
|
|
}
|
|
}
|
|
]
|
|
}],
|
|
"generationConfig": {
|
|
"responseModalities": ["TEXT", "IMAGE"]
|
|
}
|
|
}
|
|
```
|
|
|
|
### Image Configuration
|
|
|
|
```json
|
|
{
|
|
"generationConfig": {
|
|
"responseModalities": ["TEXT", "IMAGE"],
|
|
"imageConfig": {
|
|
"aspectRatio": "16:9",
|
|
"imageSize": "2K"
|
|
}
|
|
}
|
|
}
|
|
```
|
|
|
|
支持的 aspectRatio: "1:1", "16:9", "9:16", "5:4", "4:5", "3:4", "4:3"
|
|
支持的 imageSize: "1K", "2K", "4K"
|
|
|
|
## Response Format
|
|
|
|
```json
|
|
{
|
|
"candidates": [{
|
|
"content": {
|
|
"parts": [
|
|
{"text": "Here is your generated image:"},
|
|
{
|
|
"inlineData": {
|
|
"mimeType": "image/png",
|
|
"data": "base64_encoded_image_data"
|
|
}
|
|
}
|
|
]
|
|
}
|
|
}]
|
|
}
|
|
```
|
|
|
|
## Input Modalities
|
|
|
|
1. **Text-to-Image**: 纯文本提示词
|
|
2. **Text-and-Image-to-Image**: 文本 + 参考图片
|
|
3. **Multi-Reference Images**: 最多 14 张参考图片
|
|
|
|
## Authentication
|
|
|
|
使用 API Key:
|
|
```
|
|
x-goog-api-key: YOUR_API_KEY
|
|
```
|
|
|
|
或 Bearer Token:
|
|
```
|
|
Authorization: Bearer YOUR_TOKEN
|
|
```
|
|
|
|
## Special Features
|
|
|
|
- **Thought Signatures**: 多轮对话保持推理上下文
|
|
- **SynthID**: 自动添加 AI 生成图片水印
|
|
- **Grounding with Google Search**: 可使用搜索验证事实
|
|
|
|
## Implementation Notes for ComfyUI-SimpleChat
|
|
|
|
1. 需要支持自定义 base_url（用户可能使用代理）
|
|
2. 需要处理 base64 图片编解码
|
|
3. 需要支持图片输入作为参考
|
|
4. 返回的图片需要转换为 ComfyUI tensor 格式
|
|
|
|
## Reference
|
|
|
|
- https://ai.google.dev/gemini-api/docs/image-generation
|
|
- https://ai.google.dev/gemini-api/docs/imagen
|