## ENใ€Training text to image model ### iใ€Base on diffusers format The format of dataset can be set as diffuser format. If using the diffusers format dataset for training. ``` ๐Ÿ“ฆ project/ โ”œโ”€โ”€ ๐Ÿ“‚ datasets/ โ”‚ โ”œโ”€โ”€ ๐Ÿ“‚ diffusers_datasets/ โ”‚ โ”œโ”€โ”€ ๐Ÿ“‚ train/ โ”‚ โ”‚ โ”œโ”€โ”€ ๐Ÿ“„ 00000001.jpg โ”‚ โ”‚ โ”œโ”€โ”€ ๐Ÿ“„ 00000002.jpg โ”‚ โ”‚ โ””โ”€โ”€ ๐Ÿ“„ ..... โ”‚ โ””โ”€โ”€ ๐Ÿ“„ metadata.jsonl ``` Then, set scripts/train_t2i.sh. ``` export DATASET_NAME="datasets/diffusers_datasets/" ... train_data_format="diffusers" ``` Then, we run scripts/train_t2i.sh. ```sh sh scripts/train_t2i.sh ``` ### iiใ€Base on internal dataset If using the internal dataset for training, you need to format the dataset firstly. You need to arrange the dataset in this format. ``` ๐Ÿ“ฆ project/ โ”œโ”€โ”€ ๐Ÿ“‚ datasets/ โ”‚ โ”œโ”€โ”€ ๐Ÿ“‚ internal_datasets/ โ”‚ โ”œโ”€โ”€ ๐Ÿ“‚ train/ โ”‚ โ”‚ โ”œโ”€โ”€ ๐Ÿ“„ 00000001.jpg โ”‚ โ”‚ โ”œโ”€โ”€ ๐Ÿ“„ 00000002.jpg โ”‚ โ”‚ โ””โ”€โ”€ ๐Ÿ“„ ..... โ”‚ โ””โ”€โ”€ ๐Ÿ“„ json_of_internal_datasets.json ``` The json_of_internal_datasets.json is a standard JSON file, as shown in below: ```json [ { "file_path": "train/00000001.jpg", "text": "A group of young men in suits and sunglasses are walking down a city street.", "type": "image" }, { "file_path": "train/00000002.jpg", "text": "A notepad with a drawing of a woman on it.", "type": "image" } ..... ] ``` The file_path in the json needs to be set as relative path. Then, set scripts/train_t2i.sh. ``` export DATASET_NAME="datasets/internal_datasets/" export DATASET_META_NAME="datasets/internal_datasets/json_of_internal_datasets.json" ... train_data_format="normal" ``` Then, we run scripts/train_t2i.sh. ```sh sh scripts/train_t2i.sh ``` ## CNใ€่ฎญ็ปƒๅŸบ็ก€ๆ–‡็”Ÿๅ›พๆจกๅž‹ ### iใ€ๅŸบไบŽdiffusersๆ ผๅผ ๆ•ฐๆฎ้›†็š„ๆ ผๅผๅฏไปฅ่ฎพ็ฝฎไธบdiffusersๆ ผๅผใ€‚ ``` ๐Ÿ“ฆ project/ โ”œโ”€โ”€ ๐Ÿ“‚ datasets/ โ”‚ โ”œโ”€โ”€ ๐Ÿ“‚ diffusers_datasets/ โ”‚ โ”œโ”€โ”€ ๐Ÿ“‚ train/ โ”‚ โ”‚ โ”œโ”€โ”€ ๐Ÿ“„ 00000001.jpg โ”‚ โ”‚ โ”œโ”€โ”€ ๐Ÿ“„ 00000002.jpg โ”‚ โ”‚ โ””โ”€โ”€ ๐Ÿ“„ ..... โ”‚ โ””โ”€โ”€ ๐Ÿ“„ metadata.jsonl ``` ็„ถๅŽ๏ผŒ่ฟ›ๅ…ฅscripts/train_t2i.sh่ฟ›่กŒ่ฎพ็ฝฎใ€‚ ``` export DATASET_NAME="datasets/diffusers_datasets/" ... train_data_format="diffusers" ``` ๆœ€ๅŽ่ฟ่กŒscripts/train_t2i.shใ€‚ ```sh sh scripts/train_t2i.sh ``` ### iiใ€ๅŸบไบŽ่‡ชๅปบๆ•ฐๆฎ้›† ๅฆ‚ๆžœไฝฟ็”จ่‡ชๅปบๆ•ฐๆฎ้›†่ฟ›่กŒ่ฎญ็ปƒ๏ผŒๅˆ™้œ€่ฆ้ฆ–ๅ…ˆๆ ผๅผๅŒ–ๆ•ฐๆฎ้›†ใ€‚ ๆ‚จ้œ€่ฆไปฅ่ฟ™็งๆ ผๅผๆŽ’ๅˆ—ๆ•ฐๆฎ้›†ใ€‚ ``` ๐Ÿ“ฆ project/ โ”œโ”€โ”€ ๐Ÿ“‚ datasets/ โ”‚ โ”œโ”€โ”€ ๐Ÿ“‚ internal_datasets/ โ”‚ โ”œโ”€โ”€ ๐Ÿ“‚ train/ โ”‚ โ”‚ โ”œโ”€โ”€ ๐Ÿ“„ 00000001.jpg โ”‚ โ”‚ โ”œโ”€โ”€ ๐Ÿ“„ 00000002.jpg โ”‚ โ”‚ โ””โ”€โ”€ ๐Ÿ“„ ..... โ”‚ โ””โ”€โ”€ ๐Ÿ“„ json_of_internal_datasets.json ``` json_of_internal_datasets.jsonๆ˜ฏไธ€ไธชๆ ‡ๅ‡†็š„jsonๆ–‡ไปถ๏ผŒๅฆ‚ไธ‹ๆ‰€็คบ๏ผš ```json [ { "file_path": "train/00000001.jpg", "text": "A group of young men in suits and sunglasses are walking down a city street.", "type": "image" }, { "file_path": "train/00000002.jpg", "text": "A notepad with a drawing of a woman on it.", "type": "image" } ..... ] ``` jsonไธญ็š„file_path้œ€่ฆ่ฎพ็ฝฎไธบ็›ธๅฏน่ทฏๅพ„ใ€‚ ็„ถๅŽ๏ผŒ่ฟ›ๅ…ฅscripts/train_t2i.sh่ฟ›่กŒ่ฎพ็ฝฎใ€‚ ``` export DATASET_NAME="datasets/internal_datasets/" export DATASET_META_NAME="datasets/internal_datasets/json_of_internal_datasets.json" ... train_data_format="normal" ``` ๆœ€ๅŽ่ฟ่กŒscripts/train_t2i.shใ€‚ ```sh sh scripts/train_t2i.sh ```