Merge branch 'main' of https://github.com/Janspiry/Palette-Image-to-I…

…mage-Diffusion-Models into main
Janspiry · Jun 1, 2022 · d8853b8 · d8853b8
2 parents ed29b1c + d1b9b01
commit d8853b8
Show file tree

Hide file tree

Showing 14 changed files with 14 additions and 7 deletions.
diff --git a/README.md b/README.md
@@ -23,18 +23,20 @@ There are some implementation details with paper descriptions:
 - [x] Multiple GPU Training (DDP)
 - [x] EMA
 - [x] Metrics (now for FID, IS)
-- [ ] Dataset (now for inpainting, uncropping)
+- [x] Dataset (now for inpainting, uncropping, colorization)
 
 ### Task
 
 I try to finish following tasks in order:
 - [x] Inpainting on [CelebaHQ](https://drive.google.com/drive/folders/1CjZAajyf-jIknskoTQ4CGvVkAigkhNWA?usp=sharing)🚀 (available)
-- [ ] Inpainting on Places2 with 128×128 centering mask🔥
+- [x] Inpainting on [Places2 with 128×128 centering mask](https://drive.google.com/drive/folders/1fLyFtrStfEtyrqwI0N_Xb_3idsf0gz0M?usp=sharing)🚀 (available)
 - [ ] Uncropping on Places2🔥 
 - [ ] Colorization on ImageNet val set 
 
 ## Results
 
+Due to the lack of computational resources, we reduced the model parameters, while it does not fully converge. It leaves a lot of room for optimization. However, we can feel the excellent performance of this method through the stage results.
+
 ### Visuals
 
 #### Celeba-HQ
@@ -46,13 +48,17 @@ Results with 200 epochs and 930K iterations, and the first 100 samples in [cente
 
 #### Places2 with 128×128 centering mask
 
-Current results with 8 epochs and 330K iterations.
+Results with 16 epochs and 660K iterations, and the several **picked** samples in [centering mask](https://drive.google.com/drive/folders/1XusKO0_M6GUfPG-FOlID0Xcp0SiexKNe?usp=sharing).
 
-| ![Process_Places365_test_00124460](misc//image//Process_Places365_test_00124460.jpg) |    ![Process_Places365_test_00278428](misc//image//Process_Places365_test_00278428.jpg)  |
-| ------------------------------------------------ | ---- |
+| ![Mask_Places365_test_00209019.jpg](misc//image//Mask_Places365_test_00209019.jpg) | ![Mask_Places365_test_00143399.jpg](misc//image//Mask_Places365_test_00143399.jpg) | ![Mask_Places365_test_00263905.jpg](misc//image//Mask_Places365_test_00263905.jpg) |  ![Mask_Places365_test_00144085.jpg](misc//image//Mask_Places365_test_00144085.jpg)    |
+| ------------------------------------------------------------ | ------------------------------------------------------------ | ------------------------------------------------------------ | ---- |
+| ![Out_Places365_test_00209019](misc//image//Out_Places365_test_00209019.jpg) | ![Out_Places365_test_00143399.jpg](misc//image//Out_Places365_test_00143399.jpg) | ![Out_Places365_test_00263905.jpg](misc//image//Out_Places365_test_00263905.jpg) | ![Out_Places365_test_00144085.jpg](misc//image//Out_Places365_test_00144085.jpg)    |
 
 #### Uncropping on Places2
 
+Results with 8 epochs and 330K iterations, and the several  **picked** samples in [uncropping](https://drive.google.com/drive/folders/1tC3B8ayaadhXAJrOCTrw15R8t84REPWJ?usp=sharing).
+| ![Process_Places365_test_00309553](misc//image//Process_Places365_test_00309553.jpg) |    ![Process_Places365_test_00042384](misc//image//Process_Places365_test_00042384.jpg)  |
+| ------------------------------------------------ | ---- |
 
 
 ### Metrics
@@ -61,20 +67,21 @@ Current results with 8 epochs and 330K iterations.
 | -------------------- | ----------- | -------- | ---- | -------------------- |
 | Inpainting with centering mask | Celeba-HQ | False | 5.7873 | 3.0705 |
 | Inpainting with irregular mask | Celeba-HQ | False | 5.4026 | 3.1221 |
-| Inpainting with centering mask | Places2 | True |  |  |
+| Inpainting with centering mask | Places2 | False |  |        |
 | Uncropping | Places2 | True |  |  |
 
 ## Usage
 ### Environment
 ```python
-pip install -r requirement.txt
+pip install -r requirements.txt
 ```
 
 ### Pre-trained Model
 
 | Dataset   | Task       | Iterations | URL                                                          |
 | --------- | ---------- | ---------- | ------------------------------------------------------------ |
 | Celeba-HQ | Inpainting | 930K       | [Google Drive](https://drive.google.com/drive/folders/13YZ2UAmGJ-b7DICr-FDAPM7gctreJEoH?usp=sharing) |
+| Places2   | Inpainting | 660K       | [Google Drive](https://drive.google.com/drive/folders/1Vz_HC0LcpV6yMLOd-SXyoaqJHtxyPBxZ?usp=sharing) |
 
 
 

diff --git a/misc/image/Mask_Places365_test_00143399.jpg b/misc/image/Mask_Places365_test_00143399.jpg
diff --git a/misc/image/Mask_Places365_test_00144085.jpg b/misc/image/Mask_Places365_test_00144085.jpg
diff --git a/misc/image/Mask_Places365_test_00209019.jpg b/misc/image/Mask_Places365_test_00209019.jpg
diff --git a/misc/image/Mask_Places365_test_00263905.jpg b/misc/image/Mask_Places365_test_00263905.jpg
diff --git a/misc/image/Out_Places365_test_00143399.jpg b/misc/image/Out_Places365_test_00143399.jpg
diff --git a/misc/image/Out_Places365_test_00144085.jpg b/misc/image/Out_Places365_test_00144085.jpg
diff --git a/misc/image/Out_Places365_test_00209019.jpg b/misc/image/Out_Places365_test_00209019.jpg
diff --git a/misc/image/Out_Places365_test_00263905.jpg b/misc/image/Out_Places365_test_00263905.jpg
diff --git a/misc/image/Process_Places365_test_00042384.jpg b/misc/image/Process_Places365_test_00042384.jpg
diff --git a/misc/image/Process_Places365_test_00124460.jpg b/misc/image/Process_Places365_test_00124460.jpg
diff --git a/misc/image/Process_Places365_test_00157365.jpg b/misc/image/Process_Places365_test_00157365.jpg
diff --git a/misc/image/Process_Places365_test_00278428.jpg b/misc/image/Process_Places365_test_00278428.jpg
diff --git a/misc/image/Process_Places365_test_00309553.jpg b/misc/image/Process_Places365_test_00309553.jpg