Skip to content

Commit

Permalink
Update Places2 Inpainting
Browse files Browse the repository at this point in the history
  • Loading branch information
Janspiry committed May 13, 2022
1 parent 059c314 commit 7b0d51b
Show file tree
Hide file tree
Showing 12 changed files with 11 additions and 6 deletions.
17 changes: 11 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -23,13 +23,13 @@ There are some implementation details with paper descriptions:
- [x] Multiple GPU Training (DDP)
- [x] EMA
- [x] Metrics (now for FID, IS)
- [ ] Dataset (now for inpainting, uncropping)
- [ ] Dataset (now for inpainting, uncropping, colorization)

### Task

I try to finish following tasks in order:
- [x] Inpainting on [CelebaHQ](https://drive.google.com/drive/folders/1CjZAajyf-jIknskoTQ4CGvVkAigkhNWA?usp=sharing)🚀 (available)
- [ ] Inpainting on Places2 with 128×128 centering mask🔥
- [x] Inpainting on [Places2 with 128×128 centering mask](https://drive.google.com/drive/folders/1fLyFtrStfEtyrqwI0N_Xb_3idsf0gz0M?usp=sharing)🚀 (available)
- [ ] Uncropping on Places2🔥
- [ ] Colorization on ImageNet val set

Expand All @@ -46,13 +46,17 @@ Results with 200 epochs and 930K iterations, and the first 100 samples in [cente

#### Places2 with 128×128 centering mask

Current results with 8 epochs and 330K iterations.
Results with 16 epochs and 660K iterations, and the several **picked** samples in [centering mask](https://drive.google.com/drive/folders/1XusKO0_M6GUfPG-FOlID0Xcp0SiexKNe?usp=sharing).

| ![Process_Places365_test_00124460](misc//image//Process_Places365_test_00124460.jpg) | ![Process_Places365_test_00278428](misc//image//Process_Places365_test_00278428.jpg) |
| ------------------------------------------------ | ---- |
| ![Mask_Places365_test_00209019.jpg](misc//image//Mask_Places365_test_00209019.jpg) | ![Mask_Places365_test_00143399.jpg](misc//image//Mask_Places365_test_00143399.jpg) | ![Mask_Places365_test_00263905.jpg](misc//image//Mask_Places365_test_00263905.jpg) |
| ------------------------------------------------------------ | ------------------------------------------------------------ | ------------------------------------------------------------ |
| ![Out_Places365_test_00209019](misc//image//Out_Places365_test_00209019.jpg) | ![Out_Places365_test_00143399.jpg](misc//image//Out_Places365_test_00143399.jpg) | ![Out_Places365_test_00263905.jpg](misc//image//Out_Places365_test_00263905.jpg) |

#### Uncropping on Places2

Results with 8 epochs and 330K iterations, and the several **picked** samples in [uncropping](https://drive.google.com/drive/folders/1tC3B8ayaadhXAJrOCTrw15R8t84REPWJ?usp=sharing).
| ![Process_Places365_test_00309553](misc//image//Process_Places365_test_00309553.jpg) | ![Process_Places365_test_00042384](misc//image//Process_Places365_test_00042384.jpg) |
| ------------------------------------------------ | ---- |


### Metrics
Expand All @@ -61,7 +65,7 @@ Current results with 8 epochs and 330K iterations.
| -------------------- | ----------- | -------- | ---- | -------------------- |
| Inpainting with centering mask | Celeba-HQ | False | 5.7873 | 3.0705 |
| Inpainting with irregular mask | Celeba-HQ | False | 5.4026 | 3.1221 |
| Inpainting with centering mask | Places2 | True | | |
| Inpainting with centering mask | Places2 | False | | |
| Uncropping | Places2 | True | | |

## Usage
Expand All @@ -75,6 +79,7 @@ pip install -r requirement.txt
| Dataset | Task | Iterations | URL |
| --------- | ---------- | ---------- | ------------------------------------------------------------ |
| Celeba-HQ | Inpainting | 930K | [Google Drive](https://drive.google.com/drive/folders/13YZ2UAmGJ-b7DICr-FDAPM7gctreJEoH?usp=sharing) |
| Places2 | Inpainting | 660K | [Google Drive](https://drive.google.com/drive/folders/1Vz_HC0LcpV6yMLOd-SXyoaqJHtxyPBxZ?usp=sharing) |



Expand Down
Binary file added misc/image/Mask_Places365_test_00143399.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added misc/image/Mask_Places365_test_00209019.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added misc/image/Mask_Places365_test_00263905.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added misc/image/Out_Places365_test_00143399.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added misc/image/Out_Places365_test_00209019.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added misc/image/Out_Places365_test_00263905.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added misc/image/Process_Places365_test_00042384.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file removed misc/image/Process_Places365_test_00124460.jpg
Binary file not shown.
Binary file removed misc/image/Process_Places365_test_00157365.jpg
Binary file not shown.
Binary file removed misc/image/Process_Places365_test_00278428.jpg
Binary file not shown.
Binary file added misc/image/Process_Places365_test_00309553.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 7b0d51b

Please sign in to comment.