| [2024-10-29 05:11:48,675][__main__][INFO] - Using GPU for training. Main device : cuda:2 | |
| [2024-10-29 05:11:48,675][__main__][INFO] - Using multiple GPUs : [2, 3, 0, 1] | |
| [2024-10-29 05:11:53,947][__main__][INFO] - PSF shape : torch.Size([1, 135, 240, 3]) | |
| [2024-10-29 05:11:53,967][__main__][INFO] - PSF min : 0.0 | |
| [2024-10-29 05:11:53,983][__main__][INFO] - PSF max : 0.12337537109851837 | |
| [2024-10-29 05:11:53,983][__main__][INFO] - PSF dtype : torch.float32 | |
| [2024-10-29 05:11:54,014][__main__][INFO] - PSF norm : 1.7320507764816284 | |
| [2024-10-29 05:11:54,014][__main__][INFO] - Reconstruction a few images with ADMM... | |
| [2024-10-29 05:11:54,605][__main__][INFO] - Cropped shape : (135, 240, 3) | |
| [2024-10-29 05:11:56,059][__main__][INFO] - Train test size : 24000 | |
| [2024-10-29 05:11:56,059][__main__][INFO] - Test test size : 999 | |
| [2024-10-29 05:11:56,176][__main__][INFO] - Training model with 8102358 parameters | |
| [2024-10-29 05:11:56,177][__main__][INFO] - -- Pre-process model with 4051168 parameters | |
| [2024-10-29 05:11:56,178][__main__][INFO] - -- Post-process model with 4051168 parameters | |
| [2024-10-29 05:11:56,179][__main__][INFO] - Setup time : 0.11934375762939453 s | |
| [2024-10-29 05:11:56,179][__main__][INFO] - PSF shape : torch.Size([1, 135, 240, 3]) | |
| [2024-10-29 05:11:56,179][__main__][INFO] - Results saved in /root/LenslessPiCam/outputs/2024-10-29/05-11-42 | |
| [2024-10-29 05:13:33,749][__main__][INFO] - Epoch 0 with learning rate [1e-05] | |
| [2024-10-29 06:20:19,857][__main__][INFO] - loss : 0.453468582108618 | |
| [2024-10-29 06:21:57,570][__main__][INFO] - Epoch 1 with learning rate [3.1622776601683795e-05] | |
| [2024-10-29 07:28:35,353][__main__][INFO] - loss : 0.3798517593493059 | |
| [2024-10-29 07:30:13,125][__main__][INFO] - Epoch 2 with learning rate [0.0001] | |
| [2024-10-29 08:36:56,418][__main__][INFO] - loss : 0.3466011656473083 | |
| [2024-10-29 08:38:35,007][__main__][INFO] - Epoch 3 with learning rate [0.0001] | |
| [2024-10-29 09:44:51,432][__main__][INFO] - loss : 0.2878445716351267 | |
| [2024-10-29 09:46:29,168][__main__][INFO] - Epoch 4 with learning rate [0.0001] | |
| [2024-10-29 10:52:48,789][__main__][INFO] - loss : 0.2603186270172411 | |
| [2024-10-29 10:54:28,046][__main__][INFO] - Epoch 5 with learning rate [0.0001] | |
| [2024-10-29 12:00:59,577][__main__][INFO] - loss : 0.2432698901618522 | |
| [2024-10-29 12:02:38,782][__main__][INFO] - Epoch 6 with learning rate [0.0001] | |
| [2024-10-29 13:09:27,276][__main__][INFO] - loss : 0.23107604591300085 | |
| [2024-10-29 13:11:08,710][__main__][INFO] - Epoch 7 with learning rate [0.0001] | |
| [2024-10-29 14:17:04,064][__main__][INFO] - loss : 0.22168368745719383 | |
| [2024-10-29 14:18:38,168][__main__][INFO] - Epoch 8 with learning rate [0.0001] | |
| [2024-10-29 15:20:44,629][__main__][INFO] - loss : 0.213853502400219 | |
| [2024-10-29 15:22:18,582][__main__][INFO] - Epoch 9 with learning rate [0.0001] | |
| [2024-10-29 16:24:46,180][__main__][INFO] - loss : 0.20762487530956641 | |
| [2024-10-29 16:26:18,446][__main__][INFO] - Epoch 10 with learning rate [0.0001] | |
| [2024-10-29 17:28:55,052][__main__][INFO] - loss : 0.20199103643124228 | |
| [2024-10-29 17:30:25,271][__main__][INFO] - Epoch 11 with learning rate [0.0001] | |
| [2024-10-29 18:32:44,931][__main__][INFO] - loss : 0.19691736856723818 | |
| [2024-10-29 18:34:18,026][__main__][INFO] - Epoch 12 with learning rate [0.0001] | |
| [2024-10-29 19:36:35,152][__main__][INFO] - loss : 0.19323563963298937 | |
| [2024-10-29 19:38:07,609][__main__][INFO] - Epoch 13 with learning rate [0.0001] | |
| [2024-10-29 20:40:38,613][__main__][INFO] - loss : 0.1898163434192543 | |
| [2024-10-29 20:42:11,446][__main__][INFO] - Epoch 14 with learning rate [0.0001] | |
| [2024-10-29 21:44:15,779][__main__][INFO] - loss : 0.18664568219706434 | |
| [2024-10-29 21:45:48,333][__main__][INFO] - Epoch 15 with learning rate [0.0001] | |
| [2024-10-29 22:48:12,778][__main__][INFO] - loss : 0.18379510873928664 | |
| [2024-10-29 22:49:45,475][__main__][INFO] - Epoch 16 with learning rate [0.0001] | |
| [2024-10-29 23:52:11,550][__main__][INFO] - loss : 0.18137754028911357 | |
| [2024-10-29 23:53:43,567][__main__][INFO] - Epoch 17 with learning rate [0.0001] | |
| [2024-10-30 00:50:56,641][__main__][INFO] - loss : 0.17901468442132057 | |
| [2024-10-30 00:52:24,993][__main__][INFO] - Epoch 18 with learning rate [0.0001] | |
| [2024-10-30 01:46:20,401][__main__][INFO] - loss : 0.1765873846163358 | |
| [2024-10-30 01:47:49,543][__main__][INFO] - Epoch 19 with learning rate [0.0001] | |
| [2024-10-30 02:41:42,800][__main__][INFO] - loss : 0.17458244168137457 | |
| [2024-10-30 02:43:12,417][__main__][INFO] - Epoch 20 with learning rate [0.0001] | |
| [2024-10-30 03:37:33,269][__main__][INFO] - loss : 0.17257165982077569 | |
| [2024-10-30 03:39:03,287][__main__][INFO] - Epoch 21 with learning rate [0.0001] | |
| [2024-10-30 04:33:23,429][__main__][INFO] - loss : 0.17095692262301804 | |
| [2024-10-30 04:34:53,208][__main__][INFO] - Epoch 22 with learning rate [0.0001] | |
| [2024-10-30 05:29:01,239][__main__][INFO] - loss : 0.16924278690914293 | |
| [2024-10-30 05:30:30,270][__main__][INFO] - Epoch 23 with learning rate [0.0001] | |
| [2024-10-30 06:24:47,735][__main__][INFO] - loss : 0.1675586676709344 | |
| [2024-10-30 06:26:16,802][__main__][INFO] - Epoch 24 with learning rate [0.0001] | |
| [2024-10-30 07:20:14,315][__main__][INFO] - loss : 0.16611833019182073 | |
| [2024-10-30 07:21:44,657][__main__][INFO] - Train time [hour] : 26.163040837777984 h | |
| [2024-10-30 07:21:44,657][__main__][INFO] - Results saved in /root/LenslessPiCam/outputs/2024-10-29/05-11-42 | |