Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Training from scratch (200k iters + 100k iters) doesn't achieve the reported performance (PSNR 35.46) with GoPro #18

Open
ohjinjin opened this issue Apr 24, 2024 · 2 comments

Comments

@ohjinjin
Copy link

ohjinjin commented Apr 24, 2024

Hello, thank you for your good research first of all.

I was trying to reproduce the performance reported in your paper with SCER-GoPro dataset that you shared as a link.
(Before I started training from scratch, I had checked that your pre-trained weights gave me PSNR 35.44.
I thought this difference was not that big.)

Since I trained by myself with SCER-GoPro dataset and the code implementation here, total number of iterations was set as 200k which was not equal to the explanation in your paper. (The paper said total num of iter was 300k). Hence I thought this inconsistency was from that difference.
Thus I proceeded to train an additional 100k iters again, however, the performance became lower than that of 200k iter.

Is it because of issues from loading the resume training or should I have to modify some part of the experimental setting in code implementation to obtain the same performance?
Result performance is like below:

psnr 35.46 ssim 0.972 at 200K iter
psnr: 34.4930 ssim: 0.9662 at 200K + 100K iter

It would be really appreciated if you answer my question!

@ohjinjin
Copy link
Author

ohjinjin commented Jun 5, 2024

I figured out that i made a mistake about setting batchsize and the number of gpus. Thanks!

@shkids
Copy link

shkids commented Nov 5, 2024

hi, @ohjinjin
How did you set up yml? If you're trying to train, you'll need to run the test after 258 iterations, depending on your setup. However, unlike the settings, there is a problem where the test starts as soon as iter rotates 8 times.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants