Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot reproduce the SOTA performance on ETTh2 dataset. #58

Open
kehuo opened this issue Dec 4, 2022 · 0 comments
Open

Cannot reproduce the SOTA performance on ETTh2 dataset. #58

kehuo opened this issue Dec 4, 2022 · 0 comments

Comments

@kehuo
Copy link

kehuo commented Dec 4, 2022

Hi,

Thanks for sharing those reproducible code and examples. However, I cannot reproduce the metrics recorded in the paper.

For example, as shown in the below Table 4 in the paper, for ETTh2 dataset, when the horizon is set to 720, MSE = 0.475, MAE = 0.488:
image

However, I ran the below command but cannot get such metrics:
[Command I ran]:
python run_ETTh.py --data ETTh2 --features M --seq_len 736 --label_len 720 --pred_len 720 --hidden-size 4 --stacks 1 --levels 5 --lr 1e-5 --batch_size 128 --dropout 0.5 --model_name etth2_M_I736_O720_lr1e-5_bs128_dp0.5_h4_s1l5

[Results I got]:
Final mean normed mse:1.0782,mae:0.7634

Could you please advice how to repro the Multi-variates forecasting performance on ETTh2 dataset?

Thanks a lot and look forward to your reply.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant