Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

lack of Ant-v2 task related #7

Open
im-Kitsch opened this issue Nov 8, 2023 · 6 comments
Open

lack of Ant-v2 task related #7

im-Kitsch opened this issue Nov 8, 2023 · 6 comments

Comments

@im-Kitsch
Copy link

Hello,

I am wondering learning results of Ant-v2's dataset, like ant-random-v0/2 ant-medium-v0/v2. I think it is not listed in d4RL original paper but it's supplemented in github later.

Do you have the interest to evaluate thoes ant-* environment? Cuz I get very strange result for ant, even ant-random gives great result. So I am curious to compare with your result.

Best,

@takuseno
Copy link
Owner

takuseno commented Nov 8, 2023

@im-Kitsch Hi, thanks for the issue. It takes long to benchmark all algorithms with Ant dataset. But, if you give me which algorithm you want me to test, I can prioritize it.

@im-Kitsch
Copy link
Author

Hi, thnks a lot for the kind replay. Personally I am interesting on AWAC or BCQ.

Thanks!

@takuseno
Copy link
Owner

takuseno commented Nov 8, 2023

Okay, I started BCQ benchmark with ant-x-v0 dataset first. I'll be back to you later once I get results.

@takuseno
Copy link
Owner

@im-Kitsch Sorry, it took time, but I've added BCQ results with ant-x-v0 datasets.
https://github.com/takuseno/d3rlpy-benchmarks/blob/main/d4rl_table.csv

@takuseno
Copy link
Owner

I've added v2 dataset results as well.

@im-Kitsch
Copy link
Author

cool, @takuseno , really thanks a lot, it's really helpful

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants