Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about MASAC Algorithm in XuanCe and Discrete Action Space Support #65

Open
SunSkyLH opened this issue Dec 3, 2024 · 1 comment
Labels
enhancement New feature or request help wanted Extra attention is needed question Further information is requested

Comments

@SunSkyLH
Copy link

SunSkyLH commented Dec 3, 2024

Dear XuanCe Development Team,

Hello!

Thank you for your contributions to the field of multi-agent reinforcement learning! I noticed that the MASAC algorithm in the XuanCe project references the paper titled "Decomposed Soft Actor Critic Method for Cooperative Multi-Agent Reinforcement Learning". This paper explicitly states that its proposed mSAC method supports discrete action spaces. However, it seems that the current implementation of MASAC in XuanCe only supports continuous action spaces.

Could you kindly clarify whether this is due to technical considerations or development priorities? Are there any plans to support discrete action spaces in the future? I am very interested in this topic and look forward to your response.

Best regards!

@wenzhangliu
Copy link
Collaborator

Thank you for your interest in XuanCe! During our development of the SAC algorithm, we discovered significant differences between its implementation in discrete action spaces and continuous action spaces. As a result, the development of MASAC for discrete action spaces has been delayed. However, we plan to support this feature very soon. Please stay tuned, and thank you for your patience!

@wenzhangliu wenzhangliu added enhancement New feature or request help wanted Extra attention is needed question Further information is requested labels Jan 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants