0.0.1a

[MeFredFeng]

No description provided.

[MeFredFeng]

This pull request introduces several important updates to the project, including new environment setup files, improved implementation of Policy and Value Iteration algorithms, and enhanced IDE configuration for development. The main changes are grouped below by theme.

Environment Setup:

• Added a new environment_mac_mod.yml file to specify Python and package dependencies for the project, making it easier to set up the development environment on macOS.

IDE Configuration:

• Updated .idea/.gitignore to ignore default IDE files and folders, reducing noise from editor-specific artifacts in version control.

Policy Iteration Algorithm Improvements (Solvers/Policy_Iteration.py):

• Implemented the policy improvement step in train_episode by selecting the best action using one-step lookahead and updating the policy accordingly.
• Added a matrix-based policy evaluation method in policy_eval, constructing transition and reward matrices and solving for state values using linear algebra.

Value Iteration Algorithm Improvements (Solvers/Value_Iteration.py):

• Implemented value updates in train_episode using one-step lookahead and selecting the best action value for each state.
• Improved the policy function to select the best action based on computed values in policy_fn.
• Enhanced prioritized sweeping in train_episode by updating the priority queue based on value changes and performing targeted value updates.