Scholarship Requires Planning

Gantter Project

1. 1. Code Refractory and Scratch of Classes Design
   1. Point of completion: Code refactored and classes design sketch
   2. Deadline: 4d - 3/1/2015
   3. Description: Refactor the code of the open source pacman in order to facilitate the development and the understanding of anyone who look at this code, also, a simple UML classes design can guide the next steps of the project.

   
   

   2. Connectors
   1. Point of completion: java-connection and LispConnection classes working good
   2. Deadline: 8d - 3/9/2015
   3. Description: This classes will encapsulate all the communication and changes in data format between the java and lisp programs.

   
   

   3. Feature and Reward Extractor
   1. Point of completion: FeatureExtractor class and getLastReward() method working good.
   2. Deadline: 15d - 3/24/2015
   3. Description: The FeatureExtractor.java class will calculate and provide a list of features in a specific state with a specific action to the QAgent in Lisp. For example, the number of ghosts in 1 step of distance. The method getLastReward() provide the difference in the pacman score after last action.

   
   

   4. Q-Learning Agent
   1. Point of completion: Q-Learning Algorithm controlling the Pacman.
   2. Deadline: 15d - 4/8/2015
   3. Description: This phase is the core of the project, here I am going to implement the Q-Learning Algorithm.

   
   

   5. Game Design Improvement and/or Search Algorithms to Improve Distance Features 
   1. Point of completion: A version with the game design improved
   2. Deadline: 10d - 4/18/2015
   3. Description: Search Algorithms to Improve Distance Features in the pacman agent and/or Improve Ghosts AI and/or add new levels in the game and/or new audio or graphic features.

   
   

   6. Statistics
   1. Point of completion: Complete statistic evaluation comparing the random machine, the human player and the q learning algorithm evolution.
   2. Deadline: 5d - 4/23/2015
   3. Description: If the LRT Algorithm is good I will implement some chase and scattering techniques to the ghosts and make the game more interesting, if it is not good, I will see what is wrong and make changes.

   
   

   7. Paper
   1. Point of completion: Project Paper Complete
   2. Deadline: 11d - 5/5/2015
   3. Description: This paper is going to describe all the algorithms used in the project.