GitXplorerGitXplorer
b

cartpole

public
1 stars
1 forks
0 issues

Commits

List of commits on branch master.
Unverified
e0df6e3af9480fee169b5e62e900cd9b44edd515

Changed the architecture of the kNN Agent class.

bbdura committed 7 years ago
Unverified
15a27326e06c63c790568832970e2f0ab7cd736b

Layed the foundations for the kNN algorithm.

bbdura committed 7 years ago
Unverified
8a6c26d241731bbf28ff17f5c68e834b07b30706

Explored the Genetic algorithm

bbdura committed 7 years ago
Unverified
28f5e3b1dff078ea9ea45a50b03f2398c931dca3

Added a README file.

bbdura committed 7 years ago
Unverified
2b324bf2817eb4933d89ffcdf373d2365f96391d

First performance.

bbdura committed 7 years ago
Unverified
2d7a76ee4806b812b970bf8ca2ffa239ddc10ffd

Some improvements.

bbdura committed 7 years ago

README

The README file for this repository.

CartPole

A simple project to try out some learning strategies on Open AI Gym's CartPole-v0 environment :

  • a solution based on genetic algorithm;
  • a k nearest-neighbors strategy.

Genetic Algorithm

The idea is simplistic: make a fixed-sized population of agents compete. At every generation, survivors are selected stochastically according to their fitness (in this case their overall reward), and mutate into the next generation.

An Agent receives information about its environment (the observation variable returned by the step() method of the environment), and makes a decision on the action to take.

In our case, and Agent's brain consists of a simple two-layer neural network, which is fed the observation output by the environment at the end of each step. The genetic algorithm aims at determining the best parameters for the neural network.

k-Nearest Neighbors