MHaurel commited on
Commit
c72c3c9
1 Parent(s): e220de1

Push agent to the Hub

Browse files
Files changed (4) hide show
  1. README.md +40 -16
  2. model.pt +3 -0
  3. replay.mp4 +0 -0
  4. results.json +1 -1
README.md CHANGED
@@ -1,10 +1,11 @@
1
  ---
2
- library_name: stable-baselines3
3
  tags:
4
  - LunarLander-v2
 
5
  - deep-reinforcement-learning
6
  - reinforcement-learning
7
- - stable-baselines3
 
8
  model-index:
9
  - name: PPO
10
  results:
@@ -16,22 +17,45 @@ model-index:
16
  type: LunarLander-v2
17
  metrics:
18
  - type: mean_reward
19
- value: 273.87 +/- 21.93
20
  name: mean_reward
21
  verified: false
22
  ---
23
 
24
- # **PPO** Agent playing **LunarLander-v2**
25
- This is a trained model of a **PPO** agent playing **LunarLander-v2**
26
- using the [stable-baselines3 library](https://github.com/DLR-RM/stable-baselines3).
27
 
28
- ## Usage (with Stable-baselines3)
29
- TODO: Add your code
30
-
31
-
32
- ```python
33
- from stable_baselines3 import ...
34
- from huggingface_sb3 import load_from_hub
35
-
36
- ...
37
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
 
2
  tags:
3
  - LunarLander-v2
4
+ - ppo
5
  - deep-reinforcement-learning
6
  - reinforcement-learning
7
+ - custom-implementation
8
+ - deep-rl-course
9
  model-index:
10
  - name: PPO
11
  results:
 
17
  type: LunarLander-v2
18
  metrics:
19
  - type: mean_reward
20
+ value: -161.43 +/- 68.51
21
  name: mean_reward
22
  verified: false
23
  ---
24
 
25
+ # PPO Agent Playing LunarLander-v2
 
 
26
 
27
+ This is a trained model of a PPO agent playing LunarLander-v2.
28
+
29
+ # Hyperparameters
30
+ ```python
31
+ {'f': '/root/.local/share/jupyter/runtime/kernel-1742be3a-c9d5-4f9b-9f75-4156f724ad10.json'
32
+ 'gym_id': 'LunarLander-v2'
33
+ 'env_id': 'LunarLander-v2'
34
+ 'learning_rate': 0.00025
35
+ 'seed': 1
36
+ 'total_timesteps': 25000
37
+ 'torch_deterministic': True
38
+ 'cuda': True
39
+ 'track': False
40
+ 'wandb_project_name': 'ppo-implementation-details'
41
+ 'wandb_entity': None
42
+ 'capture_video': False
43
+ 'num_envs': 4
44
+ 'num_steps': 128
45
+ 'anneal_lr': True
46
+ 'gae': True
47
+ 'gamma': 0.99
48
+ 'gae_lambda': 0.95
49
+ 'num_minibatches': 4
50
+ 'update_epochs': 4
51
+ 'norm_adv': True
52
+ 'clip_coef': 0.2
53
+ 'clip_vloss': True
54
+ 'ent_coef': 0.01
55
+ 'vf_coef': 0.5
56
+ 'max_grad_norm': 0.5
57
+ 'target_kl': None
58
+ 'batch_size': 512
59
+ 'minibatch_size': 128}
60
+ ```
61
+
model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51ca58650228013818c9d28656bc877e59b4f31b922be0fd478cb99bcf0ccb63
3
+ size 42597
replay.mp4 CHANGED
Binary files a/replay.mp4 and b/replay.mp4 differ
 
results.json CHANGED
@@ -1 +1 @@
1
- {"mean_reward": 273.86919986047667, "std_reward": 21.925264617835822, "is_deterministic": true, "n_eval_episodes": 10, "eval_datetime": "2023-02-11T22:39:46.877145"}
 
1
+ {"env_id": "LunarLander-v2", "mean_reward": -161.4340304884947, "std_reward": 68.50782025456756, "n_evaluation_episodes": 10, "eval_datetime": "2023-05-30T21:38:21.053558"}