This is a nice project. As far as I understand, PPO works as follows : Collect trajectories, compute rewards and advantage estimates. Then Update the policy and Fit value function by regression. Ask for an AI to finish it ? ;)
Just FYI this is causing the dreaded "MCM is inactive in load order" error, which stops the game from loading with mods. I have 700+ mods, took me several hours to find the culprit (since this was loaded around 580).
Hey, I’m really sorry for the trouble this mod caused you. I didn’t intend for it to break anything, and I appreciate you taking the time to track it down—especially with a load order that big. This mod is still incomplete and not functional yet, which I mentioned in the description, so I’d highly recommend not installing it until someone can fix it. Again, I truly appreciate your patience, and I apologize for the frustration it caused.
Ambitious mod, But I am not sure what it does. I generally leave no survivors from my battles. So how can they learn and adapt if they are dead? Not trying to be a jerk. Just don't understand.
Thanks for your comment! The goal of this mod was to implement Proximal Policy Optimization (PPO) for enemy AI, so that each new enemy would learn from the mistakes of defeated ones. Instead of individual enemies adapting mid-battle, the overall AI pool would improve over time—meaning future encounters would feel more like fighting against an evolving player, rather than static NPCs.That said, this mod is unfinished and currently non-functional—I uploaded it in hopes that someone could help refine or complete it. If you're interested, feel free to take a look!
This is such a cool idea, I'm glad you uploaded it even if it isn't finished. I really hope someone picks this up cuz that sounds so cool xD Fighting against an evolving player from the enemy AI sounds like such fun holy s#*!
16 comments
As far as I understand, PPO works as follows :
Collect trajectories, compute rewards and advantage estimates. Then Update the policy and Fit value function by regression.
Ask for an AI to finish it ? ;)