The games we play are that easy though. Dark souls with eyes = hard, dark souls to an entity which has no eyes, but can read RAM states = easy.

Most singleplayer games (so the opponents are clockwork) are easy to enough to play with heuristics, why do we need a whole ass neural network?