Farama Gymnasium (formerly OpenAI Gym) is a standard API for reinforcement learning, and a diverse collection of reference environments. It is not officially supported on Windows, so installation could be troublesome. One common problem occurs during the Box2D package installation. You may see errors such as these:
ERROR: Failed building wheels for box2d-py
ERROR: Command swig.exe failed
ERROR: Microsoft Visual C++ 14.0 or greater is required.
The following video shows you how to install the complete Gymnasium package successfully on Windows 10/11. Click Box2D Swig Problem to jump directly to the Box2D section.