RL Environment Simulators ML Frameworks

Custom simulation environments and gym-compatible training frameworks for reinforcement learning across specific domains (trading, auctions, radio, accounting, games). Does NOT include RL algorithms, agents, or general-purpose game engines.

There are 58 rl environment simulators frameworks tracked. 6 score above 50 (established tier). The highest-rated is qgallouedec/panda-gym at 59/100 with 737 stars.

Get all 58 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=rl-environment-simulators&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Framework	Score	Tier	Stars	Language
1	qgallouedec/panda-gym Set of robotic environments based on PyBullet physics engine and gymnasium.	59	Established	737	Python
2	nicrusso7/rex-gym OpenAI Gym environments for an open-source quadruped robot (SpotMicro)	57	Established	1,084	Python
3	amazon-science/auction-gym AuctionGym is a simulation environment that enables reproducible evaluation...	57	Established	187	Jupyter Notebook
4	upb-lea/openmodelica-microgrid-gym OpenModelica Microgrid Gym (OMG): An OpenAI Gym Environment for Microgrids	55	Established	219	Modelica
5	vietnh1009/Super-mario-bros-A3C-pytorch Asynchronous Advantage Actor-Critic (A3C) algorithm for Super Mario Bros	51	Established	1,108	Python
6	ntasfi/PyGame-Learning-Environment PyGame Learning Environment (PLE) -- Reinforcement Learning Environment in Python.	51	Established	1,057	Python
7	cove9988/TradingGym Trading Gym is an open source project for the development of reinforcement...	48	Emerging	222	Jupyter Notebook
8	jangirrishabh/toyCarIRL Implementation of Inverse Reinforcement Learning Algorithm on a toy car in a...	48	Emerging	178	Python
9	PySymGym/PySymGym Python infrastructure to train paths selectors for symbolic execution engines.	47	Emerging	13	Python
10	duburcqa/jiminy Jiminy: a fast and portable Python/C++ simulator of poly-articulated robots...	43	Emerging	285	Jupyter Notebook
11	adipandas/gym_multirotor Multi-rotor Gym	42	Emerging	59	Python
12	SciSharp/Gym.NET openai/gym's popular toolkit for developing and comparing reinforcement...	42	Emerging	140	C#
13	dellalibera/gym-backgammon Backgammon OpenAI Gym	42	Emerging	54	Python
14	cassiusfive/balatro-gym Gymnasium Environment for Balatro	42	Emerging	36	Python
15	google/balloon-learning-environment The Balloon Learning Environment - flying stratospheric balloons with deep...	41	Emerging	131	Python
16	seoulai/gym Seoul AI Gym is a toolkit for developing AI algorithms.	39	Emerging	31	Python
17	NickKaparinos/OpenAI-Gym-Projects OpenAI Gym environment solutions using Deep Reinforcement Learning.	39	Emerging	80	Python
18	offworld-projects/offworld-gym OffWorld Gym: Open-Access Physical Robotics Environment for Real-World...	38	Emerging	57	Python
19	MartinThoma/banana-gym A simple stochastic OpenAI environment for training RL agents	38	Emerging	87	Python
20	ivy-llc/gym Fully differentiable RL environments, written in Ivy.	38	Emerging	66	Python
21	pathak22/exploration-by-disagreement [ICML 2019] TensorFlow Code for Self-Supervised Exploration via Disagreement	36	Emerging	129	Python
22	WUR-AI/PCSE-Gym CropGym is a highly configurable Python gymnasium environment to conduct...	36	Emerging	8	Jupyter Notebook
23	JDatPNW/QPlane Fixed Wing Flight Simulation Environment for Reinforcement Learning	36	Emerging	80	Python
24	harisankar95/voxelgym2D Gymnasium based RL environment for 2D grid path planning	35	Emerging	22	Python
25	tamsri/radio-gyms Radio Gyms is an open-source bundle of AI environments for radio communications.	35	Emerging	13	Jupyter Notebook
26	futurely/openai-universe-agents Deep reinforcement learning agents for OpenAI universe environments	33	Emerging	7	Python
27	lab-v2/pyreason-gym An OpenAI wrapper for PyReason to use in a Grid World reinforcement learning setting	32	Emerging	32	Python
28	rickstaa/stable-gym This package contains several gymnasium environments with positive definite...	32	Emerging	12	Python
29	Yusei406/calvano-qlearning Q-learning oligopoly simulation (Calvano et al., 2020) — high-fidelity...	31	Emerging	2	Python
30	purvasingh96/gym-fraud 💳 Creates a new gym environment for credit-card anomaly detection using Deep...	31	Emerging	19	Jupyter Notebook
31	dimgold/Artificial_Curiosity Adaptive Reinforcement Learning of curious AI basketball agents	30	Emerging	22	Jupyter Notebook
32	ThalesGroup/open-the-chests Open-the-chests is a training environment for event-patterns recognition.	30	Emerging	6	Python
33	Div-Infinity/XQL Extreme Q-Learning: Max Entropy RL without Entropy	30	Emerging	87	Python
34	lil-lab/knotgym [NeurIPS DB 2025] A gym environment for visual spatial reasoning - knot so simple :)	29	Experimental	15	Python
35	AlessandroPomponio/atari-bowling-ppo An autonomous agent that learns to play Atari Bowling using Reinforcement...	29	Experimental	7	Jupyter Notebook
36	doctorcorral/gyx Reinforcement Learning environment for Elixir	29	Experimental	34	Elixir
37	MGokcayK/DynaG Dynamic System solver for reinforcement learning environment. It solves ODE...	29	Experimental	1	C++
38	felipelodur/Q-Learning-Taxi-v2 Implementation of Q-Learning to learn optimal q-table of "Taxi-v2 Open AI...	29	Experimental	5	Jupyter Notebook
39	ethicsai/ethical-smart-grid Reinforcement learning environment for learning ethical behaviours in a...	28	Experimental	3	Python
40	markusdumke/q_sigma_lambda Reinforcement Learning: Implementation of Q(sigma, lambda) and Double...	21	Experimental	7	TeX
41	aweeraman/reinforcement-learning-continuous-control Continuous Control with deep reinforcement learning where the agent must...	21	Experimental	9	Python
42	VaradhKaushik/RL-models-for-Super-Mario-Bros This repository explores the application of three reinforcement learning...	20	Experimental	5	Jupyter Notebook
43	abbas-rz/ImitationReplay A focused toolkit for capturing human demonstrations in Gym/Gymnasium...	20	Experimental	1	Jupyter Notebook
44	AugustUnderground/gace DEPRECATED. Use circus instead	20	Experimental	7	Hy
45	Unique-Divine/grid-world-plus A research project in vision-based deep reinforcement learning centered on...	19	Experimental	3	Python
46	cirovitale/smart-car Smart Mobility Unity simulation using Reinforcement Learning for autonomous...	19	Experimental	1	C#
47	mohamedrxo/DQN Here, I implement Deep Q-Learning (DQN) to train agents on various Gym...	18	Experimental	5	Jupyter Notebook
48	victor-iyi/openai-gym A Reinforcement Learning demo using the OpenAI's gym environment.	18	Experimental	2	Jupyter Notebook
49	malyvsen/wombat Minimalist, flexible Python reinforcement learning framework. Out-of-the-box...	17	Experimental	1	Jupyter Notebook
50	jeffasante/RL-PPO-SharpShooter Custom-built Proximal Policy Optimization (PPO) agent learns to master a 2D...	17	Experimental	1	Python
51	Thableaddles57/reinforcement-learning-gym Implementations of various reinforcement learning algorithms (e.g.,...	14	Experimental	—	Python
52	turhancan97/Reinforcement-Learning-Training In this repo, you can find information about reinforcement learning,...	11	Experimental	—	Python
53	gautams3/IRL_IntelligentGrading Using Inverse Reinforcement Learning for grading of physical (sensorimotor)...	11	Experimental	—	Java
54	alantess/cryptogym A cryptocurrency environment for reinforcement learning.	11	Experimental	—	Python
55	AliBohZam/AI WormBot reinforcement learning	11	Experimental	—	Python
56	louis030195/xmoto-gym OpenAi's gym environment for Xmoto game - reinforcement learning research	10	Experimental	2	Jupyter Notebook
57	Ekow24/The-Q-learning-Pathfinding-algorithm-for-Autonomous-Vehicles My Q-learning pathfinding algorithm for autonomous vehicles	10	Experimental	1	Jupyter Notebook
58	accounting-intelligent-ai/cpagym CPAGYM: Accounting Gym! Economic Gym! Finance Gym! Reinforcement Learning .会计强化学习GYM。	10	Experimental	2	—