Skip to content

RBQ Simulator

The RBQ open-source package ships several simulators that fall into two groups with different purposes:

  • Open-source physics simulatorsMuJoCo and Gazebo run the full RBQ software stack (Motion / Vision / GUI) against a simulation, so you can develop and test robot software without hardware.
  • Reinforcement-learning training environmentsIsaac Gym and Isaac Lab let you train a locomotion policy and deploy it to the real robot.

Simulators

SimulatorEnginePackage pathPurpose
MuJoCoMuJoCorbq_simulator/rbq_mujoco/Run the full RBQ stack in simulation
GazeboIgnition Gazebo (Fortress)rbq_simulator/rbq_gazebo/Run the full RBQ stack in simulation, with a ROS 2 sensor bridge
Isaac GymIsaacGym (Preview 4)rbq_simulator/rbq_gym/RL training — fast parallel training
Isaac LabIsaac Sim / Isaac Labrbq_simulator/rbq_lab/RL training — high-fidelity simulation

Running the full RBQ stack (MuJoCo / Gazebo)

MuJoCo and Gazebo join the running RBQ stack as DDS peers on domain 0 / loopback. Start the stack, then the simulator:

bash
# Run the RBQ stack (Motion / Vision / GUI)
bash scripts/sim.bash --vision --no-sim

# Then start a simulator, e.g. MuJoCo
cd rbq_simulator/rbq_mujoco && ./bin/rbq_mujoco -p resources/model/default.xml

See MuJoCo and Gazebo for the full build and run instructions.

Training & deploying a policy (Isaac Gym / Isaac Lab)

The RL environments follow the same Train → Play → Deploy pipeline:

Train (Isaac Gym or Isaac Lab)

Play  (verify policy in same simulator)

Sim2Sim (MuJoCo, via rbq_low_level)

Deploy (real robot)

After training, the policy.onnx and info.json artifacts are loaded by rbq_low_level for on-robot execution.

Repository structure

All simulator code lives under rbq_simulator/:

RBQ/
└── rbq_simulator/
    ├── rbq_mujoco/        # MuJoCo simulator (full-stack)
    ├── rbq_gazebo/        # Ignition Gazebo simulator (full-stack + ROS 2 bridge)
    ├── rbq_gym/           # Isaac Gym RL environment
    └── rbq_lab/           # Isaac Lab RL environment

Next steps

This user manual is intended for RBQ users.