Interactive Demos

Leonardo Sample Application

To run the sample, first load the Franka Block Stacking scene by selecting the option Isaac Examples -> Demos -> Leonardo Demo.

Example 1: Ghost Block Stacking

This sample application shows a complex scenario using multiple hierarchical state machines to perform a multi-block stacking operation with the Franka robot.

How to run

  1. Press Create Scenario and it will load the environment.

  2. After the environment loads, press the Play button.

  3. Press Perform Task and it will start stacking blocks.

Once all blocks are stacked, the blocks and robot will reset after a fixed period of time and stacking will repeat.

You can also select the /environments/env_0_0/Rubiks_cube prim and drag it around via the translation gizmo. The main Franka robot and ghosts will avoid it.

At any time you can press the Stop/Reset Task and the robot will return to its default position and all blocks will be reset back to the table.

UR10 Sample Applications

Below are two examples with step-by-step instructions on how to simulate complex behaviors with Omniverse Isaac Sim. To run the sample, first load the UR10 Palletizing scene by selecting the option Isaac Examples -> Demos -> UR10 Palletizing.

Example 1: Fill Bin

This example demonstrates a UR10 robot picking a bin from the ground and filling it with components until the suction gripper fails to support the bin in place.

Note

If the bin becomes too heavy due to the number of objects filling it, the gripper will be unable to successfully pick it up. This is expected behavior as the force/torque limits for the gripper are set low to demonstrate breaking behavior. For more information on the tunable parameters for the surface gripper see Surface Gripper

How to run

  1. Select Fill Bin task from drop down at the UR10 Preview screen.

  2. Press Create Scenario and it will load the environment.

  3. After the environment loads, press the Play button.

  4. Press Perform Task and it will start picking up the bin.

  5. Once the bin is picked up, it will lift it close to the dispenser, and objects will start falling into the bin.

  6. Eventually the bin will become too heavy, or the impulse generated by the falling objects will be too strong, and the surface gripper will not stand and lose vacuum, making the bin fall to the ground and spill its contents.

  7. The robot arm will try to locate and pick up the bin again, but if it falls too far from the arm’s reach, the robot may get stuck.

  8. Pressing the Pause Task button in the UR10 Preview window will pause the robot automation, and provide a gizmo on screen where the user can manipulate the end effector target and make the robot move to a desired position.

  9. Pressing on the Drop Parts button will drop more objects from the dispenser, at any time during the simulation.

  10. Press the Stop button, or Reset Task to reset the demo.

Things to try

  1. Move the robotic arm with task paused
    1. Press the play button

    2. Press Perform Task

    3. Once robot starts to move, press Pause Task

    4. click in one of the arrows in the target gizmo that showed on screen, and drag it with the mouse

      • If you want to rotate the orientation, select the rotate tool on the toolbar, and click on the circles corresponding to the rotation axis you want to change.

      Note

      A few scenarios to avoid while running the sample application:

      1. When the bin is moved to an unreachable location for the robot to pick, press Stop/Reset Task button to reset the environment.

      2. When the bin falls off at an angle that would cause the robot to be stuck and not grab it again, press Stop/Reset Task button to reset the environment.

Example 2: Bin Stacking

This example shows the UR10 performing an elaborate behavior of stacking the bins on top of a pallet

How to run

  1. Select Stack Bins task from drop down at the UR10 Preview screen.

  2. Press Create Scenario and it will load the environment.

  3. After the environment loads, press the Play button.

  4. Press Perform Task. A bin will start rolling in the conveyor, and once it reaches the bottom, the robot will start picking it up.

  5. Once the bin is picked up, if it’s upside down, it will be placed on the stack, otherwise it will first be placed on the flipping base so the robot can re-grip from the bottom.

  6. After the bin is placed on the pile, the arm will return to its rest pose, and if another bin is already waiting on the conveyor, it will be picked up and the process will continue.

  7. The robot will stop once all 36 bins have been stacked.

  8. Pressing the Pause Task button will stop the robot automation, and provide a gizmo on screen where the user can manipulate the end effector target and make the robot move to a desired position.

  9. Pressing on the Add bin button will make another bin appear on the conveyor.

  10. Press the Stop button, or Reset Task to reset the demo.

Things to try

  1. Manually stack a bin
    1. Press the play button

    2. Press Perform Task

    3. Once robot starts to move, press Pause Task

    4. Click in one of the arrows in the target gizmo that showed on screen, and drag it with the mouse

      • If you want to rotate the orientation, select the rotate tool on the toolbar, and click on the circles corresponding to the rotation axis you want to change.

    5. Pick a bin in the conveyor belt.

      • Once the gripper is touching the surface of the bin, click on Close/Open Gripper

    6. Move it either to the stack or to the flipping station to pick it up from the bottom

    7. Drop the bin on the desired pose by clicking on Close/Open Gripper.

      Note

      A few scenarios to avoid while running the sample application:

      1. When the bin is moved to an unreachable location for the robot to pick, press Stop/Reset Task button to reset the environment.

      2. In Manual override, avoid rotating the arm too much to either side, as the robot’s joints have a limit of one full turn to each side, making the robot get stuck.