If you just want to run the completed project in order to collect your training and validation data this section can help do it.
To learn how to build something like this from scratch, see Part 1 and Part 2 of our tutorial.
Table of Contents
To follow this tutorial you need to clone this repository even if you want to create your Unity project from scratch.
- Open a terminal and navigate to the folder where you want to host the repository.
git clone --recurse-submodules https://github.com/Unity-Technologies/Robotics-Object-Pose-Estimation.git-
Open the completed project. To do so, open Unity Hub, click the
Addbutton, and selectPoseEstimationDemoProjectfrom the rootRobotics-Object-Pose-Estimationfolder.
-
Once the project is opened, in the Project tab, go to
Assets > Scenesand double click onTutorialPoseEstimationto open the Scene created for this tutorial. -
We now need to set the size of the images used. In the Game view, click on the dropdown menu in front of
Display 1. Then, click + to create a new preset. Make sureTypeis set toFixed Resolution. SetWidthto650andHeightto400. The gif below depicts these actions.
The completed project is set up for inference mode by default, so we must switch it to data collection mode.
-
Uncheck the
ROSObjectsGameObject in the Hierarchy tab to disable it. -
On the
Simulation ScenarioGameObject, make sure thatPose Estimation Scenariois enabled, and that itsAutomatic Iterationproperty is checked. -
On the
Main CameraGameObject, check thePerception Camera (Script)component to enable it.
To get started with the data collection, follow the instructions in Part 3: Collect the Training and Validation Data of the tutorial. This section will explain how to set the a random seed for the environment, choose how many training data examples you'd like to collect, and get things running.
If you'd like to move on to training a pose estimation model on the data you've collected, navigate to Part 3: Train the Deep Learning Model.
Have fun!
