introduction and integration of driveworks on drive...
TRANSCRIPT
![Page 1: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/1.jpg)
Aaraadhya Narra, Alessandro Ferrari
INTRODUCTION AND INTEGRATION OF DRIVEWORKS ON DRIVE PX2
![Page 2: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/2.jpg)
22
WHAT WILL YOU LEARN IN THIS LAB?
Introduction to Drive PX2
Hardware setup with Drive PX2
Developing with Driveworks on Drive PX2
Overview
![Page 3: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/3.jpg)
33
GETTING STARTED
Please log into the host based on your PX2 #
PX2 1 – 5 : HOST 1 IP – 10.30.25.189
PX2 6 – 10 : HOST 2 IP – 10.30.25.188
PX2 11 – 15 : HOST 3 IP – 10.30.25.174
PX2 16 – 20 : HOST 4 IP – 10.30.25.176PX2 21 – 25 : HOST 5 IP – 10.30.25.90
Host Password: nvidia Example USER: nvidia_19b
Example <#PX2>=19 Example <USER_LETTER>=b
Log into the Host Machine
$ export HOST_IP=<HOST_IP>$ export USER=nvidia_<PX2#><USER_LETTER> (USER_LETTER LOWERCASE!!!)$ setxkbmap gb
![Page 4: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/4.jpg)
4
HARDWARE SETUP ON DRIVE PX2
![Page 5: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/5.jpg)
5
DRIVE PLATFORM
DriveWorks
CUDA, TensorRT
DRIVE PX 2 — System Software
DRIVE PX 2 — System Hardware Vehicle Control
DNNs and Autonomous Driving Applications
Sensors
HD Maps
![Page 6: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/6.jpg)
66
DRIVE™ PX2
AI Supercomputer for Self Driving Cars
Drive™ PX2
2 Parker SoC - CPU: 4xA57 and 2xDenver Cores & Pascal iGPU
2 Pascal dGPU
Connect up to 12 cameras
Rapidly growing ecosystem of supported sensors and storage solutions
Eg: Lidars, Radars, UltraSonics etc.
Introduction
![Page 7: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/7.jpg)
7
OUT OF THE BOX
USB 2.0 Type A to Type A
DRIVE PX2 Vehicle Cable Harness
USB 3.0 HubWith Power Supply
AC Power Supply
![Page 8: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/8.jpg)
8
Top View
Front View
DRIVE™ PX2 CONNECTORS
![Page 9: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/9.jpg)
9
LINs
CANsGB Ethernet
FlexRaysAURIX Console Interface
Ignition
Power Supply In
DRIVE™ PX2 VEHICLE HARNESS
AURIX Programming Switch**
** Note: Make sure that the AURIX Programming Switch is in the RUN position.
![Page 10: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/10.jpg)
1010
POWER ON THE PX2
25%
![Page 11: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/11.jpg)
11
DRIVEWORKS
![Page 12: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/12.jpg)
12
DRIVE PLATFORM
DriveWorks
CUDA, CuDNN, TensorRT NVMedia
DRIVE PX 2 — System Software
DRIVE PX 2 — System Hardware Vehicle Control
DNNs and Autonomous Driving Applications
Sensors
HD Maps
![Page 13: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/13.jpg)
13
DRIVEWORKSAPIs, Tools & Samples
Input Perceive, Localize & Visualize Vehicle Control
Samples/Preview
• Sensor visualization
• DriveNet• LaneNet• Several CV examples• Occupancy Grid• Maps
• Pilotnet* (End-to-end DNN for self driving)
APIs
• Cameras• Lidars• Radars• IMU• GPS
• Image Processing• DNN interface• CV Modules• HD Maps interface
• CAN/DBW Kit interface
Tools • Calibration and sensor registration• Vehicle rig configuration• Data acquisition
* Available to select customers
![Page 14: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/14.jpg)
14
HANDS-ON WITH DRIVEWORKS SAMPLES
![Page 15: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/15.jpg)
1515
DRIVENET
Navigate to the DriveWorks precompiled samples folder on your PX2.
Run the DriveNet sample:
Multi-class object detector
$ cd /usr/local/driveworks/bin/
$ ./sample_drivenet
![Page 16: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/16.jpg)
16
Bounding Boxes2D Feature Tracker 2D Object Tracker
Inference EngineData Conditioning
Cameraor Video
DRIVENET
SAL
Bounding Boxes
![Page 17: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/17.jpg)
1717
LANENET
Navigate to the DriveWorks precompiled samples folder on your PX2.
To run the LaneNet sample:
Lane detection
$ cd /usr/local/driveworks/bin/
$ ./sample_lane_detection
![Page 18: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/18.jpg)
18
LANENET
Cameraor Video
Ego and adjacent lanes
Post Processing
Inference Engine
Data ConditioningSAL
![Page 19: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/19.jpg)
19
HANDS-ON WITH DRIVEWORKS TOOLS
![Page 20: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/20.jpg)
20
CONNECT THE CAMERASCamera A0
Camera B0
ATTENTION:User A: Connect the camera to Camera A0User B: Connect the camera to Camera B0PLEASE TURN OFF THE PX2 BEFORE CONNECTING CAMERAS!
![Page 21: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/21.jpg)
2121
SAMPLE CAMERA GMSL
User A connect to the group A with the following command
User B connect to the group B with the following command
Live Camera
$./sample_camera_gmsl --camera-type=ar0231 -–csi-port=ab
$./sample_camera_gmsl --camera-type=ar0231 -–csi-port=cd
![Page 22: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/22.jpg)
2222
RECORDING TOOL
Navigate to the tools folder within DriveWorks as follows
Run the recorder tool with super user privileges as follows:
This will create a config file recorder-config.json file. Open this config file with your favorite editor with super user privileges
Password for the PX2: nvidia
Data Logging
$ cd /usr/local/driveworks/tools
$ sudo ./recorder-qt
$ sudo gedit recorder-config.json
![Page 23: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/23.jpg)
2323
RECORDING TOOLConfiguration File
"version": "0.6","path": “/tmp","camera": {
"separate-thread": true,"write-file-pattern": "video_*","sensors": [
{"protocol": "camera.gmsl","params": "camera-type=ar0231,csi-port=ab,camera-count=1,fifo-
size=3,output-format=raw","channel-names": [
"first"]
}]
}
![Page 24: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/24.jpg)
2424
RECORDING TOOL
User A change the first sensor in the recorder-config.json file as follows:
User B change the first sensor in the recorder-config.json file as follows:
Edit the Configuration File
"protocol": "camera.gmsl","params": "camera-type=ar0231,csi-port=ab,camera-count=1,fifo-size=3,output-format=raw","channel-names": [
"first"]
"protocol": "camera.gmsl","params": "camera-type=ar0231,csi-port=cd,camera-count=1,fifo-size=3,output-format=raw","channel-names": [
"first"]
![Page 25: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/25.jpg)
2525
RECORDING TOOL
Now that the config file is edited and the right parameters are included, lets run the recorder tool to record the video feed with super user privileges.
You can list the recorded file by opening up the folder dw-*
Data Logging
$ sudo ./recorder-qt
$ ls /tmp/ | grep dw
![Page 26: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/26.jpg)
26
HANDS-ON WITH DRIVEWORKS API
![Page 27: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/27.jpg)
2727
DRIVEWORKS API ON DRIVE PX2Overview
Caffe Model
RGB Camera Inference Output
Sample Application
Tensor RT
![Page 28: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/28.jpg)
2828
DRIVEWORKS API ON DRIVE PX2
Please log into the host based on your PX2 #
PX2 1 – 5 : HOST 1 IP – 10.30.25.189
PX2 6 – 10 : HOST 2 IP – 10.30.25.201
PX2 11 – 15 : HOST 3 IP – 10.30.25.174
PX2 16 – 20 : HOST 4 IP – 10.30.25.176PX2 21 – 25 : HOST 5 IP – 10.30.25.90
Host Password: nvidia Example: nvidia_22b
Log into the Host Machine
$ echo $HOST_IP$ echo $USER$ ssh -X $USER@$HOST_IP
![Page 29: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/29.jpg)
29
DRIVEWORKS API ON DRIVE PX2
Init SDK Init DNN
Initialization
Clean Up
Main Loop
getFrame
NVMEDIAImage
CUDA Image
Compute
GL Image
Display
Data Flow Overview
![Page 30: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/30.jpg)
3030
DRIVEWORKS API ON DRIVE PX2
Navigate to the driveworks folder in your home directory.
Uncomment the following lines in the CMakeLists.txt file from line 8 to 10.
Live Camera with Object DNN Tracker
$ /bin/bash$ cd ~/driveworks-0.3/$ mkdir build$ cd build$ gedit ~/driveworks-0.3/samples/src/dnn/CMakeLists.txt
#TODO 1: Undo the following section to enable cross compiling of projectIf(VIBRANTE_V4L)add_subdirectory(sample_live_rggb_object_detector)endif()
![Page 31: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/31.jpg)
3131
DRIVEWORKS API ON DRIVE PX2
Now open the sample main.cpp so we can start making changes to the application code.
Live Camera with Object DNN Tracker
$ gedit ~/driveworks-0.3/samples/src/dnn/sample_live_rggb_object_detector/main.cpp
![Page 32: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/32.jpg)
3232
DRIVEWORKS API ON DRIVE PX2
Sensor initialization (line 174)
Live Camera with Object DNN Tracker
initSdk(&gSdk, gWindow); // create HAL and camerauint32_t imageWidth;uint32_t imageHeight;dwImageType cameraImageType;
// TODO 2: Copy these input parameters to initSensor function// &sal, &gCameraSensor, &imageWidth, &imageHeight, &cameraImageType, gSdkinitSensors(/* TODO 2 */);
if(cameraImageType != DW_IMAGE_NVMEDIA){
std::cerr << "Error: Expected nvmedia image type, received" << cameraImageType << "instead." << std::endl; exit(-1);
}
![Page 33: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/33.jpg)
3333
DRIVEWORKS API ON DRIVE PX2
DNN initialization (line 191)
Live Camera with Object DNN Tracker
// TODO 3: Copy the global sdk initalization parameter to initDNN function// gSdk
if (initDNN(/* TODO 3 */)){
initRenderer(&gRenderer, gSdk, gWindow);runNvMedia_pipeline(gWindow, gRenderer, gSdk,
gCameraSensor, imageWidth, imageHeight);}
![Page 34: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/34.jpg)
3434
DRIVEWORKS API ON DRIVE PX2
Error checking (line 381)
Live Camera with Object DNN Tracker
// TODO 4: Add DW_SUCCESS to check return status of Driveworks function// DW_SUCCESS
if (status != /* TODO 4 */){
std::cerr << "Cannot initialize pixel formatconverter" << std::endl;
exit(1);}
![Page 35: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/35.jpg)
3535
DRIVEWORKS API ON DRIVE PX2
NVMEDIA to GL and CUDA image (line 388)
Live Camera with Object DNN Tracker
//TODO 5: Create streamer from converting from DW_IMAGE_NVMEDIA TO //DW_IMAGE_GL//image API translatordwImageStreamerHandle_t nvm2gl = DW_NULL_HANDLE;dwImageStreamer_initialize(&nvm2gl, &displayImageProperties, /*TODO 5*/, sdk);
//TODO 6: Create streamer from converting from DW_IMAGE_NVMEDIA TO//DW_IMAGE_CUDAageStreamerHandle_t nvm2cuda = DW_NULL_HANDLE;
dwImageStreamer_initialize(&nvm2cuda, &displayImageProperties, /*TODO 6*/, sdk);
![Page 36: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/36.jpg)
3636
DRIVEWORKS API ON DRIVE PX2
Utilize GL image for display (line 483)
Live Camera with Object DNN Tracker
// TODO 7: Send via ImageStreamer to get GL image back// nvm2gl
status = dwImageStreamer_postNvMedia(rgbaImage, /* TODO 7 */);...else{
dwImageGL *frameGL = nullptr;status = dwImageStreamer_receiveGL(&frameGL, 60000, /* TODO 7 */);if (status == DW_SUCCESS && frameGL){
...dwImageStreamer_returnReceivedGL(frameGL, /* TODO 7 */);
}}
![Page 37: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/37.jpg)
3737
DRIVEWORKS API ON DRIVE PX2
Utilize CUDA image for inference (line 501)
Live Camera with Object DNN Tracker
// TODO 8: Send via ImageStreamer to get GL image back// nvm2cuda
status = dwImageStreamer_postNvMedia(rgbaImage, /* TODO 8 */);...else{
dwImageCUDA *frameCUDA = nullptr;status = dwImageStreamer_receiveCUDA(&frameCUDA, 10000, /* TODO 8 */);if (status == DW_SUCCESS && frameCUDA){
...dwImageStreamer_returnReceivedCUDA(frameCUDA, /* TODO 8 */);
}}
![Page 38: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/38.jpg)
3838
DRIVEWORKS API ON DRIVE PX2
Clean up (line 572)
Live Camera with Object DNN Tracker
dwSensor_stop(cameraSensor);//TODO 9: Release GL imagestreamer//&nvm2gldwImageStreamer_release(/*TODO 9*/);
//TODO 10 Release CUDA imagestreamer//&nvm2cudadwImageStreamer_release(/*TODO 10*/);
![Page 39: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/39.jpg)
3939
DRIVEWORKS API ON DRIVE PX2
Add the correct camera port (line 130)
Live Camera with Object DNN Tracker
// Replace /* TODO 11 */ below with the following code in the correct places:
// USER A: "ab"// USER B: "cd"ProgramArguments::Option_t("csi-port", /* TODO 11 */),
![Page 40: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/40.jpg)
4040
DRIVEWORKS API ON DRIVE PX2
Once in our build directory, we start the cross compilation process by generating the makefiles.
Follow the compilation instruction in the /home/nvidia/README.md file on your PX2.
Cross Compilation from Host to Drive PX2
![Page 41: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/41.jpg)
4141
DRIVEWORKS API ON DRIVE PX2
Now that our binaries have been successfully compiled, switch back to your PX2 to copy the files from the host directly. Press Ctl+D to leave the SSH session.
Ensure you replace <PX2#> with your PX2's number and <USER_LETTER> with either A|B. $HOST_IP should still be your host’s IP address from earlier.
ON THE DPX2!!!
Host Password: nvidia Example user: nvidia_19a
Example <#PX2>=19 Example <USER_LETTER>=a
Cross Compilation from Host to Drive PX2
$ echo $USER$ echo $HOST_IP$ scp $USER@$HOST_IP:/home/$USER/driveworks-0.3/build/install/bin/sample_live_rggb_object_detector~/sample_live_rggb_object_detector$ sudo mv ~/sample_live_rggb_object_detector /usr/local/driveworks/bin
![Page 42: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/42.jpg)
4242
DRIVEWORKS API ON DRIVE PX2
Open a picture of a car in the Chromium browser and point your cameras towards it.
Running the Sample
$ cd /usr/local/driveworks/bin$ /usr/local/driveworks/bin/sample_live_rggb_object_detector
![Page 43: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/43.jpg)
43
OTHER RESOURCESTOOLSDeveloper Zone (developer.nvidia.com/DRIVE)Developer Forums (devtalk.nvidia.com)
SCHOOLSDeep Learning Institute – Autonomous DrivingUdacity Nanodegree
OTHER PRESENTATIONS
![Page 44: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/44.jpg)
4444
AUTOMOTIVE PX2 LABSHands On Workshops
Please attend the following Auto workshops:
Training a Semantic Segmentation Network ready for Deployment in the Car by Oliver Knieps & Joohoon Lee
Deployment of Semantic Segmentation Network using Tensor RT by Joohoon Lee & Chethan Ningaraju
CUDA Programming on Drive PX2 by Chethan Ningaraju
EGL Streams: Interoperability for Camera, CUDA and OpenGL by Debalina Bhattacharjee & Sharan Ashwathnarayan
![Page 45: Introduction and integration of driveworks on drive px2on-demand.gputechconf.com/gtc-eu/2017/presentation/53022...• CV Modules • HD Maps interface • CAN/DBW Kit interface Tools](https://reader033.vdocuments.site/reader033/viewer/2022042922/5f6e9570911ab41add4c14d5/html5/thumbnails/45.jpg)
Questions?
THANK YOU!