design of an intelligent vehicle control system based on labview ·  · 2015-09-23cles and vehicle...

7
21 Metallurgical and Mining Industry No. 7— 2015 Automatization Conclusion The proposed control approach for the pulp gas phase parameters on the basis of high-energy ultra- sound allows to implement the effective management of pulp gas phase composition, enhance the concen- trate quality and efficiency of the mineral processing technological process. References 1. Beloglazov K.F. Zakonomernosti flotatsion- nogo protsessa [Regularities of the flotation proces]. Moscow, Metallurgizdat, 1947. 2. Brezani I. Flotation kinetics – modeling. Available at: http://www.mathworks.com/mat- labcentral/fileexchange/28703-flotation-kinet- ics-modeling. 3. Pikilnyak A. V. Adaptive control of the pulp gas phase parameters in the flotation process based on the dynamic effects of high-energy ultrasound. PhD diss. Kryvyi Rih, 2014. 4. Morkun V., Morkun N., Pikilnyak A. (2014). The gas bubble size distribution control forma- tion in the flotation process, Metallurgical and Mining Industry, No4, pp. 42-45 5. Morkun V., Morkun N., Pikilnyak A. (2015). Adaptive control system of ore beneficiation process based on Kaczmarz projection algo- rithm, Metallurgical and Mining Industry, No2, pp.35-38. 6. Pikilnyak A. (2015). Adaptive control system of the iron ore flotation using a control action based on high-energy ultrasound, Metallurgi- cal and Mining Industry, No2, pp.27-30. 7. Morkun V., Morkun N., Pikilnyak A. (2014). The adaptive control for intensity of ultrasonic influence on iron ore pulp, Metallurgical and Mining Industry, No6, pp. 8-11. 8. Andreyev Ye., Lvov V., Nikolayev A. , Si- lakova O. (2008). Obzor sovremennykh i kompyuternykh programm dlya modelirovani- ya protsessov obogashcheniya poleznykh iskopayemykh [An overview of modern and computer programs for the simulation of min- eral processing], Obogashcheniye rud. No4, p.p. 19–25. 9. Morkun V., Morkun N., Pikilnyak A. (2014). Simulation of the Lamb waves propagation on the plate which contacts with gas containing iron ore pulp in Waveform Revealer toolbox, Metallurgical and Mining Industry, No5, pp. 16-19. Design of an Intelligent Vehicle Control System Based on LabVIEW Lijun Wang, Nanchun Liu, Jianjiao Wang, Jingzheng Hu, Fang Liang School of Mechanical Engineering, North China University of Water Resources and Electric Power, Zhengzhou 450011, Henan, China Abstract Compared with the traditional intelligent vehicle control system has the following deficiencies: complex image processing algorithm and not flexible cable communication mode, and not real-time traffic monitoring and control, the design by use of LabVIEW which has a wealth of signal processing functions and graphical

Upload: phunghuong

Post on 24-May-2018

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Design of an Intelligent Vehicle Control System Based on LabVIEW ·  · 2015-09-23cles and vehicle electronics is increasingly being con-cerned about the people. ... vision system,

21Metallurgical and Mining IndustryNo. 7— 2015

AutomatizationConclusionThe proposed control approach for the pulp gas

phase parameters on the basis of high-energy ultra-sound allows to implement the effective management of pulp gas phase composition, enhance the concen-trate quality and efficiency of the mineral processing technological process.

References1. Beloglazov K.F. Zakonomernosti flotatsion-

nogo protsessa [Regularities of the flotation proces]. Moscow, Metallurgizdat, 1947.

2. Brezani I. Flotation kinetics – modeling. Available at: http://www.mathworks.com/mat-labcentral/fileexchange/28703-flotation-kinet-ics-modeling.

3. Pikilnyak A. V. Adaptive control of the pulp gas phase parameters in the flotation process based on the dynamic effects of high-energy ultrasound. PhD diss. Kryvyi Rih, 2014.

4. Morkun V., Morkun N., Pikilnyak A. (2014). The gas bubble size distribution control forma-tion in the flotation process, Metallurgical and Mining Industry, No4, pp. 42-45

5. Morkun V., Morkun N., Pikilnyak A. (2015). Adaptive control system of ore beneficiation process based on Kaczmarz projection algo-rithm, Metallurgical and Mining Industry, No2, pp.35-38.

6. Pikilnyak A. (2015). Adaptive control system of the iron ore flotation using a control action based on high-energy ultrasound, Metallurgi-cal and Mining Industry, No2, pp.27-30.

7. Morkun V., Morkun N., Pikilnyak A. (2014). The adaptive control for intensity of ultrasonic influence on iron ore pulp, Metallurgical and Mining Industry, No6, pp. 8-11.

8. Andreyev Ye., Lvov V., Nikolayev A. , Si-lakova O. (2008). Obzor sovremennykh i kompyuternykh programm dlya modelirovani-ya protsessov obogashcheniya poleznykh iskopayemykh [An overview of modern and computer programs for the simulation of min-eral processing], Obogashcheniye rud. No4, p.p. 19–25.

9. Morkun V., Morkun N., Pikilnyak A. (2014). Simulation of the Lamb waves propagation on the plate which contacts with gas containing iron ore pulp in Waveform Revealer toolbox, Metallurgical and Mining Industry, No5, pp. 16-19.

Design of an Intelligent Vehicle Control System Based on LabVIEW

Lijun Wang, Nanchun Liu, Jianjiao Wang, Jingzheng Hu, Fang Liang

School of Mechanical Engineering, North China University of Water Resources and Electric Power, Zhengzhou 450011, Henan, China

AbstractCompared with the traditional intelligent vehicle control system has the following deficiencies: complex image processing algorithm and not flexible cable communication mode, and not real-time traffic monitoring and control, the design by use of LabVIEW which has a wealth of signal processing functions and graphical

Page 2: Design of an Intelligent Vehicle Control System Based on LabVIEW ·  · 2015-09-23cles and vehicle electronics is increasingly being con-cerned about the people. ... vision system,

Metallurgical and Mining Industry22 No. 7— 2015

Automatizationprogramming features and NI myRIO which has powerful hardware system, the intelligent vehicle control system is more flexible and convenient. Firstly, the system by NI myRIO transfer the camera collect image information; Secondly, the image information via Wi-Fi communication to LabVIEW visual analysis module and deal with it by the algorithm; Finally, according to the image information analysis results, NI myRIO by PWM control algorithm of the FPGA module control the rotation of the motor and servo, realizes the automatic tracking and storage, and other functions of intelligent vehicle. Key words: LabVIEW, INTELLIGENT VEHICLE, NI MYRIO, SYSTEM CONTROL.

IntroductionWith the rapid development of control theory and

technology in the transport sector, research on vehi-cles and vehicle electronics is increasingly being con-cerned about the people. Intelligent vehicle as a typi-cal number of high-tech integrated carrier, mainly re-lated to the theory and technology of real-time image processing, pattern recognition, artificial intelligence, automatic control, sensor technology, and other disci-plines [1]. It combines with the latest research results of information science technology and artificial intel-ligence and is an important part of the current nation-al focus on the development of intelligent transport system [2]. Intelligent vehicle control system has a wide range of theoretical value and practical signifi-cance. The identification methods of intelligent vehi-cle not only determine its own performance, but also affect the cost of development and use of the systems [3].Early on, identification methods of intelligent ve-hicle is mainly based on electromagnetic induction guide technology, but due to the small range of elec-tromagnetic induction, does not apply to a wide range of complex environments [4]. Advantages of the im-age sensor and the combination with the feasibility of the current image processing technology, has become an important subject of intelligent vehicle path iden-tification technology. The intelligent vehicle control system also still in the use of various sensors, through C language programming of traditional design level. However, this control method has the following ques-tions: firstly, developers must use a variety of sen-sors to achieve data transmission and transfer; sec-ondly, there is no definite link between the various sensors and data communications, the system can’t be achieved comprehensive treatment and integrated treatment of the accident unexpected situations.

Now, with the constant development of automo-tive technology, Research on intelligent vehicle con-trol system has made great progress. On abroad, such as the intelligent vehicle control system of VERTIS in Japan, the intelligent owners have 23 ITSZ sub-system is mainly used for vehicle communication, information processing, environmental exploration, and auxiliary control (autopilot) function. In addition, Renault developed the intelligent vehicle can not only

make vehicles aware of their surroundings, such as road conditions, distance of nearby vehicles and driv-ing speed, etc. Also can make promptly corrected ad-justments to the speed, direction and other reactions according to specific circumstances [5]. Although, intelligent vehicle research starts relatively late in our country, but it develops rapidly. For example, Tsin-ghua University developed the autonomous mobile robot test vehicle THMR-V, which has been able to travel on the more complex environment by itself [6]. In this system, they used a laser radar and camera for vision system, and the use of their existing advanced image processing technology to identify and process information, and then intelligent control, to achieve intelligent vehicle movement.

The design of the system in the original theory, based on a method of combining hardware and soft-ware, the application of virtual instrument technolo-gy to develop intelligent vehicle control system. The Control platform based on LabVIEW, will not only make the complex redundant programming become visualization, simplicity. And with the help of the LabVIEW rich signal processing functions, the signal analysis and processing become more simplification. Furthermore, the NI myRIO as the core of hardware system, by control the camera, motor, servo, buzzers and other hardware, implement the intelligent vehi-cle’s monitoring traffic information, automatic track-ing, reversing warehousing and other functions. By WIFI wireless communications, intelligent vehicle control system not only real-time monitoring, but also through graphics, pictures in one of the wireless background operation, making the operation more convenient and intuitive. The system also can use WiFi communication function of NI myRIO display the traffic and motion information and control intelli-gent vehicle motion on the iPad. That makes the con-trol system more diversified and intelligent.

Whole scheme design NI myRIO is the core of intelligent vehicle control

systems. Design of the system is divided into three parts: acquisition the traffic information, process the image information, control intelligent vehicle mo-tion. Firstly, NI myRIO transfer camera collect image information; Secondly, the image information via

Page 3: Design of an Intelligent Vehicle Control System Based on LabVIEW ·  · 2015-09-23cles and vehicle electronics is increasingly being con-cerned about the people. ... vision system,

23Metallurgical and Mining IndustryNo. 7— 2015

AutomatizationWi-Fi communication to LabVIEW visual analysis module and deal with it by the algorithm; Finally, according to the image information analysis results, NI myRIO by PWM control algorithm of the FPGA module control the rotation of the motor and servo, realizes the automatic tracking and storage, and other functions of intelligent vehicle;

By set up the image and color testing, if the intel-ligent vehicle meet green to slow down, meet the red to stop, meet other color can rotate smoothly. And the system transfers the z axis of triaxial accelerometer pa-rameters in NI myRIO, to realize the intelligent vehi-cle drive in different speed at different terrain. Buzzer is not only in the servo angle to sound an alarm when a certain Angle, also can alarm in bad road conditions. The monitor and control system implementation by LabVIEW software loaded on the computer, accept, display and send intelligent vehicle speed, angle, traf-fic information and other data, so as to real-time mon-itor the movement of intelligent vehicle.

Hardware systemThe system hardware mainly includes the follow-

ing several parts: computer hardware system, camera, NI myRIO, vehicle, motor, servo and buzzer. The computer is the upper machine of the whole system, through the LabVIEW platform control system, to control the movement of the vehicle, servo, and re-al-time display of vehicle movement speed, angle and road information. It can be connected by WiFi com-munication with NI myRIO; the camera is similar to the intelligent vehicle's eyes, acquisition the image of road information. The image process by the applica-tion of LabVIEW image processing module, the traf-fic information and angle information feedback to the servo and motor movement, so as to complete the ve-hicle’s path identification function; Motor is the power part of the intelligent vehicle's, the speed and control of the motor mainly use of the half-bridge rectifier cir-cuit and PWM algorithm. Servo mainly includes mo-tor controller, DC motor and reducer. We need install a potentiometer to detect the rotation angle of the out

put shaft. The control panel can accurately control and maintain the angle of the output shaft according to the potential for information.NI myRIO include the latest Xilinx Zynq® program-mable system on chip (SoC) technology, which con-tains a dual-core ARM Cortex-A9 processor and with 28,000 logic cells, 16 DMA channels FPGA. In addi-tion, NI myRIO also has a plurality of peripheral I / O interfaces, including 10 analog inputs and 6 analog outputs, 40 digital inputs and outputs and stereo audio input and output. In the debug and connection func-tions, there are four programmable control LEDs and an triaxial acceleration sensor onboard.Combined with the hardware advantage of NI myRIO, using ARM architecture A9 real-time performance and the FPGA can be customized I/O, complete the system design. The pin is shown in Figure 1.

Figure 1. The pin of NI myRIO

Figure 2. Hardware connection diagram

Through WIFI signal, the system control NI myRIO directly on the LabVIEW platform, NI myRIO link to camera, motor, servo and buzzer. Di-rectly by motor and servo control the movement of intelligent vehicles, and through the control of cam-eras acquisition the image information. At the same time by the Z axis acceleration sensor onboard mon-itor the road traffic information. The hardware con-nection diagram is shown in figure 2:

Page 4: Design of an Intelligent Vehicle Control System Based on LabVIEW ·  · 2015-09-23cles and vehicle electronics is increasingly being con-cerned about the people. ... vision system,

Metallurgical and Mining Industry24 No. 7— 2015

AutomatizationSoftware systemSoftware system is the emphasis and difficulties

of the design. The software program is mainly com-posed of hardware configuration, algorithm process-ing and hardware exit part. Hardware configuration including servo motor, buzzer and cameras, a serial port configuration, servo and motor PWM configu

ration, camera transfer and image acquisition. Algo-rithm processing mainly includes image processing algorithm and control algorithm of servo motor and buzzer. The image processing algorithm include the binary, filtering, edge detection, establish the coordi-nates, angle measurement Software system flow chart shown in Figure 3:

Figure 3. Software connection diagram

Figure 4. Rear panel of the hardware configuration

1) NImyRIOhardwareconfigurationBy configuring I / O port of NI myRIO to achieve

communication between the NI myRIO and PC com-puter. The servo and motor I / O port directly configu-

re to PWM port. While configure to the camera USB port directly connect to myRIO. Rear panel of the hardware configuration is shown in figure 4.

In this transfer PWM sub-VI, it sets that transfer the NI myRIO parameters and the PWM input signal.

When we configure the PWM port, if the parame-ters are inappropriate that will cause the PWM signal

Page 5: Design of an Intelligent Vehicle Control System Based on LabVIEW ·  · 2015-09-23cles and vehicle electronics is increasingly being con-cerned about the people. ... vision system,

25Metallurgical and Mining IndustryNo. 7— 2015

Automatizationis invalid; by transfers the FPGA module to improve the program processing configuration and ensure the successful of the operation. As shown in figure 5 is the PWM sub-VI.

Figure 5. The PWM sub-VI

Figure7. Angle measurement algorithm

Figure 8. Automatic storage algorithm

2) NI myRIO control algorithmAutomatic tracking and storage algorithm is im-

portant part of the control program. Where in the au-tomatic tracking is processed and analyzed images on LabVIEW vision module, included the image cache, image color transfer binarization processing, edge de-tection, establish the coordinate and angle measure-ment. After the addition of the color image recogni-tion, identify system by check the color of the image on the road surface, control the angle of servo rota-tion and the speed of motor. The storage algorithms include NI myRIO motors, servos, cameras, buzzer control algorithm.

The following describes the algorithm for the ser-vo motor, buzzer and cameras processing functions: firstly, the algorithm of servo including simple manu-al servo parts, as shown in figure 6.

Figure 6. Simple manual servo algorithm

Figure 9. PWM value control algorithm

The algorithm program of camera angle measure-ment and automatic storage of servo rotation angle block diagram as shown in figure 7 and figure 8.

Secondly, the motor control algorithm. The motor control algorithm much simpler than the servo, just some simple PWM value control, it is easy to imple-ment in the LabVIEW program. But given the color recognition and triaxial acceleration sensor, the mo-tor control algorithm needs to add some algorithm processing. The algorithm of PWM motor control is shown in figure 9 below.

Thirdly, buzzer control algorithms. When the servo angle more than 10 degrees, the buzzer began to work.

Page 6: Design of an Intelligent Vehicle Control System Based on LabVIEW ·  · 2015-09-23cles and vehicle electronics is increasingly being con-cerned about the people. ... vision system,

Metallurgical and Mining Industry26 No. 7— 2015

AutomatizationIf the color recognition is red, then the buzzer will

send out beeps to suggest the dangerous. If the road is not very well, more than the value set by three axis acceleration sensor, the buzzer also beeps, at the same time, the motor will reduce the speed.

Fourth, the camera control algorithms. Camera processing algorithm is the most core part the soft-ware program. The camera control algorithms include image cache, image color transfers, image binariza-tion process, image filtering, image edge detection, image processing, image coordinates establish, image angle measurement. The image color recognition is though the way of check the color of the picture on the road surface, judge traffic information and exe-cutes the corresponding control commands. Figure 10 is a part of color recognition.

Figure 10. Color recognition program

Figure 11. Three-axis accelerometer control motor program

Three-axis accelerometer control motor program-ming are shown in figure 11 below.

In the storage operation, the system based on the results of color recognition performs the appropriate action. If the road surface detected is green sticker, the servo control vehicle turning while motor control decelerating; If the road surface detected is red stick-er, the vehicle stop moving to complete automatic warehouse; If the road surface detected is black stick-er, the vehicle proceed automatic tracking.

The whole algorithm processing is executed in a certain order. In order to avoid sequence function causes the function structure of the data stream error, so we have the error cluster instead of the order of the function. So that both avoid redundancy function and reduce errors. Automatic tracking and parking storage algorithm overall program block diagram as shown respectively in figure 12 and 13.

Fifth, through the variable Z axis acceleration sen-sor to detect the road information, that can control the different road have different speed .

Figure 12. Automatic tracking algorithm

Page 7: Design of an Intelligent Vehicle Control System Based on LabVIEW ·  · 2015-09-23cles and vehicle electronics is increasingly being con-cerned about the people. ... vision system,

27Metallurgical and Mining IndustryNo. 7— 2015

Automatization

Figure 13. Storage algorithm

Figure 14. Intelligent vehicle physical diagram

ConclusionIntelligent vehicle control system based on Lab-

VIEW to meet the needs of intelligent vehicles, in addition to achieve tracking and storage operation, but also has the following characteristics: (1) the op-eration system is simple and convenient. And though the way of wifi network, the movement of intelligent vehicles become more flexible;(2) compared with the traditional intelligent vehicle the development cost is greatly reduced;(3)compared with the traditional in-telligent vehicle use several sensors, the system only use of camera reduce redundancy and the difficulty of debugging program. Physical map of intelligent vehi-cle is shown in figure 14.

AcknowledgementsThis work was supported by Zhengzhou Measur-

ing & Control Technology and Instrumentations Key Laboratory(121PYFZX181) and HASTIT(14HAS-TIT001)

References1. Orita T, et a1. (1993) An approach to the intelli-

gent vehicle. Proc. of IEEE Intelligent Vehicles Symposium, p.p. 426-432.

2. Wang C. (2014) Intelligent vehicle develop-ment present situation and forecast. Sciences & wealth, no.3, p.p. 123-124.

3. Liu J. (2011) Based on visual navigation in-telligent vehicle control system design and re-search (Master Thesis). Southwest University of Science and Technology: Mianyang.

4. Guo H., Tan M. (2001) Development status and trend of mobile robot. Robot technology and application, 23(3), p.p. 7-14.

5. Zhou J. (2011) Intelligent vehicle control sys-tem design based on vision navigation (Master Thesis).Wuhan University of Technology: Wu-han.

6. Shun Y. (2007) Intelligent vehicle control sys-tem based on path planning (Master Thesis). Qingdao university: Qingdao.

7. Wilcox B., Gennery D. (1987) Vision system for a AGV system. Mobile Robots, 5,p.p. 172-179.

8. Wang R., Xu Y. (2002) A vision-based road edge detection algorithm. Proc. of IEEE Intelli-gent Vehicle Symposium, p.p. 141-147.

9. Wang Y., Wang Z. (2009) Image processing technology based on Labview. Ordnance in-dustry automation, 28(1), p.p.89-91.

10. Wang H., Yang J. (2014) Test platform for wireless vision intelligent vehicle. Electronics World, 4,p.123.

11. Yuan M. (2010) Intelligent vehicle integrated information monitoring system development based on LabVIEW. The modern electronic technology. 35(20), p.p.149-151.

12. Chang J. (2012) Product test platform design and application based on LabVIEW machine vision (Master Thesis). South China university of technology: Guangzhou.