Abstract: Recently, the automobile industry is pursuing the functionality and robustness of the entire system while applying various technologies such as electronic equipment, computer and control. The autonomous navigation system recognizes the position autonomously through the GPS and the sensors and cameras installed in the vehicle and allows the driver to run on the road without driving himself. The key technology of autonomous vehicles is to implement an optimal control system through real-time information fusion in the presence of different sampling, time delay and unspecified disturbance. In this study, a robust controller is designed by distributed image processing algorithm using dynamic motion of vehicle for each sensor and data fusion using these results. In addition, the autonomous vehicle control system is applied to real-time optimization based control and prediction method and the proposed control system is verified through application to simulation vehicle.