With the growth of the automotive electronics technology, the advanced driver assistance system (ADAS) becomes more and more important. Especially, the moving object detection (MOD) is an important issue in the ADAS in intelligent vehicles. In realistic systems, there exist two critical challenges including computing time and detection rate for MOD. To overcome these problems, we propose a novel moving object detection system which contains pre-processing, feature extraction, classification and state machine. The pre-processing contains ROI extraction and skipping low busyness windows, which accelerates the computing time to solve the mentioned problem. To improve the performances, in this paper, the weighted histogram of oriented uniform gradient (WHOUG) with support vector machine (SVM) is proposed to promote the detection accuracy. Besides, the finite state machine could further improve the robustness of the proposed system. The results demonstrate that the proposed system achieves better performance than the traditional one, and also maintains real time computation.