In the paper, we propose a new automatic road sign detection and locating system to assist path planning and location the road sign. In the system, Back-Propagation Neural Networks has been first adopted to search the road sign of interest, and then the morphology is employed to smooth the RSOI. In the real environment road signs are usually affected by affine distortion. Therefore, we use perspective-transformation-invariant generalized Hough transformation to detect and locate the road signs accurately. Several experimental results are also included to demonstrate the practicable of the system.