This study proposes a novel learning-based point cloud structurization method especially for building components such as plates, beams, columns, and walls. The proposed model net learns from the point clouds generated by existing building information modeling (BIM) components to predict the geometric model of a newly given point cloud consequently. It is worthy to note that the BIM-to-Point cloud approach overcomes the difficulty of 3D training data acquisition that is usually confronted in most deep learning applications. The average precision (AP) of each category achieved a precision of above 50% in the classification task, in which the wall category yielded a precision of 77%. On the other hand, the predicted object corner positions reported an accuracy better than 25cm, in which the beam category revealed an accuracy of up to 10cm. Moreover, the quality of the geometric model in vector-linking prediction reached a precision of 70% suggesting that the proposed learning-based method can indeed reconstruct the geometric model of a given point cloud automatically.