The approaches of web mining have been classified into three types, web usage mining, web structure mining, and web content mining. The web usage mining consists of three phases: data preprocessing, pattern discovery, and pattern analysis. In this paper, we use STPN web structure model to solve path completion and use the link graph to calculate a transition matrix containing one-step transition probabilities between the states in the Markov model. Finally, we compare the probability of linking each page by using Markov model and the probability that we predict. We provide the administrators adjusting the web structure and content to make the navigation of user more convenient.