While navigation could be done using existing rule-based approaches, it becomes more attractive to use learning from demonstration (LfD) approaches to ease the burden of tedious rule designing and parameter tuning procedures. In our previous work, navigation in simple dynamic environments is achieved using the Learning to Search (LEARCH) algorithm with a proper feature set and the proposed data set refinement procedure. In this paper, the multi-step learning approach with goal-related information is proposed to further capture the successive motion behavior of the user in complex environments. The behaviors of the demonstrator could be matched by the motion control module in which policies of the demonstrator are well captured.