The popularization of intelligent equipment, following the rapid development of wireless communication technology, has also promoted the demand for bandwidth occupancy services such as video streaming. The technology combining KCN technology and mmWave technology can meet the demand of rich bandwidth and large rate transmission in the future. However, the combination of these two technologies will bring novel challenges in forwarding strategies, routing algorithms and so on. In this paper, according to the characteristics of the KCN network with mmWave communication, a stochastic optimization algorithm is proposed for the multi-path content forwarding problem aiming at the base station with the function of sending mmWave and in-network caching. Then the Lyapunov stability equation is adopted to further analyze this optimal problem. Through the optimization of the queue problem, the problem is further decomposed into three optimal sub-problems. At the same time, each physical meaning of these three decomposed problem is shown. At last, extensive simulations are performed in terms of provided stochastic optimal forwarding algorithms.