To solve the large residual problems which may occur during weight training, QuasiNewton
algorithm was combined with Levernberg-Marquardt algorithm to form a new comprehensive learning
algorithm, named LM-QuasiNewton, for feed-forward neural networks. Simulation shows that LM-
QuasiNewton algorithm can effectively solve large residual problems with better convergence and stability
compared with otherweight learning algorithms.