Abstract: Q learning is of great importance in reinforcement learning. MQ algorithm with multi-step predicting capability is proposed to compensate the drawbacks of Q learning and Q（λ）algorithmin in this paper . Firsly MDP model is presented. Then based on the anal

Key words: Reinforcement learning, MQ algorithm, Q learning, Q（λ）algorithm