For solving a kind of multi-agent collaboration task planning problems with limited communication environment, this paper proposes a multi-agent online planning method based on MAXQ-OP. And in the Robocup soccer simulation 2D Wall Station and many players pass the ball to the algorithm in question did an experiment. The experiment shows intelligent agent in this method than the traditional algorithm has increased significantly in the scenario which cooperation is needed.