As a data analysis software based on Postgre SQL and Greenplum, MADlib provides different kinds of mathematical, statistical and data mining methods. This paper introduces the design and implementation of java-based MADlib automation test framework, which can process and load data, generate and execute test cases, analyze test result automatically. As a result, large amounts of work from manual test can be avoided. What’s more, this test framework is easy to develop and maintain because it is developed in Java.