Interpolation algorithm is widely used as image scaling tool in image processing. The better interpolating algorithm not only requires the processing speed to meet the demand, but also has better processing visual effect. In this paper, an image enlarging algorithm based on Newton interpolation algorithm is proposed. First of all, the algorithm fits the image pixel values of the specific region in a certain area, and then enlarges the image. Through the contrast test, result shows that the proposed algorithm can realize the image enlargement operation well, and on image detail processing also has a good visual effect.