Traditional smoothing method will cause the loss of image edge information, to solve this problem, a smoothing filtering method based on border information is proposed in this paper. This algorithm detect the image edge, then use different method to smooth the image edge pixels and the other pixel, effectively eliminate noise while preserving the edge information. Experimental results shows, to reduce Gauss noise and salt and pepper noise, our method takes less time, have good noise reduction effect, and keep the image edge clear. So our method has a good practicality.