Renormalization is a deep idea in physics, and it is interesting to find some simple models where it can be performed exactly. One such problem is particles interacting with localized sources which, nonrelativistically, is the delta function potential. We will show that all the usual rules of quantum mechanics apply for this renormalized problem, even on a general two dimensional Riemannian manifold. We will discuss some extensions of these ideas.