I would first try the spot healing brush tool (j). You may need to turn off content aware, depending on the size of the area and how close it is to the text, but you can quickly touch up the problem areas with it, and then paint/clone stamp out any problem areas.