Goof Off works well for removing sticker or glue residue
http://www.valsparglobal.com/val/resident/goof-off.jsp
You might also try WD40 - I hear it works too just be careful not to get it on the bristles of the brush.