Late payments can take a serious toll on your credit rating, especially if payments are reported to be of 90 days late or more. If you are looking to improve your credit score, it is worth it to look into the steps you can take in an attempt to remove late payments from your credit file.