Simply put, survivor benefits are paid to those who are eligible for them based on your work record prior to your death. The more you pay into Social Security, the more valuable your survivor benefits will be to your loved ones. That is one reason why we don’t recommend taking your retirement benefits early. Doing so reduces your survivor benefits. Spouses, ex-spouses, and family members may be eligible for survivor benefits.