Does a water softener remove fluoride?

No.

A water softener will only exchange positively charged ions (metals), calcium, potassium, sodium and magnesium but not negatively charged ones like fluoride, chloride, sulphate or nitrate.