Williams has been sidelined since September with an ankle injury, but the Wales international is back in contention after coming through 45 minutes of Palace's under-21s' clash against Queens Park Rangers unscathed this week.
Fellow winger Jerome Thomas is a doubt after picking up a groin injury in training, while club captain Paddy McCarthy remains out with a long-term groin problem.