The stud is probably spinning inside the housing. Try pushing up on the light by placing a plastic or wood wedge between the light and the pedestal. It may help to hit them with some penetrating fluid and let them sit overnight before you proceed.
This getting older ain't for cowards. - John Mellencamp