Rhossili's old rectory is supposedly haunted, as is the Atlantic-facing bay it faces from the foot of Rhossili Downs.
You can read these tales and more Gower ghost stories in the Explore Gower guidebook Gower Ghosts.
A photography portfolio of the Gower Peninsula by author/photographer Chris Elphick