It is said that this chapel originates from the Confraria das Almas (Brotherhood of Souls) that supported a rudimentary hospital, named S. Tiago, which housed poor and sick travellers. Later, a larger chapel was built, named Senhora da Misericórdia, and the brotherhood was also renamed Senhor dos Passos. It was rebuilt at the end of the 19th century.