With the care of the nobleman Petras Šiukšta, the constructions of a brick church in place of the wooden one began in 1635. The church was restored in 1902-1919 (and remained such to this day). Apytalaukis Church of St. Apostles Peter and Paul is Baroque with Renaissance features. There is a parish cemetery near the church. Members of Šiukšta and Zabiela families, owners of Apytalaukis village, were burried in the cemetery and the cellars of the church. Parents of the Nobel Literature Laureate Czeslaw Milosz married in this church.
Apytalaukis Village, Vilainiai Local Authority, Kėdainiai District