The English term "savings bank" matches the Swedish term "sparbank"

other english words that include "savings" : swedish :
savings besparingars, parmedel
savings account sparkonto