Is the remaining balance after paying medical expenses in a HSA taxable?

I understand the contributions I make each payroll are pre-taxed but if I want to save up for a few years for an emergency and not use it, am I taxed on my contributions each year? I don't understand the benefit of doing this unless I have a lot of medical expenses the same year.