A web server is a computer sitting on the internet with an address. When you type its address into a web browser it returns a web page. The point of a web server is that they are always on, providing your website day and night even when you or your organisation have gone home for the day.
A web server holds all the files that make up your website. They also often act as a mail server which handles all the emails that use the same domain name as your website.