If your email server is offline then mail won’t be delivered. The sender’s server will retry as other have noted, but how often and how many times varies. Hosting at home, even when possible, is not a great idea in my opinion.

There are endless options for hosting out there, I don’t want to name names since I only really have experience with one.