Also known as a vacation message or an out of office message. Automatic reply is a rule that can be set in your Office 365 account that will automatically reply to incoming emails with a preset response for a preset amount of time.