After installing Apache and trying to start the server, you get an error telling you that ProxyErrorOverride is not a valid command.
A likely cause for this problem is that proxy_http is not enabled.
Reading the status for apache2.service:
Invalid command 'ProxyErrorOverride', perhaps misspelled
Enable the proxy_http module by typing the following command:
sudo a2enmod proxy_http