The program can be installed alone from http://www.apache.org/dyn/closer.cgi.
Apart from that, a portable all-in-one is XAMPP.
apt-get install apache2
The service should be restarted manually after the most part of the configuration modifications:
vim /etc/httpd/conf/httpd.conf /etc/init.d/apache2 restart