Difference between revisions of "OPS335 Lab 6"

From CDOT Wiki
Jump to: navigation, search
m (Allowing samba access to home directories with SELinux enabled.)
m (INVESTIGATION 3: INSTALL, CONFIGURE & RUN WEBMAIL APPLICATION (Roundcube Mail))
 
(88 intermediate revisions by 6 users not shown)
Line 1: Line 1:
 
[[Category:OPS335]][[Category:OPS335 Labs]]
 
[[Category:OPS335]][[Category:OPS335 Labs]]
  
==SAMBA SERVER RESOURCES==
+
== OBJECTIVE & PREPARATION==
 +
[[Image:lamp.png|thumb|right|300px|To provide additional help make your web resource more dynamic (for web apps such as webmail) several services are also required. A popular acronym to represent these foundations and servers is referred to as '''LAMP'''. It stands for '''Linux''', '''Apache''', '''MySQL''', and '''PHP''' (or ''Python'').<br><br>Image by Shmuel Csaba Otto Traian,<br>https://commons.wikimedia.org/w/index.php?curid=28224098)<br>(via: [http://creativecommons.org/licenses/by-sa/3.0 Commons Attribution-Share Alike 3.0]) ]]
 +
In this lab, we will look at several separate technologies that are used with the Apache web server to install, configure and run web applications.
  
Online References:
+
The basic purpose of the Apache web server is to serve text pages, images, and other static files. You can format those web-pages to appear nice, but they would lack dynamic functionality (i.e. the ability to change colors or font-size when the mouse moves over a link, button, etc). In other words using Apache web-server as a sole application would not make your web-pages more interesting.
  
* (Course Notes on Samba Server)
+
If we want to add more features for our web-page (eg. dynamic functionality, security, e-commerce, etc), your webserver would need additional help. To provide additional help requires several resources - more than just the web server itself. A popular acronym to represent these foundations and servers is referred to as '''LAMP'''. It stands for '''Linux''', '''Apache''', '''MySQL''', and '''PHP''' (or ''Python'').
*[http://www.tomsitpro.com/articles/linux-server-configuration-guide-book-excerpt,2-777-2.html Samba Server Setup] (Simple setup guide for samba server]
 
  
==OVERVIEW==
+
In your previous OPS235 course, your second assignment may have required you setup a similar series of services in order to run a Wiki on one of your virtual machines. In this lab, we will set up another example of a '''"LAMP solution"''' that will allow the user to run webmail in a web-browser to send and receive e-mail messages.
  
According to the samba.org website:
+
=== Online Resources===
  
''"Samba is the standard Windows interoperability suite of programs for Linux and Unix. Samba is Free Software licensed under the GNU General Public License, the Samba project is a member of the Software Freedom Conservancy."''
+
* [http://www.liquidweb.com/kb/how-to-install-apache-on-centos-7/ Installing Apache Webserver on Centos7]
 +
* [http://www.w3schools.com/php/default.asp PHP Tutorial] (w3schools.com)
 +
* [http://www.w3schools.com/sql/ MySQL / SQL Language Resources] (w3schools.com)
  
Although a Samba server can provide many features such as printer sharing and backups, this lab's primary focus is to set up a Samba server on a Linux server in order to allow MS Windows users to share common files from the Linux's Samba server.
+
== INVESTIGATION 1: SETTING UP A WEBSERVER WITH DYNAMIC WEBPAGES ==
  
This lab will first install, setup, and enable a Samba server. Then another virtual machine will be created for a Windows operating system. Finally, within the Windows virtual machine, users will access files from the Linux Samba server (both graphically and command line).
+
=== Install, Configure & Run a Webserver (Apache) ===
  
 +
Next we need to install, configure and run a webserver on one of our Linux VMs.
  
==INVESTIGATION 1: INSTALLING &amp; CONFIGURING A SAMBA SERVER==
+
'''Perform the following steps:'''
 +
 
 +
#Make certain you are in your '''VM1''' machine.
 +
#Install the Apache package (the name of the package is '''httpd''').
 +
#Start the httpd service, and enable this service to start automatically upon system startup.
 +
#Using a text browser such as '''lynx''' on vm1 go to http://localhost. You should get the Apache Test Page which indicates your web server is running on the local virtual machine.
 +
#Make certain to configure your firewall to allow access to the httpd service (i.e. the Apache serves HTTP traffic which goes over TCP port '''80''') and keep the changes past rebooting.
 +
#Open a web-browser in your '''host''' machine and enter the following URL: '''vm1.youruserid.ops'''.<br />If you setup your Apache webserver correctly, you should be able to view the Apache Test page.
 +
#Although we will not be exploring webservers in depth, we will have you create a simple webpage for testing purposes, then later setup a web resource for webmail.
 +
#The term '''DocumentRoot''' specifies where the Apache webserver will search for documents to serve. Create the file '''index.html''' in your '''DocumentRoot''' directory with the following contents (replace the date with the current one):<br><source>Hello, this is a web page on vm1.youruserid.ops and the current time is Mar 28 22:16:27 EDT 2016!</source>
 +
<ol><li value="9">If you refresh your web-browser page in your browser, you should see the contents of your ''index.html'' document. If you wish, you can specify the filename index.html in the address, but it is not necessary, since the file index.html is automatically loaded by default when the URL refers to that directory containing that file.</li></ol>
 +
 
 +
 
 +
{{Admon/tip |Using the '''index.html''' file|It is considered to be a "best practice" to create '''index.html''' files for newly-created subdirectories within the '''DocumentRoot''' (or users' '''public_html''' directories) to force a display of a web-page, instead of viewing the directories "index" listing of files (from "curious eyes"): that is why the name of the file is called ''"index.html"''.}}
 +
 
 +
 
 +
<ol><li value="10">Refresh your web-page by issuing the keycombination: '''ctrl-r'''. Notice that the time doesn't change as you refresh the page. This indicates that the page is static (not dynamic) indicating that the page does not change (i.e. boring!).</li></ol>
  
In this investigation, we will set up a '''Samba server''' on our '''VM2''' machine. We will first install, configure and enable the samba server on our virtual machine, and then we will quickly test to see if the Samba server works.
+
=== Creating a PHP Script ===
  
 +
In order to allow us to run a webserver application in a web-browser, we need a scripting language that will allow the web-browser to function dynamically (i.e. being able to change frequently, as opposed to being "static" or unchanging). In this section, we will demonstrate how a scripting language (PHP) can be used for the web-browser to react in a more dynamic fashion.
  
{{Admon/important|Prerequistites|Due to the changes made in lab3, '''you will now need your vm1 running (as the DNS server)''' in order for any of your virtual machines to be able to use the internet.}}
+
{{Admon/tip |PHP Scripting Language|PHP code is considered to be a language that runs on the web-server (i.e. "server-side programming"). PHP code can be embedded in an HTML document (HTML code), and use the resources on the "server-side" to make the web document or resource more dynamic (eg. database access, etc). Although it is not the purpose of this course to learn about and create PHP documents, here is a quick resource on PHP: [http://www.w3schools.com/php/default.asp PHP Tutorial]}}
  
 
'''Perform the following steps:'''
 
'''Perform the following steps:'''
  
#Make certain that both your '''VM1''' and '''VM2''' machines are running.
+
#'''Copy''' the '''index.html''' file as '''index.php''' and modify it to contain:<br><source>Hello, this is a web page on vm1.youruserid.ops and the current time is <?php system("date"); ?>!</source>
#Switch to your '''VM2''' machine as the '''root''' user.
+
 
#Issue the following Linux command to install Samba server utlity:<br>'''yum install samba samba-client'''<br>
+
<ol><li value="2">On your host machine, in the web-browser manually add '''/index.php'''. Notice that in a web browser the ''index.php'' file isn't treated as a default page and the contents don't contain the date, but instead are displaying the text in the php code you entered into the index.php file (refer to above code).</li>
#Copy the file '''/etc/samba/smb.conf''' to another filename by issuing the following command:<br>'''cp /etc/samba/smb.conf /etc/samba/smb.conf.original'''
+
<li>The reason this occurs is that the PHP interpreter hasn't been installed on your vm by default.</li>
#Clear the contents of the configuration file by running '''cat /dev/null > /etc/samba/smb.conf'''
+
<li>Install the '''php''' package on your vm1 machine, and restart your webserver. NOTE: The php package comes with a working default Apache configuration so you don't need to enable it manually.</li>
#Edit '''/etc/samba/smb.conf''' so that the file that contains the following lines:
+
<li>Refresh the webpage in your web-browser on your host machine. You should now notice that you see the date instead of the call to the date command. Refresh your webpage several times to see how the time changes. This is simply a "trivial example" of dynamic web content does it does provide a simple demonstration of how scripting languages can be used to create more dynamic webpages.</li>
[global]
+
</ol>
workgroup = WORKGROUP
 
server string = "put your real name here without the quotes"
 
encrypt passwords = yes
 
smb passwd file = /etc/samba/smbpasswd
 
 
 
[home]
 
comment = "put your real name here without the quotes"
 
path = /home/<yourSenecaID>
 
public = yes
 
writable = yes
 
printable = no
 
create mask = 0765
 
<ol><li value="3">Append (add) the following parameter to the bottom of the '''[global] section''' that will limit access to the share so that only machines in your virtual network and those in the lab room will be able to access it:</li></ol>
 
hosts allow = 192.168.x. 127.0.0.1
 
<ol><li value="4">Append (add) the following parameter to the '''[home] section''' so that only your user account can access that share:</li></ol>
 
valid users = <yourSenecaID>
 
<ol><li value="5">Create a Samba account and password for yourSenecaID by issuing the following command:<br>'''smbpasswd -a <yourSenecaID>'''</li></ol>
 
  
{{Admon/tip|Changing Existing Samba Account Passwords|If you need to change a user's existing Samba account password, you can issue the following command as root: '''smbpasswd username'''.}}
+
=== Controlling Access to Pages ===
  
<ol><li value="6">Confirm the user you created has been added using the following command:<br>'''pdbedit -L -v'''</li><li>Test and review your configuration with the command:<br>'''testparm'''</li><li>Use the '''systemctl''' command to start the smb.service and enable the service to run on boot-up</li><li>If you are in one of the sections with SELinux set to enforcing, you will need to tell it to allow samba access to home directories: '''setsebool -P samba_enable_home_dirs 1'''</li><li>Install the ''netstat'' command by issuing the following command:<br>'''yum install net-tools'''</li><li>Issue the '''netstat -nautp''' command to see with port Samba is running on.</li><li>Use the information in the previous step to modify the firewall on VM2 machine to allow samba traffic.</li><li>Test to see that you can connect to your Samba server (locally) by issuing the following command:<br>'''smbclient -U <yourSenecaID> -L 127.0.0.1'''</li><li>When prompted, enter your Samba account password.</li><li>The output from that issued command show appear similar to example displayed below:</li></ol>
+
For security, it is important to allow access to general areas of your webpage, but also limit access to other sub-directories that contain other webpages or documents. Penetration Testers or hackers may be able to navigate your file systems within your html directory to obtain unauthorised information.  
 
Sharename      Type      Comment
 
---------      ----      -------
 
home            Disk      Your Name
 
IPC$            IPC      IPC Service ("Your Name")
 
Domain=[WORKGROUP] OS=[Windows 6.1] Server=[Samba 4.2.3]
 
 
Server                Comment
 
------                -------
 
 
WorkGroup            Master
 
---------            ------
 
 
<ol><li value="13">To access the Samba client shell on your local Samba share, issue the following command:<br>'''smbclient '\\127.0.0.1\home' -U <yourSenecaID>'''</li><li>Enter your Samba account password.</li><li>Issue the help command to note common commands (''dir'', ''cd'', ''ls'', ''put'', ''get''). Note how similar they are to ''sftp'' commands.</li><li>Enter '''exit''' to terminal your local Samba session.</li></ol>
 
  
Although you can use smbclient to access, browse and share files within other Linux and Windows servers, it is more practical to setup a Samba server to allow MS Windows Users to access a common file share on a Linux machine, and will be demonstrated in Investigation 2.
+
There are many common-sense safeguards, such as creating an index.html file in your default directory that will display a webpage instead of the directory index. On the other hand, there are also safeguards that you can setup to provide additional protection to your data on your web server.
 +
 
 +
'''Perform the following steps:'''
 +
 
 +
# As the root user on your gateway/host, try to forward incoming http connections that arrive on your host to the web server on vm1. Use an iptables command something like this:<br><source>iptables -t nat -A PREROUTING -p tcp --dport 80 -j DNAT --to 192.168.X.2</source>OR this (whichever works):<br><source>iptables -t nat -A PREROUTING -i *externalinterface* -p tcp --dport 80 -j DNAT --to 192.168.X.2</source>
 +
 
 +
{{Admon/important |Do not save these rules|The PREROUTING rule above will redirect all HTTP requests to vm1. That will be a problem in the future when you run yum install or yum update, which downloads things over HTTP.}}
 +
 
 +
# You will also need to create a rule in the FORWARD chain in the default table to accept connections to port 80.
 +
# To test this setup you'll need to use another machine outside your own network.  For this purpose you can simply use the host (machine running Vmware).
 +
# Have the external machine view both '''index.html''' and '''index.php'''
 +
# Create a new directory called '''private''' inside your '''DocumentRoot''' and move index.php inside it.
 +
# View both files again.<br><br>You will now modify the settings on the web-server to prevent machines outside our network from accessing the private directory.<br><br>
 +
# Add the following directory statement to your apache configuration file. The default pathname for the apache configuration file is: '''/etc/httpd/conf/httpd.conf''' (NOTE: replace the X with your own network octet):
 +
 
 +
{{Admon/important |Do not overwrite existing settings|There should already be two Directory statements in that file.  One for '''/var/www''' and one for '''/var/www/html'''.  Add your new Directory statement after them.  Do not overwrite them.}}
 +
 
 +
<source>
 +
<Directory "/var/www/html/private">
 +
  AllowOverride None
 +
  Require ip 192.168.X.0/24
 +
</Directory>
 +
</source>
 +
 
 +
This sets up separate rules and access permissions for that subdirectory. Your should no longer be able to access any pages in the private directory (or any sub-directories of it) from external machines, but your internal machines (including your host) should still have access.
  
 
'''Record steps, commands, and your observations in INVESTIGATION 1 in your OPS335 lab log-book'''
 
'''Record steps, commands, and your observations in INVESTIGATION 1 in your OPS335 lab log-book'''
  
==INVESTIGATION 2: CONNECTING TO A SAMBA SERVER FROM A WINDOWS CLIENT==
+
== INVESTIGATION 2: SETTING UP AN ONLINE DATABASE==
  
This investigation will configure your VM2 machine to act as a Samba File server to allow Windows OS Users access to the Linux Samba server files.
+
The next piece of the puzzle is installing, configuring, and running a database server to support your webmail application that will be installed and setup later in this lab.
  
=== Creating a Windows7 Professional VM ===
+
=== Install, Configure and Run MySQL Database Server ===
  
To demonstrate how to access and share files from a remote MS Windows server using '''smbclient''' on your '''host''' machine, we will install a Windows7 Professional machine as a virtual machine.
+
MySQL is used to allow storage and retrieval of structured data. SQL is a command language (used by scripting languages such as PHP) to allow programmers to access databases contained within a server (or other servers via a network) to be used within web-based applications via the web-browser.
 +
 
 +
We won't spend much time learning the details of MySQL configuration but you need a basic server set up. You may remember when setting up MySQL from OPS235 - it is basically the same concept.
 +
 
 +
{{Admon/tip |MySQL / SQL Language Resources|Again, MySQL can be a complex topic: Seneca has an entire course that concentrates on using SQL commands! Here is a link to MySQL / SQL Language resources: [http://www.w3schools.com/sql/ MySQL / SQL Language Resources].}}
  
 
'''Perform the following steps:'''
 
'''Perform the following steps:'''
  
#Make certain you are using your '''host''' machine.
+
#Install '''mariadb-server'''.<br /><br />  The MySQL and MariaDB are actually two <u>separate</u> projects run by different groups, yet they are compatible; therefore, you can use documentation from one to configure the other. <br><br>
#Download a version of MS Windows7 Professional ISO file to your host machine. If you have already downloaded an ISO file, then you can use that (i.e. transfer to your host machine).<br>'''NOTE:''' You cannot use a CD/DVD since KVM does not install by CD/DVD.<br><br>'''ALTERNATIVE METHOD:''' You could also refer to the following link to download Windows7 OS image: https://inside.senecacollege.ca/its/software/ , <br>select '''Software Downloads''', login with your senecaid and password, select '''MSDN''', and then select a Windows7 Professional iso image to download.<br>You are <u>not</u> required to obtain a product key since you will not need to extend the use of this Windows OS over 60 days.
+
#'''NOTE:''' When installing mariadb, make certain that you have not just the '''client''' but also the '''server software'''.
 +
#When you start the MySQL service, check the system log file for instructions regarding how to set the root password. Even though we will '''not''' configure our MySQL service to be '''accessible over the network''', it is accepted as a "best practice" configuring for network access for each MySQL installation.
 +
#Note that the MySQL service has two root passwords:<ul><li>For the localhost</li><li>For external requests</li></ul>
 +
#Start the mariadb server, then refer to the log file (by running '''journalctl -xe''') to learn how to run the two commands in order to generate the appropriate passwords.<br><br>NOTE: Use a password you make up yourself, but do <u>not</u> use your own secret password, since you will be storing that password in a plain text file for later reference.
 +
#Start the service and ensure that it will start automatically every time the machine boots.
  
{{Admon/tip |Rearming the Windows Trial Version|If are your trial period for your Windows machine is nearly over, you can extend the trial period for another 30 days by running a command prompt as the <u>administrator</u> (right-click on '''cmd''' icon) and issuing the command: '''slmgr -rearm'''. Obviously, you are required to perform this operation prior to the termination of the initial trial period.}}
+
=== Test Connection to MySQL Database Server ===
  
 +
While the web server (with php), and MySQL server may be working individually, we need to ensure that they can connect to each other. Since this test will involve storing the database password in a plain-text html file, we want to make sure no one else can access it.
  
<ol><li vaLUE="3">Create a new virtual machine (RAM: '''1024 MB''', hard drive size: '''20 GB''', accept all other defaults) making certain to specify the location of your downloaded Windows OS iso file.</li><li>Install the Windows OS creating a default user as the administrator.</li><li>Upon successful installation, log into the Windows machine as a regular user, open a command prompt and using the '''ping''' command to confirm that you can connect to your VM2 machine.</li></ol>
+
'''Perform the following steps:'''
  
===Accessing Files on a Linux Samba Server via Windows Explorer ===
+
# Modify the Directory statement for your '''private''' directory to prevent any machine other than your vm1 from accessing it.
 +
# Re-start the web-server and try to access the page from another machine.  Make sure that you can '''not''' do so before you continue.
 +
# Install the '''php-mysql''' module so that the installation of php your web server is using can execute sql statements.  You will have to restart the service after installing it.
 +
#Modify the '''index.php''' page in your '''private''' directory to match the code below.  This will test that your web server can connect to the database (replace the <user> and <password> with values appropriate for your machine):<br><source>
 +
<?php
 +
$mysqli = new mysqli("localhost", "<user>", "<password>");
 +
if ($mysqli->connect_errno) {
 +
    echo "Failed to connect to MySQL: (" . $mysqli->connect_errno . ") " . $mysqli->connect_error;
 +
}
 +
echo $mysqli->host_info . "\n";
 +
?>
 +
</source>
 +
#Once that page shows a successful connection on your VM ('''Localhost via UNIX socket''' via the '''lynx''' application) this step is complete.
  
With some additional "tweaking" to your Linux Samba server configuration file, you should be able to access files on that file from a Windows machine on the same network. You will be creating a Samba share for your home directory of your regular user account.
+
You have now established that the web server is able to run code which can interract with the database. This will allow dynamic pages to make use of information stored there when providing resources to your users.
  
'''Perform the following tasks:'''
+
'''Record steps, commands, and your observations in INVESTIGATION 2 in your OPS335 lab log-book'''
  
# Make certain that both your '''VM2''' and '''Windows''' virtual machines are running.
+
== INVESTIGATION 3: INSTALL, CONFIGURE &amp; RUN WEBMAIL APPLICATION (Roundcube Mail) ==
# On your Windows VM, temporarily turn off the firewall for your Windows machine.
 
# Open the Windows Explorer application.
 
# At the top of the application, enter the following:<br>'''\\IPADDR_OF_VM2_MACHINE\home'''
 
  
{| width="40%" align="right" cellpadding="10"
+
{|cellpadding="15" width="40%" align="right"
  
 
|- valign="top"
 
|- valign="top"
|
+
 
[[Image:samba-login.png|thumb|right|300px|You will be prompted (once only) for the Samba user-name and password for your '''VM2''' machine). ]]
+
|width="10%" | [[Image:Roundcube.png|thumb|right|200px|'''Roundcube''' webmail application Logo<br>GPL,<br> https://commons.wikimedia.org/w/index.php?curid=1772791]]
|
+
 
[[Image:samba3-map-drive.png|thumb|right|300px|You can create a '''mapped network drive (z:)''' for your Linux Samba server network share). Make certain that '''Reconnect at Login''' option is enabled. ]]
+
|width="10%" |[[Image:roundcube-pic.png|thumb|right|300px|Screencapture of '''roundcube''' webmail application running in order to send and receive mail messages via a web-browser.]]
 +
 
 +
 
 
|}
 
|}
  
<ol><li value="5"> You will be prompted to enter your VM2 username and password (one time only). Refer to diagram on right.<br><br>'''NOTE:''' It may take approximately 30 seconds to display the file contents.<br><br></li><li>Where your successful? If not, try to troubleshoot the problem first, then ask your lab assistant or instructor for assistance.</li><li>Close the Windows Explorer application window.</li><li>Click on the '''START''' menu, and click on '''Computer'''.</li><li>Click on the Map Network Drive button, and create a '''mapped network drive''' (called it drive '''Z:''') which is a Samba share of your VM2 machine for the home directory making certain option to '''Reconnect at Login''' is enabled.</li><li>When finished, click on '''Network''' in Windows file manager to confirm that the network share is present.</li><li>Restart your Windows VM and confirm that the network share is active.</li><li>Try to create a file on your Windows VM on your Linux Samba machine. Were you able to create a save a file?</li><li>Switch to your VM2 machine and check to see if that file was created in your home directory.</li><li>Finally, enable your Windows VM firewall, but with an exception for a Samba connection (i.e. the port number obtained from the previous investigation).</ol>
+
In the investigation, we will simply install, configure and run the '''roundcube''' webmail application.
 +
'''Perform the following steps on vm1:'''
 +
<ol>
 +
<li>Download the lastest '''Complete''' "zipped tarball" from their website (https://roundcube.net/download/) using wget on the download link .</li>
 +
<li>Extract the "zipped tarball" and rename the generated directory that contains download source code to: '''webmail'''.  Also make sure that '''webmail''' is a sub-directory of your '''DocumentRoot'''.
 +
* Use the '''--no-same-owner''' option when extracting the tar achive to ensure that the files do not keep the original owner (who will not exist on your system).</li>
 +
<li>Change the ownership of the '''temp''' and '''logs''' directories so they belong to '''apache'''.</li>
 +
<li>If you're not in Andrew's sections and you have SELinux enabled: This service needs to be able to write to several directories ('''temp''' and '''logs''') that SELinux prevents write access to.  If you are in a section that has SELinux set to '''enforcing''', run the following commands to let it know that apache should be allowed to write to files in those directories.
 +
<source>
 +
semanage fcontext -a -t httpd_log_t '/var/www/html/webmail/temp(/.*)?'
 +
semanage fcontext -a -t httpd_log_t '/var/www/html/webmail/logs(/.*)?'
 +
restorecon -v -R /var/www/html/webmail
 +
</source>
 +
::NOTE: If your machine does not have the '''semanage''' command, use yum to install the '''policycoreutils-python''' package.
 +
You will also need to tell selinux to allow the webserver to open connections to the MTAs with <source>setsebool -P httpd_can_network_connect 1</source></li>
 +
<li>In the directory now named "webmail",  there will be a file named '''INSTALL''' which will walk you through the rest of the Roundcube installation.
 +
<br /><br />Some installation tips to consider:
 +
::* Be careful about copying &amp; pasting the MySQL setup part: take time and pay attention to detail: do not try to "rush it".
 +
::* You will need to install additional Apache modules including: '''php-xml''' and '''php-mbstring'''.
 +
::* Don't forget to set the password in the roundcube configuration.</li>  
 +
<li>To make things easier, RoundCube has a well configured installation page available through your local web browser (You will see a note about it in the '''INSTALL''' file).</li>
 +
 
 +
::* Go onto your host, open Firefox and on the address bar type '''vm1.<yourSenecaID>.ops/webmail/installer''', make sure your dns on host can resolve the web address. Alternatively, instead of "vm1.<yourSenecaID>.ops" you can input the ip address of your vm1, '''192.168.X.2/webmail/installer''', change X to your own IP octet.
 +
::* Inside the web browser installer, ensure all required options are "'''ok'''", if "'''DOM: not ok'''" it means you need to install additional php packages (yum install php-xml php-mbstring). Once everything is ready (it will not let you continue otherwise) click next go to the next page.
 +
::* On the next page, under the '''IMAP settings''' insert '''vm3.<yourSenecaID>.ops''' in '''default_host''' field and '''143''' in '''default_port''' field. Under '''SMTP settings''' insert '''vm2.<yourSenecaID>.ops''' in '''smtp_server''' field, and '''25''' in '''smtp_port''' field. Ensure '''smtp_user/smtp_pass''' is '''empty''' and '''uncheck''' the "Use the current IMAP username and password for SMTP authentication" checkbox.
 +
::* Under '''Database setup''' '''db_dsnw''', enter "localhost" as your database server, "roundcubemail" for database name. Put "roundcube" as Database user, and the password you set for the roundcube user when you configured that in the previous step for database password. Everything else can be left as default.  
 +
::* Click Next to create the configuration file, then download it to your '''host'''. By default it will be saved under '''~yourSenecaID/Downloads'''. Transfer that file '''to vm1''' using '''scp''' and place it inside '''/var/www/html/webmail/config''' folder.
 +
::* Go to test config page if you are not there already and "Check config file" should be ok. "Check DB config" should also be ok, if not check your mysql settings.
 +
::* Make sure your SMTP and IMAP servers are running, then finally test your configuration by sending email using your smtp server through test field provided by webmail installer, you should receive a test email sent by RoundCube. Test your IMAP settings by simply loging in with your SenecaID and vm3 password on the same webpage.
 +
::* If everything works properly you can '''skip to''' step 9. *Remember you can edit the configuration file manually by editing "/var/www/html/webmail/config/config.inc.php".
 +
</li>
 +
<li>Note that both of your IMAP and SMTP servers are on different machines (i.e. not on vm1). Therefore, you should see custom values in the following parameters in the Roundcube configuration file:
 +
 
 +
<source>$config['smtp_server']
 +
$config['smtp_user'] = '';
 +
$config['smtp_pass'] = '';
 +
$config['default_host']
 +
$config['default_port']</source>
  
 +
:::'''NOTE:''' The last <u>two</u> entries above refer to your IMAP server
  
'''Record steps, commands, and your observations in INVESTIGATION 2 in your OPS335 lab log-book'''
+
</li>
 +
<li>Now that you have Roundcube installed it is time to test if the roundcube webmail application is working by logging on, then sending and receiving e-mail messages:
 +
*Using the Firefox webbrowser, navigate to '''vm1.<yourdomain>.ops/webmail''' and login (using the username only).
 +
*Use the interface provided to send and receive email.</li>
 +
<li>If mail sent through roundcube is sending from the wrong domain (i.e. user@vm3.yourdomain.ops instead of user@yourdomain.ops), each user can override it in the settings tab, or you can set:
 +
::* '''$config['mail_domain']''' </li>
 +
</ol>
 +
 
 +
'''Record steps, commands, and your observations in INVESTIGATION 3 in your OPS335 lab log-book'''
 +
 
 +
{{Admon/important |Backup your VMs!|You MUST perform a '''full backup''' of ALL of your VMs whenever you complete your '''OPS335 labs''' or when working on your '''OPS335 assignments'''. You should be using the dump or rsync command, and you should use  the Bash shell script that you were advised to create in order to backup all of your VMs.}}
  
 +
== COMPLETING THE LAB ==
 +
You now have a complete LAMP stack and could host a variety of web-pages that could include dynamically generated content and database access. You also have a webpage that is relying on a number of different services cooperating in order for it to work properly.
  
==COMPLETING THE LAB==
+
===Online Submission===
 +
Follow the instructions for lab 6 on blackboard.
 +
<!--
 +
===Andrew's sections===
  
'''Arrange evidence (command output) for each of these items on your screen, then ask your instructor to review them and sign off on the lab's completion:'''
+
You may choose to:
 +
* Submit screenshots of your work on Blackboard, in which case you don't need to come to the lab.
 +
* Or come to the lab, show me your work, and talk to me about it. I want to hear what you've learned and answer any questions you have.
  
::<span style="color:green;font-size:1.5em;">&#x2713;</span> Proof of network share of VM2 machine from Windows VM via Windows Explorer application
+
You'll get the same grade regardless of how you choose to submit your work.
::<span style="color:green;font-size:1.5em;">&#x2713;</span> Firewall settings on your Windows VM to allow Linux Samba network share
 
::<span style="color:green;font-size:1.5em;">&#x2713;</span> Display contents of '''/etc/samba/smb.conf''' file on VM2 machine
 
::<span style="color:green;font-size:1.5em;">&#x2713;</span> Firewall exceptions (both machines) to allow Samba traffic
 
::<span style="color:green;font-size:1.5em;">&#x2713;</span> Lab logbook completed
 
  
 +
::<span style="color:green;font-size:1.5em;">&#x2713;</span>Download and run '''https://ict.senecacollege.ca/~andrew.smith/ops335/labcheck5.bash''' on your '''host''' machine.
 +
::<span style="color:green;font-size:1.5em;">&#x2713;</span>Completed Lab6 log-book notes.
 +
-->
  
 
==EXPLORATION QUESTIONS==
 
==EXPLORATION QUESTIONS==
  
 
+
# What does the term LAMP stand for? Briefly describe the purpose of each of the following items in LAMP.
#What does SMB?
+
# What is the major difference between a static web document and a dynamic document?
#What is the purpose of the '''testparm''' command?
+
# What does the term "server-side programming" mean?
#What does the text inside square brackets in the '''smb.conf''' file mean? (e.g., "[home]").
+
# What is the purpose of creating and using an index.html file?
#Explain the meaning of the line "create mask = 0765" in the smb.conf file?
+
# What is the purpose of creating and using an index.php file?
#What does the '''smbpasswd''' command do?
 

Latest revision as of 13:12, 29 March 2021


OBJECTIVE & PREPARATION

To provide additional help make your web resource more dynamic (for web apps such as webmail) several services are also required. A popular acronym to represent these foundations and servers is referred to as LAMP. It stands for Linux, Apache, MySQL, and PHP (or Python).

Image by Shmuel Csaba Otto Traian,
https://commons.wikimedia.org/w/index.php?curid=28224098)
(via: Commons Attribution-Share Alike 3.0)

In this lab, we will look at several separate technologies that are used with the Apache web server to install, configure and run web applications.

The basic purpose of the Apache web server is to serve text pages, images, and other static files. You can format those web-pages to appear nice, but they would lack dynamic functionality (i.e. the ability to change colors or font-size when the mouse moves over a link, button, etc). In other words using Apache web-server as a sole application would not make your web-pages more interesting.

If we want to add more features for our web-page (eg. dynamic functionality, security, e-commerce, etc), your webserver would need additional help. To provide additional help requires several resources - more than just the web server itself. A popular acronym to represent these foundations and servers is referred to as LAMP. It stands for Linux, Apache, MySQL, and PHP (or Python).

In your previous OPS235 course, your second assignment may have required you setup a similar series of services in order to run a Wiki on one of your virtual machines. In this lab, we will set up another example of a "LAMP solution" that will allow the user to run webmail in a web-browser to send and receive e-mail messages.

Online Resources

INVESTIGATION 1: SETTING UP A WEBSERVER WITH DYNAMIC WEBPAGES

Install, Configure & Run a Webserver (Apache)

Next we need to install, configure and run a webserver on one of our Linux VMs.

Perform the following steps:

  1. Make certain you are in your VM1 machine.
  2. Install the Apache package (the name of the package is httpd).
  3. Start the httpd service, and enable this service to start automatically upon system startup.
  4. Using a text browser such as lynx on vm1 go to http://localhost. You should get the Apache Test Page which indicates your web server is running on the local virtual machine.
  5. Make certain to configure your firewall to allow access to the httpd service (i.e. the Apache serves HTTP traffic which goes over TCP port 80) and keep the changes past rebooting.
  6. Open a web-browser in your host machine and enter the following URL: vm1.youruserid.ops.
    If you setup your Apache webserver correctly, you should be able to view the Apache Test page.
  7. Although we will not be exploring webservers in depth, we will have you create a simple webpage for testing purposes, then later setup a web resource for webmail.
  8. The term DocumentRoot specifies where the Apache webserver will search for documents to serve. Create the file index.html in your DocumentRoot directory with the following contents (replace the date with the current one):
    Hello, this is a web page on vm1.youruserid.ops and the current time is Mar 28 22:16:27 EDT 2016!
  1. If you refresh your web-browser page in your browser, you should see the contents of your index.html document. If you wish, you can specify the filename index.html in the address, but it is not necessary, since the file index.html is automatically loaded by default when the URL refers to that directory containing that file.


Idea.png
Using the index.html file
It is considered to be a "best practice" to create index.html files for newly-created subdirectories within the DocumentRoot (or users' public_html directories) to force a display of a web-page, instead of viewing the directories "index" listing of files (from "curious eyes"): that is why the name of the file is called "index.html".


  1. Refresh your web-page by issuing the keycombination: ctrl-r. Notice that the time doesn't change as you refresh the page. This indicates that the page is static (not dynamic) indicating that the page does not change (i.e. boring!).

Creating a PHP Script

In order to allow us to run a webserver application in a web-browser, we need a scripting language that will allow the web-browser to function dynamically (i.e. being able to change frequently, as opposed to being "static" or unchanging). In this section, we will demonstrate how a scripting language (PHP) can be used for the web-browser to react in a more dynamic fashion.

Idea.png
PHP Scripting Language
PHP code is considered to be a language that runs on the web-server (i.e. "server-side programming"). PHP code can be embedded in an HTML document (HTML code), and use the resources on the "server-side" to make the web document or resource more dynamic (eg. database access, etc). Although it is not the purpose of this course to learn about and create PHP documents, here is a quick resource on PHP: PHP Tutorial

Perform the following steps:

  1. Copy the index.html file as index.php and modify it to contain:
    Hello, this is a web page on vm1.youruserid.ops and the current time is <?php system("date"); ?>!
  1. On your host machine, in the web-browser manually add /index.php. Notice that in a web browser the index.php file isn't treated as a default page and the contents don't contain the date, but instead are displaying the text in the php code you entered into the index.php file (refer to above code).
  2. The reason this occurs is that the PHP interpreter hasn't been installed on your vm by default.
  3. Install the php package on your vm1 machine, and restart your webserver. NOTE: The php package comes with a working default Apache configuration so you don't need to enable it manually.
  4. Refresh the webpage in your web-browser on your host machine. You should now notice that you see the date instead of the call to the date command. Refresh your webpage several times to see how the time changes. This is simply a "trivial example" of dynamic web content does it does provide a simple demonstration of how scripting languages can be used to create more dynamic webpages.

Controlling Access to Pages

For security, it is important to allow access to general areas of your webpage, but also limit access to other sub-directories that contain other webpages or documents. Penetration Testers or hackers may be able to navigate your file systems within your html directory to obtain unauthorised information.

There are many common-sense safeguards, such as creating an index.html file in your default directory that will display a webpage instead of the directory index. On the other hand, there are also safeguards that you can setup to provide additional protection to your data on your web server.

Perform the following steps:

  1. As the root user on your gateway/host, try to forward incoming http connections that arrive on your host to the web server on vm1. Use an iptables command something like this:
    iptables -t nat -A PREROUTING -p tcp --dport 80 -j DNAT --to 192.168.X.2
    OR this (whichever works):
    iptables -t nat -A PREROUTING -i *externalinterface* -p tcp --dport 80 -j DNAT --to 192.168.X.2
Important.png
Do not save these rules
The PREROUTING rule above will redirect all HTTP requests to vm1. That will be a problem in the future when you run yum install or yum update, which downloads things over HTTP.
  1. You will also need to create a rule in the FORWARD chain in the default table to accept connections to port 80.
  2. To test this setup you'll need to use another machine outside your own network. For this purpose you can simply use the host (machine running Vmware).
  3. Have the external machine view both index.html and index.php
  4. Create a new directory called private inside your DocumentRoot and move index.php inside it.
  5. View both files again.

    You will now modify the settings on the web-server to prevent machines outside our network from accessing the private directory.

  6. Add the following directory statement to your apache configuration file. The default pathname for the apache configuration file is: /etc/httpd/conf/httpd.conf (NOTE: replace the X with your own network octet):
Important.png
Do not overwrite existing settings
There should already be two Directory statements in that file. One for /var/www and one for /var/www/html. Add your new Directory statement after them. Do not overwrite them.
<Directory "/var/www/html/private">
  AllowOverride None
  Require ip 192.168.X.0/24
</Directory>

This sets up separate rules and access permissions for that subdirectory. Your should no longer be able to access any pages in the private directory (or any sub-directories of it) from external machines, but your internal machines (including your host) should still have access.

Record steps, commands, and your observations in INVESTIGATION 1 in your OPS335 lab log-book

INVESTIGATION 2: SETTING UP AN ONLINE DATABASE

The next piece of the puzzle is installing, configuring, and running a database server to support your webmail application that will be installed and setup later in this lab.

Install, Configure and Run MySQL Database Server

MySQL is used to allow storage and retrieval of structured data. SQL is a command language (used by scripting languages such as PHP) to allow programmers to access databases contained within a server (or other servers via a network) to be used within web-based applications via the web-browser.

We won't spend much time learning the details of MySQL configuration but you need a basic server set up. You may remember when setting up MySQL from OPS235 - it is basically the same concept.

Idea.png
MySQL / SQL Language Resources
Again, MySQL can be a complex topic: Seneca has an entire course that concentrates on using SQL commands! Here is a link to MySQL / SQL Language resources: MySQL / SQL Language Resources.

Perform the following steps:

  1. Install mariadb-server.

    The MySQL and MariaDB are actually two separate projects run by different groups, yet they are compatible; therefore, you can use documentation from one to configure the other.

  2. NOTE: When installing mariadb, make certain that you have not just the client but also the server software.
  3. When you start the MySQL service, check the system log file for instructions regarding how to set the root password. Even though we will not configure our MySQL service to be accessible over the network, it is accepted as a "best practice" configuring for network access for each MySQL installation.
  4. Note that the MySQL service has two root passwords:
    • For the localhost
    • For external requests
  5. Start the mariadb server, then refer to the log file (by running journalctl -xe) to learn how to run the two commands in order to generate the appropriate passwords.

    NOTE: Use a password you make up yourself, but do not use your own secret password, since you will be storing that password in a plain text file for later reference.
  6. Start the service and ensure that it will start automatically every time the machine boots.

Test Connection to MySQL Database Server

While the web server (with php), and MySQL server may be working individually, we need to ensure that they can connect to each other. Since this test will involve storing the database password in a plain-text html file, we want to make sure no one else can access it.

Perform the following steps:

  1. Modify the Directory statement for your private directory to prevent any machine other than your vm1 from accessing it.
  2. Re-start the web-server and try to access the page from another machine. Make sure that you can not do so before you continue.
  3. Install the php-mysql module so that the installation of php your web server is using can execute sql statements. You will have to restart the service after installing it.
  4. Modify the index.php page in your private directory to match the code below. This will test that your web server can connect to the database (replace the <user> and <password> with values appropriate for your machine):
    <?php
    $mysqli = new mysqli("localhost", "<user>", "<password>");
    if ($mysqli->connect_errno) {
        echo "Failed to connect to MySQL: (" . $mysqli->connect_errno . ") " . $mysqli->connect_error;
    }
    echo $mysqli->host_info . "\n";
    ?>
  5. Once that page shows a successful connection on your VM (Localhost via UNIX socket via the lynx application) this step is complete.

You have now established that the web server is able to run code which can interract with the database. This will allow dynamic pages to make use of information stored there when providing resources to your users.

Record steps, commands, and your observations in INVESTIGATION 2 in your OPS335 lab log-book

INVESTIGATION 3: INSTALL, CONFIGURE & RUN WEBMAIL APPLICATION (Roundcube Mail)

Roundcube webmail application Logo
GPL,
https://commons.wikimedia.org/w/index.php?curid=1772791
Screencapture of roundcube webmail application running in order to send and receive mail messages via a web-browser.


In the investigation, we will simply install, configure and run the roundcube webmail application. Perform the following steps on vm1:

  1. Download the lastest Complete "zipped tarball" from their website (https://roundcube.net/download/) using wget on the download link .
  2. Extract the "zipped tarball" and rename the generated directory that contains download source code to: webmail. Also make sure that webmail is a sub-directory of your DocumentRoot.
    • Use the --no-same-owner option when extracting the tar achive to ensure that the files do not keep the original owner (who will not exist on your system).
  3. Change the ownership of the temp and logs directories so they belong to apache.
  4. If you're not in Andrew's sections and you have SELinux enabled: This service needs to be able to write to several directories (temp and logs) that SELinux prevents write access to. If you are in a section that has SELinux set to enforcing, run the following commands to let it know that apache should be allowed to write to files in those directories.
    semanage fcontext -a -t httpd_log_t '/var/www/html/webmail/temp(/.*)?'
    semanage fcontext -a -t httpd_log_t '/var/www/html/webmail/logs(/.*)?'
    restorecon -v -R /var/www/html/webmail
    NOTE: If your machine does not have the semanage command, use yum to install the policycoreutils-python package.
    You will also need to tell selinux to allow the webserver to open connections to the MTAs with
    setsebool -P httpd_can_network_connect 1
  5. In the directory now named "webmail", there will be a file named INSTALL which will walk you through the rest of the Roundcube installation.

    Some installation tips to consider:
    • Be careful about copying & pasting the MySQL setup part: take time and pay attention to detail: do not try to "rush it".
    • You will need to install additional Apache modules including: php-xml and php-mbstring.
    • Don't forget to set the password in the roundcube configuration.
  6. To make things easier, RoundCube has a well configured installation page available through your local web browser (You will see a note about it in the INSTALL file).
    • Go onto your host, open Firefox and on the address bar type vm1.<yourSenecaID>.ops/webmail/installer, make sure your dns on host can resolve the web address. Alternatively, instead of "vm1.<yourSenecaID>.ops" you can input the ip address of your vm1, 192.168.X.2/webmail/installer, change X to your own IP octet.
    • Inside the web browser installer, ensure all required options are "ok", if "DOM: not ok" it means you need to install additional php packages (yum install php-xml php-mbstring). Once everything is ready (it will not let you continue otherwise) click next go to the next page.
    • On the next page, under the IMAP settings insert vm3.<yourSenecaID>.ops in default_host field and 143 in default_port field. Under SMTP settings insert vm2.<yourSenecaID>.ops in smtp_server field, and 25 in smtp_port field. Ensure smtp_user/smtp_pass is empty and uncheck the "Use the current IMAP username and password for SMTP authentication" checkbox.
    • Under Database setup db_dsnw, enter "localhost" as your database server, "roundcubemail" for database name. Put "roundcube" as Database user, and the password you set for the roundcube user when you configured that in the previous step for database password. Everything else can be left as default.
    • Click Next to create the configuration file, then download it to your host. By default it will be saved under ~yourSenecaID/Downloads. Transfer that file to vm1 using scp and place it inside /var/www/html/webmail/config folder.
    • Go to test config page if you are not there already and "Check config file" should be ok. "Check DB config" should also be ok, if not check your mysql settings.
    • Make sure your SMTP and IMAP servers are running, then finally test your configuration by sending email using your smtp server through test field provided by webmail installer, you should receive a test email sent by RoundCube. Test your IMAP settings by simply loging in with your SenecaID and vm3 password on the same webpage.
    • If everything works properly you can skip to step 9. *Remember you can edit the configuration file manually by editing "/var/www/html/webmail/config/config.inc.php".
  7. Note that both of your IMAP and SMTP servers are on different machines (i.e. not on vm1). Therefore, you should see custom values in the following parameters in the Roundcube configuration file:
    $config['smtp_server']
    $config['smtp_user'] = '';
    $config['smtp_pass'] = '';
    $config['default_host']
    $config['default_port']
    NOTE: The last two entries above refer to your IMAP server
  8. Now that you have Roundcube installed it is time to test if the roundcube webmail application is working by logging on, then sending and receiving e-mail messages:
    • Using the Firefox webbrowser, navigate to vm1.<yourdomain>.ops/webmail and login (using the username only).
    • Use the interface provided to send and receive email.
  9. If mail sent through roundcube is sending from the wrong domain (i.e. user@vm3.yourdomain.ops instead of user@yourdomain.ops), each user can override it in the settings tab, or you can set:
    • $config['mail_domain']

Record steps, commands, and your observations in INVESTIGATION 3 in your OPS335 lab log-book

Important.png
Backup your VMs!
You MUST perform a full backup of ALL of your VMs whenever you complete your OPS335 labs or when working on your OPS335 assignments. You should be using the dump or rsync command, and you should use the Bash shell script that you were advised to create in order to backup all of your VMs.

COMPLETING THE LAB

You now have a complete LAMP stack and could host a variety of web-pages that could include dynamically generated content and database access. You also have a webpage that is relying on a number of different services cooperating in order for it to work properly.

Online Submission

Follow the instructions for lab 6 on blackboard.

EXPLORATION QUESTIONS

  1. What does the term LAMP stand for? Briefly describe the purpose of each of the following items in LAMP.
  2. What is the major difference between a static web document and a dynamic document?
  3. What does the term "server-side programming" mean?
  4. What is the purpose of creating and using an index.html file?
  5. What is the purpose of creating and using an index.php file?