Changes

In this assignment, your you will create a script that can generate usage reports based off of output from the last command or from a file in a similar format. You will use usage_data_file for testing but the script should preform the following activities:also be tested on some other Linux machines and on Matrix.

* The <b>datetime</b> module

** === Argparse ===Argparse is a much, much better way of dealing with command line arguments. It not only handles positional arguments, but options as well and will generate usage messages.It's <i>very highly recommended</i> that you spend at least a few minutes reading through the [https://docs.python.org/3/howto/argparse.html Argparse Tutorial] . === Datetime ===Since Python is a <i>batteries</i> included language, it's important to get accustomed with using some of the modules in the standard library. Since we are dealing with dates and times, you are required to work with the datetime module. The full docs can be found [https://docs.python.org/3/library/datetime.html here]. Datetime objects can be initialized from strings that match a particular format. One example is provided for you in the codebase: [https://docs.python.org/3/library/datetime.html#datetime.datetime.strptime the strptime] function. Once you have created datetime objects, you can do useful things with them: * <code> d1 > d2 </code> will return True is d1 is <b>later</b> than d2.* <code> d2 - should read d1 </code> will return a <i>timedelta</i> object, which is an amount of time between d2 and d1. More interesting methods are in the [https://docs.python.org/3/library/datetime.html#datetime.datetime.fold table] in the docs. === Timedelta ===When performing some operations with datetime objects, we may see timedelta objects being created. In math, <b>delta</b> refers to a difference. So a timedelta object is essentially an object that represents a duration. You can do useful things with timedelta objects:* <code> delta1 + delta2 </code> will add up two durations. For example, if delta1 is two hours and delta2 is three hours, then this firstoperation will return five hours.** <code> str(delta1) </code> will represent the timedelta in a friendly format: H:MM:SS if the duration is less than 24 hours.  More interesting methods are in the [https://docs.python.org/3/library/argparsedatetime.html Argparse API reference information page#datetime.datetime.fold table]in the docs.

usage: new_templateassignment2.py [-h] [-l {user,host}] [-r RHOST] [-t {daily,monthlyweekly}] [-u USERd DATE] [-su USER] [-v] F [F ...files]

F list of files file to be processed, if blank, will call last

-t {daily,monthlyweekly}, --type time {daily,monthlyweekly} type of report: daily day or monthlyweek -d DATE, --date DATE specify date for report

If there is only one a file name provided at the command line, read the login/logout records from the contents of the given file. If the there is not file name is "online", get the record on the system your script is being execute using the Linux command "last -iwF". The format of each line in the file should be the same as the output of 'last -Fiw'. Filter out incomplete login/logout record (hints: check for the number of fields in each record). If there is more than one file name provided, merge all the files together with the first one at the top and the last one at the bottom. Read and process the file contents in that order in your program.

<li><code>git add *assignment2.py</code>

<li> Use the check script to check your work: <code>./checkA2.py -f -v TestHelp</code>. It should succeed.<li> Investigate the <code>parse_for_user()</code> function, with the <code>usage_data_file</code>. <b>In main, call `parse_for_user()` with `output` as the argument. Investigate what's returned.</b>

<li> Test using <bcode>Continue committing these changes as your proceed./checkA2.py -f -v TestList</bcode><li> Implement . You should see some tests succeeding, but some failing. Use the check script to start implementing the same things as parse_for_user but functions needed for <codeb>parse_for_hosts-l host</codeb>. Use the user function to guide you. <li> Compare <b>Continue committing these changes as your output with proceed.</b> Your script should now be passing the output belowTestList tests.<li> Write Now implement the `parse_for_daily()` function using the pseudocode given-d <date> option. This should be taking the will filter your user list of lines from your file, and output a dictionary with start dates in DD/MM/YYYY format as based on the key and usage in seconds as date provided by the valueuser.<li> Use <code> {'01./01/1980': 1200, '02/01/1980': 2400, '03/01/1980': 2200} checkA2.py -f -v TestDate</code>to check your work. <lib> Once your `parse_for_daily()` function works, call it with You have completed the argparse options, and display the contents.first milestone!</b><li> Write (or modify) a function The next stage will be to do implement the same for remote hostsdaily/weekly reports.Use <code>TestDaily<li/code> Implement the outputting of the duration in HH:MM:SS instead of seconds. It's recommended you write a function to take in seconds and return a string. Call this when the `-s` option is absent. Make sure this is working with remote hosts as well. You should now have x of y tests passing.<licode>TestWeekly</code> Finally, implement with the `--monthly` option. Create a new function and get it working. start with seconds, then duration and make sure it works with remote as wellcheck script.

The second column should be 15 characters long and be right-aligned.  <pre>Daily Usage Report for rchan < same number of characters============================ <Date Usage < right justified13/02/2018 0:26:00 <15/02/2018 0:33:00Total 0:59:20llllllllllrrrrrrrrrrrrrrr < left column is 10 chars, right column is 15^left just.</pre>

The following are the reports generated by the usage report script (ur.py) with the "usage_data_file" mentioned in the overview section. You can download the file [https://scs.senecac.on.ca/~raymond.chan/ops435/a2/usage_data_file here] to test your ur.py script.

[eric@centos a2]$ ./a2assignment2.py -u rchan -t daily usage_data_file

[eric@centos7 a2]$ ./a2assignment2.py -r 10.40.105.130 -t daily usage_data_file -s

14/02/2018 3:02:1113/02/2018 3560 2:12:49Total 3560 5:15:00

[eric@centos7 a2]$ ./a2assignment2.py -u cwsmith -t monthly weekly usage_data_file

Monthly Weekly Usage Report for cwsmith================================

02/2018 0306 3:02:1103/2018 0010 0:38:00Total 03 3:40:11</pre> ==== Monthly Usage Report by Remote Host ====The following is a Monthly Usage Report created for the remote host 10.40.105.130 by the command:<pre>[eric@centos7 a2]$ ./a2.py -r 10.40.105.130 -t monthly usage_data_file</pre> <pre>Monthly Usage Report for 10.40.105.130======================================Date Usage02/2018 05:15:00Total 05:15:00</pre> As discussed before, this command should also accept the <code>--seconds</code> option. ==== List Users With Verbose ====Calling any of the previous commands with the <code>--verbose</code> option should cause the script to output more information:<pre>[eric@centos7 a2]$ ./a2.py -l user usage_data_file -v</pre> <pre>Files to be processed: ['usage_data_file']Type of args for files <class 'list'>User list for usage_data_file=============================asmithcwsmithrchantsliu2

[eric@centos7 a2]$ ./a2assignment2.py -r 10.40.105.130 -t monthly weekly usage_data_file -v

Files to be processed: ['usage_data_file']Type of args for files <class 'list'>usage report for remote host: 10.40.105.130usage report type: monthlyMonthly Weekly Usage Report for 10.40.105.130======================================

02/2018 0506 0:1502:0031Total 05 0:1502:0031

Running the script with "online" <B>no filename</b> as a file argument should call a subprocess.Popen object and run the command <code>last -Fiw</code>.

[eric@mtrx-node06pd ~]$ ./a2assignment2.py -l user online

[eric@mtrx-node06pd ~]$ ./a2assignment2.py -u adas20 -t daily online

=== Detail Algorithm Document ===Follow the standard computation procedure: input - process - ouput when creating the algorithm document Please note that there will no unit test for this assignment.==== input ====* get data (command line arguments/options) from the user using the functions provided by the argparse module* according to the arguments/options given at the command line, take appropriate processing action. ==== processing ====* based on the file(s) specified, read the contents of each file and use appropriate objects to store but it* based on the command line arguments/options, process the data accordingly, which includes** data preprocessing (split is still a multi-day record into single day record)** record processing (preform required computation)==== output ====* output the required report based on the processed data==== identify and select appropriate python objects and functions ====The following python functions (to be created, you may have more) are useful in handling the following sub-tasks:* reads login records from files and filters out unwanted records* convert login records into proper python object type so that it can be processed using as much built-in functions as possible * create functions which generate daily usage reports by user and/or by remote host* create functions which generate monthly usage reports by user and/or by remote hostrequirement.

To help you with this assignment=== First Milestone ===By April 4, you should use have your <code>TestHelp</code>, <code>TestList</code> and <code>TestDate</code> tests all passing. Make sure that the a2_template.py code is in the your GitHub repository as . I will use a starting point in designing your own Python Usage Report scriptpull request comment to give feedback, suggest changes or get you unstuck.

| Algorithm Submission First Milestone || 10 ||

| Daily/Monthly Weekly Functions || 10 ||

| Output Date Functions || 5 ||

| Other Output/other Functions || 5 ||