Good work on the project!!
Just some feedback for ya:
- Try to clarify yaml config setup - There are differences in how to refer to directorys in the 2 examples - preferences : {} should be preferences: {}
- creation of the 'extension_perf_reports' directory should be incorporated into the
zip with the python files to save the user from having to make the directory.
- Give some sort of feedback on test conclusions, it currently just dumps you back to the DOS prompt. - Just say tests completed successfully/ failed etc.