Firefox Performance Testing Lab Fall 2010

From CDOT Wiki
Revision as of 00:30, 20 September 2010 by Knovichikhi (talk | contribs) (Tests: Initial First Round)
Jump to: navigation, search

Goal

The goal of this lab is twofold. First, to provide students with a real-world experience of working collaboratively in an open community; and second, to work on a cutting-edge, but manageable project within the Mozilla community.

Objective

To conduct A/B performance tests of the Chrome Experiments using nightly builds of both Firefox and Chrome, in order to identify performance bottlenecks in Firefox. Also, to profile and file bugs in order to fix these issues.

Method

  • As a group determine a method for dividing the Chrome Experiments so they all get tested
  • Install both the Firefox and Chrome nightly builds
  • Test each experiment in the two browsers, looking for various issues:
    • Speed - is Firefox as fast as Chrome at rendering the graphics?
    • Smoothness - are the graphics as smooth as in Chrome? Do you notice a lot of pauses, jerkiness, etc.?
    • Responsiveness - does Firefox remain responsive while you run the demo? Is it pegging your CPU(s)?
  • Record your findings, as well as browser and computer info ([about:support], [about:]) in the Results Spreadsheet.

Resources


Tests: Initial First Round

(humph) Let's refine this a bit more, such that we track:

Name of Experiment | URL of Experiment | Your Name | Date of Test | Hardware Info | Browser Info | Firefox Performance - Speed | Firefox Performance - Smoothness | Firefox Performance - Responsiveness | Notes and other Details |

(carl) Separate or cumulative results page?


Test No. Name
Results
1-10 Carl Results
11-20 Kevin Lasconia Results
21-30 Andrew Condinho Results
31-40 Stephen Bologna Results
41-50 Kenneth Pangilinan Results
51-60 Pete Leaning Results
61-70 Brian Law Results
71-80 Steven Weerdenburg Results
81-90 James Evangelista Results
91-100 Kaitlyn Callow Results
101-110 Crystal de Nobrega Results
111-120 Chris DeCairos Results
1-26 (Linux) Konstantin Novichikhin Results

Tests: Second Round

Test Tester Problem Additional Info
Lorenz 84 Stephen Bologna In the 32bit version of Minefield on Vista the browser froze for several seconds when the page loaded, and any attempt to interact with the test caused it to freeze again. In the 64bit version of Minefield on Window 7, the page took several minutes to load, and the image was not drawn properly.
FlowerPower Kaitlyn Callow
  • Doesn't work on Win32 build from 2010-09-17 10pm (Mozilla/5.0 (Windows NT 6.1; rv:2.0b7pre) Gecko/20100917 Firefox/4.0b7pre).
  • works in mac fine.
Cheloniidae Live Kaitlyn Callow Not running. Returning error:

Error: console is not defined Source File: http://spencertipping.com/beta/cheloniidae-live-b1/script.js Line: 2

Bug Reports

NOTE: All bugs related to what we find should have [chromeexperiments] in the bug's Whiteboard field, so we can track them. The following Bugzilla search will list them all: https://bugzilla.mozilla.org/buglist.cgi?quicksearch=[chromeexperiments]