Changes

Jump to: navigation, search

Firefox Performance Testing Lab Fall 2010

5,185 bytes added, 14:52, 27 September 2010
no edit summary
== Resources ==
 
===Links===
* [http://chromeexperiments.com Chrome Experiments]
* [https://spreadsheets.google.com/ccc?key=0AgzO6h8d9PSsdHE0a2JmeEZWUHFOQm00ZTJLNElIZ2c&hl=en&pli=1#gid=0 Results Spreadsheet]. Talk to Dave to get permissions in order to edit.
* [http://nightly.mozilla.org/ Firefox (i.e., Minefield) nightly builds]
* [http://build.chromium.org/buildbot/snapshots/ Chrome (i.e., Chromium) nightly builds]
* [https://bugzilla.mozilla.org/show_bug.cgi?id=594920 Example performance bug]
===Misc Info===
 
One of the questions that comes up a lot when filing these bugs, especially on Windows, is whether or not you have Direct2D (i.e., D2D) or Direct3D (D3D) enabled. The graphics system in Firefox has 3 states related to hardware acceleration:
 
# no hardware acceleration
# D3D but not D2D
# All hardware acceleration
 
You can control this using various preferences, which you can change by going to '''about:config''' (type this into your address bar and press enter):
 
* D3D Layers Preferences
** layers.accelerate-all
** layers.accelerate-none
* Font Rendering
** gfx.font_rendering.directwrite.enabled
* Direct2D
** gfx.direct2d.force-enabled
 
You can also use built-in Firefox options to toggle hardware acceleration between the "None" and "All" states by (un)checking “Use hardware acceleration when available” in the Advanced section of the Preferences/Options dialog. Alternately, you can run Firefox in safe mode to disable hardware acceleration [http://blog.mozilla.com/joe/2010/09/15/testing-hardware-acceleration/]. When filing a bug related to hardware acceleration, please include the Graphics card information from '''about:support''' in your browser.
== Tests: Initial First Round ==
! Test !! Tester !! Problem !! Additional Info <br />
|-
| [http://www.chromeexperiments.com/detail/lorenz-84/ Lorenz 84] || [[User:sbologna|Stephen Bologna]] || In the 32bit version of Minefield on Vista the browser froze for several seconds when the page loaded, and any attempt to interact with the test caused it to freeze again. In the 64bit version of Minefield on Window 7, the page took several minutes to load, and the image was not drawn properly.|||-
| [http://www.chromeexperiments.com/detail/google-sphere/ Google Sphere]
|| [[User:sbologna|Stephen Bologna]]
|| Overall look in Minefield is very sloppy compared to Chromium. When the 2d text gets close to the screen, it becomes less legible. It also runs slower on Minefield.
|| Runs fine in Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.8) Gecko/20100722 Firefox/3.6.8
|-
|-
 | [http://www.chromeexperiments.com/detail/ballliquid-poolparticles/ Ball PoolLiquid Particles]|| [[User:cwdesautelsSweerdenburg |Carl DSteven Weerdenburg]]|| Choppy at 50+% ball saturation Minefield particle dot redraw very slow, manages approx 10 frames/sec. Chromium has no delay when moving the window rendering particle dot movement. Both have difficulty in letter rendering|| Chromes breakpoint was far laterInvestigation yields a [https://bugzilla.mozilla.org/show_bug.cgi?id=564643 duplicate]
|-
 | [http://www.chromeexperiments.com/detail/chromedrones/ ChromeDrones]|| [[User:cwdesautels|Carl D]]|| Video and Audio chop when 8+ notes were introduced|| |- | [http://www.chromeexperiments.com/detail/liquidanimated-particlesharmonograph/ Liquid ParticlesAnimated Harmonograph]
|| [[User:Sweerdenburg |Steven Weerdenburg]]
|| Image rendering much slower than on Chromium. Drawing of complex patterns on Minefield particle dot redraw very slow, manages approx 10 frames/secwould sometimes cause centre to "wobble". CPU utilization seems (near) identical on both.|| Chromium has Hardware acceleration makes no delay when rendering particle dot movement. Both have difficulty in letter renderingdifference
|-
| <strike>[http://www.chromeexperiments.com/detail/browser-pong/ Browser Pong]</strike>
|| [[User:Sweerdenburg |Steven Weerdenburg]]
|| <strike>Minefield calculates the "ball" window height as twice that of Chromium</strike>|| Seems resolved in latest nightly
|-
| [http://www.chromeexperiments.com/detail/realtime-video-ascii-conversion/ Realtime Video->ASCII Conversion]
|| [[User:Sweerdenburg |Steven Weerdenburg]]
|| Seems to have very difficult time at higher "resolutions" (smaller fonts). Scales up in canvas size ok, but becomes unresponsive over prolonged periods (5+ minutes) of use. Handles larger canvas with same resolution better than chrome at default settings.
||
|-
|| [[User:Kclascon |Kevin Lasconia]]
|| When the cube is rotated in any direction the animation is very choppy. There is also a delay between moving the mouse in one direction and the actual cube moving in that direction.
|| Chrome was very smooth, and responsive. Filed a bug [https://bugzilla.mozilla.org/show_bug.cgi?id=599351 here].
|-
|| [[User:Kclascon |Kevin Lasconia]]
|| In Firefox, when more complex objects are generated the spinning animation of the object becomes increasingly more choppy. During transformations the animation would freeze for a few seconds then continue.
|| Chrome did not experience any of Found a bug about the outlined problems above.|- | same experiment [httphttps://wwwbugzilla.chromeexperimentsmozilla.comorg/detail/browser-ball/ Browser Ballshow_bug.cgi?id=503470 here]|| [[User:Kclascon |Kevin Lasconia]]|| There is an issue when multiple windows are spawned in Firefox for this experiment. When moving the ball from the main window to another the ball will get stuck. Even when trying to "throw" the ball to another window it will still get stuck.|| In Chrome, the ball can actually be moved to and from new windows.
|-
| [http://www.chromeexperiments.com/detail/gravity/ Gravity]
|| [[User:Kclascon |Kevin Lasconia]]
|| This experiment does not work in the Mozilla/5.0 (Windows NT 6.0; WOW64; rv:2.0b7pre) Gecko/20100916 Firefox/4.0b7pre nightly build.|| It works fine in Chrome. It also works in Firefox 3.6.10, however the objects cannot be dragged around like in Chrome.|- | A bug filed [httphttps://wwwbugzilla.chromeexperimentsmozilla.comorg/detail/animated-harmonograph/ Animated Harmonographshow_bug.cgi?id=570922 here]|| [outlines the dragging issues. Did some regression testing to determine the builds where the experiment worked and stopped working. Added some additional info to this bug [Userhttps:Sweerdenburg |Steven Weerdenburg]]|| Rotation and redraw much slower than on Chromium//bugzilla.mozilla. Drawing of complex patterns on Minefield would sometimes cause centre to "wobble"org/show_bug.|| Was extremely slow on Sept 13 build, now running better but still slower than Chromiumcgi?id=595541 here]. Slowly leaks memory (20MB over 10 minutes)
|-
Filed a [https://bugzilla.mozilla.org/show_bug.cgi?id=598498 Bug]
|-
 
 
| [http://www.chromeexperiments.com/detail/depth-of-field/ Depth of Field]
|| [[User:kpangilinan |Kenneth Pangilinan]]
|| Minefield freezes up PC for a few seconds before running. When attempting to move the window around, PC freezes up again.
|| Experiment works fine in Chromium, moving the window around is fine as well.
|-
 
| [http://www.chromeexperiments.com/detail/3d-javascript-with-sandy-hx/ 3D JS w/ Sandy DX]
|| [[User:kpangilinan |Kenneth Pangilinan]]
|| Experiment did not load in Minefield or Chromium.
||
|-
 
| [http://www.chromeexperiments.com/detail/javascript-voxel-spacing/ JS Voxel Spacing]
|| [[User:kpangilinan |Kenneth Pangilinan]]
|| In Minefield it runs at 2-4FPS, in Chromium it runs at 22-24FPS, about 10 times faster!
||
|-
 
| [http://www.chromeexperiments.com/detail/gear/ Gear]
|| [[User:blaw1 |Brian Law]]
|| This experiment is very choppy in Minefield, whereas Chromium runs smoothly. In Minefield you can see arrows in the boxes which shouldn't be visible.
||
|-
 
| [http://www.chromeexperiments.com/detail/waterfall/ Waterfall]
|| [[User:blaw1 |Brian Law]]
|| Minefield quickly begins to lag as more balls enter the screen. Chromium will run smoothly for much longer.
||
|-
 
| [http://www.chromeexperiments.com/detail/pocket-full-of-canvas/ Pocket Full of Canvas]
|| [[User:peleaning |Pete Leaning]]
|| Minefield draws black triangles in the following effects in 'pocket full of canvas':
Elipse, Colorrects, Mario, Colormunch, imagewaves, fire, wave(de)form and imagemagnifier. These artifacts are not present in Chromium
||The two functions that seem to be responsible for this are renderTriangle() and drawImage
|-
 
| [http://www.chromeexperiments.com/detail/kaleidscope/ Kaleidscope]
|| [[User:ajcondinho |Andrew Condinho]]
|| Physical window becomes jerky and laggy whenever you re-size the window.
|| Tested this out on my desktop and lag disappeared, looks like it might be an issue with lesser hardware
|-
 
| [http://www.chromeexperiments.com/detail/physicsketch/ physicSketch]
|| [[User:ajcondinho |Andrew Condinho]]
|| Objects don't draw, and after a few failed attempts experiment stops responding to any attempts to draw.
|| Chrome has no problems running this experiment.
|-
 
| [http://www.chromeexperiments.com/detail/swirling-tentacles/ Swirling Tentacles]
|| [[User:cldenobrega |Crystal de Nobrega]]
|| Swirling Tentacles only works with D2D disabled; is super slow and choppy. Computer freezes when you try to resize the window.
|| [https://bugzilla.mozilla.org/show_bug.cgi?id=599954 Filed a Bug].
|-
 
| [http://www.chromeexperiments.com/detail/blob Blob]
|| [[User:cldenobrega |Crystal de Nobrega]]
|| Blob has drawing artifacts (crap at the top of the window) when experiment is first launched.
|| [https://bugzilla.mozilla.org/show_bug.cgi?id=599962 Filed a Bug].
|-
 
 
|}
* [https://bugzilla.mozilla.org/show_bug.cgi?id=597186 Wilderness Downtown Canvas bug]
* [https://bugzilla.mozilla.org/show_bug.cgi?id=598498 Wilderness Downtown Crash bug (xull.dll)]
* [https://bugzilla.mozilla.org/show_bug.cgi?id=598831 Liquid Particles perf bug (dupe)]
* [https://bugzilla.mozilla.org/show_bug.cgi?id=598834 Animated Harmonograph perf bug]
* [https://bugzilla.mozilla.org/show_bug.cgi?id=598361 Pocket Full of Canvas triangle bug]
* [https://bugzilla.mozilla.org/show_bug.cgi?id=599210 Ball Dropping bug]
* [https://bugzilla.mozilla.org/show_bug.cgi?id=599236 Video->ASCII Conversion perf bug]
* [https://bugzilla.mozilla.org/show_bug.cgi?id=599318 Javascript Voxel Spacing bug]
* [https://bugzilla.mozilla.org/show_bug.cgi?id=599350 Gear bug]
* [https://bugzilla.mozilla.org/show_bug.cgi?id=599351 Colorscube bug]
* [https://bugzilla.mozilla.org/show_bug.cgi?id=595541 Google Gravity bug (added additional info)]
* [https://bugzilla.mozilla.org/show_bug.cgi?id=599568 physicSketch bug]
* [https://bugzilla.mozilla.org/show_bug.cgi?id=599569 Kaleidscope Re-size Bug]
* [https://bugzilla.mozilla.org/show_bug.cgi?id=599616 Depth of Field Bug]
* [https://bugzilla.mozilla.org/show_bug.cgi?id=599954 Swirling Tentacles Bug]
* [https://bugzilla.mozilla.org/show_bug.cgi?id=599962 Blob Drawing Artifacts Bug]

Navigation menu