Changes

Jump to: navigation, search

PGO Related Bugs

24,046 bytes added, 23:26, 9 December 2008
0.3 Release
== <font color="Peru">Project Name </font>==
PGO Related Bugs
== <font color="Peru">Project Description </font>==
Firefox crashes or experiences bugs after creating PGO builds on Windows. The focus of this project is to determine what is causing these crashes or bugs and either patch/fix them or find solutions to allow for the optimizations without incurring the problems.
== Project Leader(s) ==As of Oct 2nd:<br />Profiling Firefox to increase the number of functions optimized in the PGO build of Firefox.
[[User:cbishop2|Chris Bishop]]== <font color="Peru">Project Leader(s) </font>==
== Project Contributor(s) ==*[[User:cbishop2|Chris Bishop]]
- None so far but that will change.== <font color="Peru">Project Contributor(s) </font>==
NOTE: only Project Leader(s) should add names here. You '''can’t''' add your own name Contributors are needed for help on profiling Firefox to the Contributor listimprove PGO on Firefox.
== Project Details ==What contributions are needed?
Details *What should be profiled?*A write up on steps to produce profile.*Creating scripts to execute profile steps.<br />{| border="1"!style="width:auto"|Name!style="width:25px"|!style="width:auto"|Contribution|-|Chris Bishop ( Example )||Script to comeopen and close Firefox.|-|}<br /><br />*Need some bash scripting help.*I'm on IRC as chrisBee {| border="1"!style="width:auto"|Name!style="width:25px"|!style="width:auto"|Script Contribution|-|[[User:cdpatel1|Chinmay Patel]]||Created a small script to search and replace a piece of text in a file.|-|} == <font color="Peru">Project Tasks </font>==<table style="width: 100%;" class="standard-table" cellborder=1 border=1 cellpadding=3 cellspacing=0> <th style="width: 15%;">Task</th> <th style="width: 42%>Details</th> <th style="width: 5%;">Priority</th> <th style="width: 5%;">Status</th> <th style="width: 8%;">Target</th> <th style="width: 25%;">Link(s) or Notes</th>
<tr> <td>'''Compile Firefox PGO'''</td> <td>Compile the trunk of Firefox using <code>make -f client.mk profiledbuild</code>.</td> <td style="background-color: Orange; text-align: center; font-weight: bold; font-size: bigger">High</td> <!-- color green when done --><td style= Project News "background-color: green; text-align: center; font-weight: bold;">Done</td> <td style="background-color: YellowGreen; text-align: center; font-weight: bold;">0.1 R</td> <td></td> </tr> <tr> <td>'''Reproduce PGO Bugs or Crashes'''</td> <td>I need to reproduce the bugs or crashes other people were experiencing with their pgo builds.</td> <td style="background-color: Orange; text-align: center; font-weight: bold; font-size: bigger">High</td> <!-- color green when done --><td style="background-color: green; text-align: center; font-weight: bold;">Done</td> <td style="background-color: YellowGreen; text-align: center; font-weight: bold;">0.1 R</td> <td>Unable to reproduce. Focusing on profiling Firefox. [http://dee132.blogspot.com/2008/10/change-of-direction.html Blog Post]</td> </tr> <tr> <td>'''Compile Firefox PGO Tests'''</td> <td>Compile Firefox with VS 2005 and Vista SDK and compile with VS 2008 w/o Vista SDK.</td> <td style="background-color: Orange; text-align: center; font-weight: bold; font-size: bigger">Low</td> <!-- color green when done --><td style="background-color: white; text-align: center; font-weight: bold;">Not Started</td> <td style="background-color: YellowGreen; text-align: center; font-weight: bold;">0.3 R</td> <td></td> </tr> <tr> <td>'''Determine 0.1 Release'''</td> <td>I need to determine what I'll be releasing for the 0.1 Release.</td> <td style="background-color: Orange; text-align: center; font-weight: bold; font-size: bigger">High</td> <!-- color green when done --><td style="background-color: green; text-align: center; font-weight: bold;">Done</td> <td style="background-color: YellowGreen; text-align: center; font-weight: bold;">Sept 28th, 2008</td> <td></td> </tr> <tr> <td>'''Scenario Scripts'''</td> <td>I need a script that will build multiple PGO builds in different directories using different profiling scenarios.</td> <td style="background-color: Orange; text-align: center; font-weight: bold; font-size: bigger">High</td> <!-- color green when done --><td style="background-color: green; text-align: center; font-weight: bold;">Done</td> <td style="background-color: YellowGreen; text-align: center; font-weight: bold;">Oct 24th, 2008</td> <td>I need some help from contributors to help me accomplish this. **Update** Thanks to Chinmay and Dave Humphrey I was able to create this script.</td> </tr> <tr> <td>'''Create SQLite Upstream Bug'''</td> <td>I have determined the pgo bug is actually with SQLite and it needs to be added to the upstream for it to be worked on.</td> <td style="background-color: Orange; text-align: center; font-weight: bold; font-size: bigger">High</td> <!-- color green when done --><td style="background-color: white; text-align: center; font-weight: bold;">On Going</td> <td style="background-color: YellowGreen; text-align: center; font-weight: bold;">Oct 24th, 2008</td> <td>Looking into how to actual do this</td> </tr> <tr> <th colspan="6">0.2 Release</th> </tr> <tr> <td>'''Setup Test Environment'''</td> <td>I need to setup a test environment to duplicate the testing done on Thunderbird.</td> <td style="background-color: Orange; text-align: center; font-weight: bold; font-size: bigger">High</td> <!-- color green when done --><td style="background-color: green; text-align: center; font-weight: bold;">Done</td> <td style="background-color: YellowGreen; text-align: center; font-weight: bold;">Nov 4th, 2008</td> <td>I have this VM setup but I am not using yet since my XP OS that is not on a VM is much faster.</td> </tr></table>
==<font color= September "Peru">Project Details </font>== === Conversations === {||width="15px"||December 6th|Ted Mielczarek|-||colspan="2"|I told Ted about how a large number of pgc (profile data) files were in a folder that gets deleted before the pgc files get used to optimize Thunderbird. It turns out that this folder gets clobbered to make sure if some one rebuilt their try after removing a component that it would not still be there. Ted suggest adding a flag that <code>ifndef MOZ_PROFILE_USE</code> then go ahead and clobber it otherwise don't.<br /><br />That is only one part of it. The pgc files need to be merged into their corresponding pgd (program database) files but the script that does this only looks in one directory. I think I can just tell it to look in both locations. The <code>pgomerge.py</code> does not return errors for files not found.<br /><br />Ted also said I should create another bug about this ---how components can't be PGO'd on Win32.|}
=== PGO Details ===
==== Met with Ted Mielczarek ( Sept 15th, 2008 ) ====
{|
|&nbsp;&nbsp;&nbsp;width="15px"||On Tuesday after the conference was over I met with Ted and we discussed how I can get started on the [[PGO_Build_Details| Details]]|-||[[PGO_Related_Bugs/TB_Details|Thunderbird PGO Project.Details]]
|}
==== Created First Build ( Sept 17th, 2008 ) Thunderbird ====
{|
|&nbspwidth="15px"||[[PGO_Build_Details/TB-Addrbook| Address Book enabled with PGO]]<br/>Turned on speed optimizations for the Address Book module. |} === Testing Scripts ==={||width="15px"|| {|class="collapsible collapsed" style="border-style:solid;&nbspborder-width:thin;&nbspborder-color:black"!align="left" style="background-color:#FF9933; font-weight:bold;border-style:solid;border-width:thin;padding: 2px 2px 2px 2px;"|The scripts I am using for running tests against my builds ( Oct 2nd, 2008 )|I walked through -|<code>#!/bin/sh</code><br/><span style="color:green;">''####### the Mozilla documentation .mozconfig file to use for how this build''</span><br /><code>export MOZCONFIG=/f/mozilla/.mozconfigPGO</code><br /><span style="color:green;">''####### the subdirectory trunk holds my src files''</span><br /><code>cd trunk</code><br /><span style="color:green;">''####### time the profile build and output stdout and stderr to files that are timestamped''</span><br /><code>time make -f client.mk profiledbuild 1> /i/mozilla/pgo-output-`date +%s`.txt 2> /i/mozilla/pgo-errors-`date +%s`.txt''</code><br /><span style="color:green;">''####### after the build Firefoxis completed done run the xpcshell tests and output stdout and stderr to file that are timestamped''</span><br /><code>make check 1> /i/mozilla/pgo-check-output-`date +%s`. I started [httptxt 2> /i/mozilla/pgo-check-errors-`date +%s`.txt</code><br /><span style="color:green;">''####### change to the objdir directory then to the mochitest directory''</span><br /><code>cd /i/mozilla/ff-pgo/_tests/testing/mochitest</code><br /><span style="color:green;">''####### run the mochitest, run test right away, close the browser when done, log all output to a timestamped file''</span><br /developer><code>python runtests.py --autorun --close-when-done --log-file=/i/mozilla/pgo-mochitest-`date +%s`.orglog --file-level=DEBUG</encode>|}<br /Mozilla_Source_Code_>{|class="collapsible collapsed" style="border-style:solid;border-width:thin;border-color:black"!align="left" style="background-color:#FF9933; font-weight:bold;border-style:solid;border-width:thin;padding: 2px 2px 2px 2px;"|Here is the .mozconfig file (MercurialOct 2nd, 2008 ) here] with getting |-|<code>. $topsrcdir/browser/config/mozconfig</code><br /><code>mk_add_options MOZ_OBJDIR=/i/mozilla/ff-pgo</code><br /><code>mk_add_options MOZ_MAKE_FLAGS=-j5</code><br /><span style="color:green;">''####### this is the script to run after the first build to gather profile data''</span><br /><code>mk_add_options PROFILE_GEN_SCRIPT="sh /f/mozilla/pgo.sh"</code><br /><code>ac_add_options --disable-vista-sdk-requirements</code><br /><span style="color:green;">''####### this has to be enabled to perform the source mochitests''</span><br /><code and continued until I received errors>ac_add_options --enable-tests</code><br /><code>ac_add_options --disable-debug</code><br /><code>ac_add_options --disable-accessibility</code>|}<br />{|class="collapsible collapsed" style="border-style:solid;border-width:thin;border-color:black"!align="left" style="background-color:#FF9933; font-weight:bold;border-style:solid;border-width:thin;padding: 2px 2px 2px 2px;"|Here is the script the profile build runs to gather profile data ( Oct 2nd, 2008 )|-|<pre>#!/bin/shexport NO_EM_RESTART=1mkdir $OBJDIR/_profileprofilecd /i/mozilla/ff-pgo/_tests/testing/mochitestpython runtests. Humph and Ted on IRC helped me sort it out and I successfully built Firefoxpy --autorun --close-when-done --log-file=/i/mozilla/pgo-profile-mochitest-`date +%s`.log --file-level=DEBUG</pre>|}  
|}
==== Created Project Page ( Sept 18th, 2008 ) =Related Bugs === 
{|
|&nbsp;&nbsp;&nbsp;width="15px"||-|| Profiledbuild doesn't work on comm-central - [https://bugzilla.mozilla.org/show_bug.cgi?id=448515 448515]|-||Figure out why building jemalloc breaks with PGO enabled - [https://bugzilla.mozilla.org/show_bug.cgi?id=419470 419470]|-||sort out PGO-triggered bugs - [https://bugzilla.mozilla.org/show_bug.cgi?id=419893 419893]|-||I created this page for win32 mozilla-central weirdness with PGO - [https://bugzilla.mozilla.org/show_bug.cgi?id=437002 437002]|-||To enable PGO on Thunderbird a module in the project and added it Mozilla core needs to the list of Projectshave PGO disabled - [https://bugzilla.mozilla.org/show_bug.cgi?id=465592 465592] - Resolved|-||Components cannot be PGO'd on Windows - [https://bugzilla.mozilla.org/show_bug.cgi?id=468285 468285]|-||js3250!1.pgc remains in dist/bin during a PGO build - [https://bugzilla.mozilla.org/show_bug.cgi?id=467271 467271]
|}
==== Working with PGO ( Sept 19th, 2008 ) =Patches ===
{|
|&nbsp;&nbsp;&nbsp;width="15px"||-||Here is the [[PGO_Related_Bugs/Patches#465592|patch]] for bug [https://bugzilla.mozilla.org/show_bug.cgi?id=465592 465592].|-||Working with some old assignments in c and c++ I tried to compile these programs with pgo options but Here is the linker failed on both projectsproposed [[PGO_Related_Bugs/Patches#468285 | patches]] for bug [https://bugzilla.mozilla.org/show_bug. Also tried from inside of Visual Studio 2008 but received compilation errorscgi?id=468285 468285].
|}
==== Compiled an old assignment with PGO ( Sept 20th, 2008 ) =Releases ===
{|
|&nbspwidth="15px"||==== <span style="color:SaddleBrown;">0.1 Release</span> ==== {||width="15px"||{|!width="25px" |!|-|colspan="2"|'''Reproduce bug(s)'''|-||Was able to reproduce bug for sqlite pgo.|-|colspan="2"|'''Document how to reproduce bug(s).'''|-||To enable PGO for sqlite a line must be commented in a make file.<br />in path/to/src/db/sqlite/src/Makefile.in<br /> add a hash to the line <code>NO_PROFILE_GUIDED_OPTIMIZE = 1</code> <br />should look like <code>#NO_PROFILE_GUIDED_OPTIMIZE = 1</code><br />The build firefox with <code>make -f client.mk profiledbuild</code><br />in the .mozconfig file you'll need an extra parameter <code>mk_add_options PROFILE_GEN_SCRIPT="sh script/to/run.sh"</code><br /><em>My Script file</em> has the following: <pre>export NO_EM_RESTART=1 #this means 'do not restart for any reason' during automation we do not want any restarting mkdir $OBJDIR/_profileprofile cd $OBJDIR/_tests/testing/mochitestpython runtests.py --test-path=browser/ --autorun --close-when-done</pre> |-|colspan="2"|'''Hone in on cause of bug(s).'''|-||Turns out the bug is in the sqlite3.c file. I can reproduce the error when creating a stand alone sqlite application and enabling PGO on the application.|-|colspan="2"|'''Running xpcshell and Mochitest against PGO build.'''|-||Since firefox right out crashes I am unable to run Mochitests but the xpcshell tests do run until they hit the storage tests.<br />{|class="collapsible collapsed" style="border-style:solid;&nbspborder-width:thin;&nbspborder-color:black"!align="left" style="background-color:#FF9933;font-weight:bold;border-style:solid;border-width:thin;padding: 2px 2px 2px 2px;"|SQLite PGO Errors in xpcshell ( Oct 16th, 2008 )|-|My previous attempts at compiling the old assignment <pre>TEST-UNEXPECTED-FAIL | ../../_tests/xpcshell-simple/test_storage/unit/test_bug-365166.js | test failed, see log../../_tests/xpcshell-simple/test_storage/unit/test_bug-365166.js.log:>>>>>>>*** Storage Tests: Trying to close! <<<<<<<TEST-UNEXPECTED-FAIL | ../../_tests/xpcshell-simple/test_storage/unit/test_bug-393952.js | test failed, see log../../_tests/xpcshell-simple/test_storage/unit/test_bug-393952.js.log:>>>>>>>*** Storage Tests: Trying to close! <<<<<<<TEST-UNEXPECTED-FAIL | ../../_tests/xpcshell-simple/test_storage/unit/test_bug-429521.js | test failed, see log../../_tests/xpcshell-simple/test_storage/unit/test_bug-429521.js.log:>>>>>>>*** Storage Tests: Trying to close! <<<<<<<TEST-UNEXPECTED-FAIL | ../../_tests/xpcshell-simple/test_storage/unit/test_bug-444233.js | test failed, see log../../_tests/xpcshell-simple/test_storage/unit/test_bug-444233.js.log:>>>>>>>*** Storage Tests: Trying to close! <<<<<<<TEST-UNEXPECTED-FAIL | ../../_tests/xpcshell-simple/test_storage/unit/test_connection_executeAsync.js | test failed, see log../../_tests/xpcshell-simple/test_storage/unit/test_connection_executeAsync.js.log:>>>>>>>*** Storage Tests: Trying to close! <<<<<<<TEST-UNEXPECTED-FAIL | ../../_tests/xpcshell-simple/test_storage/unit/test_like.js | test failed, see log../../_tests/xpcshell-simple/test_storage/unit/test_like.js.log:>>>>>>>*** Storage Tests: Trying to close! <<<<<<<TEST-UNEXPECTED-FAIL | ../../_tests/xpcshell-simple/test_storage/unit/test_like_escape.js | test failed because , see log../../_tests/xpcshell-simple/test_storage/unit/test_like_escape.js.log:>>>>>>>*** Storage Tests: Trying to close! <<<<<<<make[2]: *** [check] Interruptmake[1]: *** [check] Interruptmake: *** [check] Interrupt</pre>|}||-|colspan="2"|'''Create strategy for profiling Firefox to improve performance. '''|-||I tried different approaches to profiling for Firefox to improve its performance but I was including object files not able to help it at all. I have concluded that were the existing script of opening and closing the browser is more than enough for profiling. The browser is rendered using the same components to render and load web pages this means profiling the loading and rendering of the browser will optimize the rendering and loading of web pages.|-|colspan="2"|'''Deliverable'''|-||I have updated the bug [https://bugzilla.mozilla.org/show_bug.cgi?id=419893 419893] with how to reproduce the bug, a text file of the errors, a zip file with the source code for my test app to produce pgo errors with sqlite as a stand alone app.|} |} ==== <span style="color:SaddleBrown;">0.2 Release</span> ===={||width="15px"|| {|!width="25px" |!|-|colspan="2"|'''Setup Testing Environment'''|-||Created Windows 2003 Server VM - but I am still using my faster Windows XP OS since it is not a VM. The test environment will be used to verify performance data once testing of PGO begins. Either in 0.3 or beyond.|-|colspan="2"|'''Compile Thunderbird with PGO'''|-||I successfully compiled Thunderbird with PGO. It required modifying a different compilerfile. I blogged about it [http://dee132.blogspot.com/2008/11/success. Oopshtml here]. |-|colspan="2"|'''Compile Steps'''|-||I also have the steps to compile Thunderbird with PGO [[PGO_Related_Bugs/Thunderbird|here]].|-|colspan="2"|'''Contribute to Existing Bug'''|-|| The bug '''Profiledbuild doesn't work on comm-central''' [https://bugzilla.mozilla.org/show_bug.cgi?id=448515 448515] has been re-opened and I have posted my success results on this bug.|-|colspan="2"|'''Add PGO to one module'''|-||This will be pushed back to 0.3 Release|} <!-- end of inside 0.2 release -->|} ==== <span style="color:SaddleBrown;">0.3 Release</span> ===={||width="15px"||{|!width="25px" |!|-|colspan="2"|'''Patch to enable PGO for Thunderbird on Windows'''|-||I created a new [https://bugzilla.mozilla.org/show_bug.cgi?id=465592 bug] for allow PGO for Thunderbird on Windows and my patch has made it into the mozilla-core.<br/>This is the [[PGO_Related_Bugs/Patches | patch]] that landed.|-|colspan="2"|'''Add PGO to one module'''|-||It turns out that by default each module is optimized for size if using PGO. The problem that arose from this was the profile data was being collect but not used. The profile data was successful getting deleted at creating the beginning of the build cycle.|-|colspan="2"|'''Create a new bug for deleted profile data'''|-||Problem 1 is the profile data in the dist/bin/components folder is getting deleted. Problem 2 is even if the profile data wasn't getting deleted the pgomerge.py script is not looking for profile data in the dist/bin/components folder anyways. This means that any component that are profiled are not getting optimized.<br />Here are the [[PGO_Related_Bugs/Patches#468285|patches]] I'm proposing.<br/>I created a PGO build with an old assignmentnew [https://bugzilla.mozilla.org/show_bug.cgi?id=468285 bug] for this problem.|-|colspan="2"|'''Details of optimizing Thunderbird'''|-||Using the proposed patches 74 objects were profiled and 69 were optimized. Here are the [[PGO_Related_Bugs/TB_Details|details]].|} <!-- end 0.3 release -->|} |}<!-- end of table indent --> === Errors ==={||width="15px"||*Build Environment:**Windows XP (32-bit)**Visual Studio 2008**Vista SDK {|class="collapsible collapsed" style="border-style:solid;border-width:thin;border-color:black"!align="left" style="background-color:#FF9933; font-weight:bold;border-style:solid;border-width:thin;padding: 2px 2px 2px 2px;"|Firefox Compilation Errors ( Sept 26th, 2008 )|-|<pre>e:\mozilla\trunk\modules\lcms\src\cmscgats.c(875) : fatal error C1001: An internal error has occurred in the compiler.(compiler file 'f:\dd\vctools\compiler\utc\src\p2\main.c[0x511953E5:0x00000008]', line 182) To work around this problem, try simplifying or changing the program near the locations listed above.Please choose the Technical Support command on the Visual C++ Help menu, or open the Technical Support help file for more information LINK : fatal error LNK1000: Internal error during IMAGE::BuildImage  Version 9.00.21022.08  ExceptionCode = C0000005 ExceptionFlags = 00000000 ExceptionAddress = 511953E5 (51030000) "e:\Program Files\Microsoft Visual Studio 9.0\VC\BIN\c2. dll" NumberParameters = 00000002 ExceptionInformation[ 0] = 00000000 ExceptionInformation[ 1] = 00000008 CONTEXT: Eax = 00000000 Esp = 0012ED18 Ebx = 02D5D215 Ebp = 0012ED2C Ecx = 02D96601 Esi = 02D5D280 Edx = 02DAAE12 Edi = 00000305 Eip = 511953E5 EFlags = 00010246 SegCs = 0000001B SegDs = 00000023 SegSs = 00000023 SegEs = 00000023 SegFs = 0000003B SegGs = 00000000 Dr0 = 00000000 Dr3 = 00000000 Dr1 = 00000000 Dr6 = 00000000 Dr2 = 00000000 Dr7 = 00000000</pre>|}  {|class="collapsible collapsed" style="border-style:solid;border-width:thin;border-color:black"!align="left" style="background-color:#FF9933; font-weight:bold;border-style:solid;border-width:thin;padding: 2px 2px 2px 2px;"|Firefox Compilation Errors ( Sept 22th, 2008 )|-|<pre>make[6]: *** [mozlcms.dll] Error 232make[6]: *** Deleting file `mozlcms.dll'make[5]: *** [libs] Error 2make[4]: *** [libs_tier_external] Error 2make[3]: *** [tier_external] Error 2make[2]: *** [default] Error 2make[1]: *** [build] Error 2make: *** [profiledbuild] Error 2</pre>|}<br /> |} <!-- end of table indent --> Thunderbird PGO Errors<br />The lcms module breaks pgo. [[PGO_Related_Bugs/TB_PGO_Errors|Found Here]] === Performance ==={||width="15px"|| Last updated: October 11th, 2008==== [[PGO_Pref_data_here| PGO Performance data ]]====  {|class="collapsible collapsed" style="border-style:solid;border-width:thin;border-color:black"!align="left" style="background-color:#FF9933; font-weight:bold;border-style:solid;border-width:thin;padding: 2px 2px 2px 2px;"| PGO Build Results ( Sept 20th, 2008 )|-|The program loads 15,000 random records from a text file into 4 tables each using a different method for storage and searching.
<ol type="1">
<li>Simple Table: Uses an array and a linear search.
|3.6x
|} <!-- End result Table -->
 |}  |} <br /!-- end of table indent -->I think I will look at the optimization data to figure out how it optimized my application. I also need to build an optimized version of Firefox and run it. I know it has bugs or crashes, that is the point of this project so I also need to figure out how to compile and debug Firefox in Visual Studio.<!-- {|class="collapsible collapsed" style="border-style:solid;border-width:thin;border-color:#FFCC66"!align="left" style="background-color:#CCFFFF;"||-|
|}
-->
==<font color="Peru">Project News </font>= Firefox and PGO ( Sept 22th, = === December 2008 ) ====
{|
!width="100px"|&nbsp;&nbsp;&nbspDate!width="15px"|!Comments|-valign="top"|style="color:green;font-weight:bold" |Dec 8nd, 2008||I built Firefox with successfully optimized the command <code>make -f clientcomponents but I broke something small.mk profiledbuild< I [http:/code>/dee132. This first compiles Firefox with extra code that watches the activity in Firefox and creates profile data to optimize Firefoxblogspot.com/2008/12/thunderbird-components-getting. After Firefox is compiled html blogged] about it runs .|-valign="top"|style="color:green;font-weight:bold" |Dec 6nd, 2008||I posted a script that loads the browsernew bug about components not getting optimized for Windows. While the browser it This is outputting profile data about the activity[https://bugzilla. After the browser is closed it compiles again but this time using the profile data to optimize Firefox to run faster on Windowsmozilla.<br org/> <br />During the compiling of Firefox I received a lot of warningsshow_bug. Then Minefield loaded and after typing in an URL an Assertion happenedcgi?id=468285 bug]. Firefox closed and continue to compile using the profile data but it failed |-valign="top"|style="color:green;font-weight:bold" |Dec 6nd, 2008||After talking with errors. Ted Mielczarek on IRC I tried again this time just closing the browser after it started but again it failed to compile with have found out why the profile data.<br /><br />files I'll post the output and error logs online.Here m profiling are some of not getting merged into the errorsoptimized build.<pre>make[6]: *** [mozlcms.dllPGO_Related_Bugs#Conversations|Here] Error 232make[6]: *** Deleting file `mozlcmsis the conversation.dll'make[5]|-valign="top"|style="color:green;font-weight: *** [libs] Error 2bold" |Dec 6nd, 2008|make|My patch has made into mozilla-central. Here is the [4]http: *** [libs_tier_external//dee132.blogspot.com/2008/12/patch-landed.html blog] Error 2posting.make[3]|-valign="top"|style="color:green;font-weight: *** [tier_external] Error 2bold" |Dec 5nd, 2008|make|My patch has been reviewed. It needed some changes but was approved. This is the [2]https: *** [default//bugzilla.mozilla.org/show_bug.cgi?id=465592 bug] Error 2.|-valign="top"make[1]|style="color: *** [build] Error 2makegreen;font-weight: *** [profiledbuild] Error 2bold" |Dec 5nd, 2008</pre>| Here is link |Still trying to build get the address book optimized. Discovered that all the modules are getting optimized for size by default. I [http://zenitdee132.senecacblogspot.on.cacom/wiki2008/imgs12/Sept22buildoptimizing-thunderbird-address-book_05.zip outputhtml blogged]about it.|-valign="top"|style="color:green;font-weight:bold" |Dec 3nd, 2008||Added speed optimizations to the address book module in Thunderbird. This library gets linked into the mail.dll.|-valign="top"|style="color:green;font-weight:bold" |Dec 2nd, 2008||I got a patch up that will disable pgo for the mozlcms module when it is not linked into the xul.dll.
|}
==== PGO build with no debug or tests ( Sept 24th, November 2008 ) ====----
{|
!width="100px"|&nbspDate!width="15px"|!Comments|-valign="top"|style="color:green;&nbspfont-weight:bold" |Nov 24th, 2008||I've been looking at the Thunderbird Makefiles. I'm trying to understand how the build process works. I [http://dee132.blogspot.com/2008/11/understanding-thunderbird-build-process.html blogged] about it.|-valign="top"|style="color:green;&nbspfont-weight:bold" |Nov 18th, 2008||I created a new [https://bugzilla.mozilla.org/show_bug.cgi?id=465592 bug] to get input on how to enable PGO for Thunderbird without modifying the Mozilla core files. Blog is [http://dee132.blogspot.com/2008/11/lets-start-converation.html here].|-valign="top"|style="color:green;font-weight:bold" |Nov 12th, 2008||I have updated my 0.2 Release.|-valign="top"|style="color:green;font-weight:bold" |Nov 12th, 2008||Nomis who is working on enabling PGO for TB on Mac is having different errors than me. He is posting to the same bug as I am.|-valign="top"|style="color:green;font-weight:bold" |Nov 12th, 2008||A closed [https://bugzilla.mozilla.org/show_bug.cgi?id=448515 bug] for PGO on Thunderbird has been re-opened. I Compiled Firefox am posting to it with disable debug and tests new information and findings.|-valign="top"|style="color:green;font-weight:bold" |Nov 7th, 2008||I posted results from using PGO.|-valign="top"|style="color:green;font-weight:bold" |Nov 7th, 2008||I successfully compiled Thunderbird with PGO enabled. I did not receive any assertions but had to disable PGO for the build still failed mozlcms.dll.|-valign="top"|style="color:green;font-weight:bold" |Nov 4th, 2008||Made change to the client.mk file for Thunderbird and compiled it with PGO enable. I received a compileerror. |-valign="top"|style="color:green;font-weight:(bold" |Nov 1st, 2008||Installed Windows 2003 for creating a testing environment.
|}
==== Compile with VS 2005 Instead ( Sept 26th, October 2008 ) ====----
{|
!width="100px"|&nbspDate!width="15px"|!Comments|-valign="top"|style="color:green;&nbspfont-weight:bold" |Oct 28th, 2008||Focusing on adding PGO to Thunderbird. Built Thunderbird from source.|-valign="top"|style="color:green;&nbspfont-weight:bold" |Oct 17th, 2008||I have written up my 0.1 Release and have blogged about it.|-valign="top"|style="color:green;font-weight:bold" |Oct 16th, 2008|mconner and dbaron |After compiling Firefox with sqlite pgo enabled I was able to reproduce the crash as reported on the #developers on irc[https://moznetbugzilla.mozilla.org suggested /show_bug.cgi?id=419893 bug]. I also received errors in xpcshell which I try posted to compile the profile build using Visual Studio 2005[https://bugzilla.mozilla.org/show_bug.cgi?id=419893 bug] on bugzilla. I also created a test application for sqlite and found it crashed when compiled with PGO as a stand alone application. My other build environment is XP (32bit)|-valign="top"|style="color:green;font-weight:bold" |Oct 14th, VS 2008 and Vista SDK||Through the contribution of a fellow student I was able to create a script to automate multiple PGO Builds. For testing purposes |-valign="top"|style="color:green;font-weight:bold" |Oct 11th, 2008||I should check if VS 2005 checked my performance tests again this time including a pgo build with no profiling and Vista SDK compile then VS 2008 by itselfGoogle Maps was 45% on both Minefields. I'll probably use VirtualBox to make it easierRegardless of the profiling.
The actual error to my compiling |-valign="top"|style="color:green;font-weight:bold" |Oct 10th, 2008||Updated the contributions section for help with VS 2008 is found herecreating bash shell scripts.
<pre>e:\mozilla\trunk\modules\lcms\src\cmscgats.c(875) : fatal error C1001: An internal error has occurred in the compiler.|-valign="top"(compiler file 'f|style="color:\dd\vctools\compiler\utc\src\p2\main.c[0x511953E5green;font-weight:0x00000008]'bold" |Oct 10th, line 182)2008||Made a pgo performance chart. To work around this problem, try simplifying or changing Google Maps was 45% faster in my pgo build after I profiled the program near the locations listed abovesite.Please choose the Technical Support command on the Visual C++ Help menu, or open the Technical Support help file for more information
LINK |-valign="top"|style="color: fatal error LNK1000green;font-weight: Internal error bold" |Oct 8th, 2008||Still receiving 35 failed tests even when I have no windows open and am not at the computer.|-valign="top"|style="color:green;font-weight:bold" |Oct 8th, 2008||Ted mentioned on IRC that the 35 failed tests may of happened because I was moving my mouse during IMAGEthe tests. Which I was. I'm going to try the tests again.|-valign="top"|style="color:green;font-weight:bold" |Oct 7th, 2008||Using pgomgr I am able to see what profiling data has been collected.|-valign="top"|style="color:green;font-weight:bold" |Oct 4th, 2008||A build of Firefox without PGO resulted in 35 failed Tests in Mochitest. Xpcshell passed just fine. At this time the tree is closed so I cannot get the latest bug free version.|-valign="top"|style="color:green;font-weight:BuildImagebold" |Oct 2nd, 2008||After talking with Ted and Dave Humphrey I am going to focus my project on increasing the profiling of Firefox to increase its speed.<br />I am also enabling the modules that have PGO disable and running the xpcshell and Mochitests on them to determine if they are still broken or if they are now working.|}
Version 9.00.21022.08=== September 2008 ===----
ExceptionCode {|!width= C0000005"100px"|Date ExceptionFlags !width= 00000000"15px"|!Comments ExceptionAddress |-|style= 511953E5 (51030000) "ecolor:\Program Files\Microsoft Visual Studio 9green;font-weight:bold" | Sept 30th, 2008||Failed to reproduce bugs.0\VC\BIN\c2 I followed Ted's suggestions on my blog but still not experiencing any problems with my pgo build.dll|-|style="color:green;font-weight:bold" | Sept 28th, 2008 NumberParameters = 00000002| ExceptionInformation|Ted pointed me in the right direction on how to reproduce the PGO bugs. His post is [ 0] http://dee132.blogspot.com/2008/09/successful-pgo-build.html?showComment= 00000000 ExceptionInformation[ 11222626180000#c5457576464993100116 here] = 00000008.|-CONTEXT|style="color:green;font-weight:bold" | Sept 26th, 2008| Eax = 00000000 |Successfully compiled Firefox with PGO using Visual Studio 2005 compiler. Esp Tests and debug are disabled.|-|style= 0012ED18"color:green;font-weight:bold"|Sept 26th, 2008| Ebx |On IRC some guys suggested compiling with Visual Studio 2005 instead.|-|style= 02D5D215 Ebp "color:green;font-weight:bold"|Sept 24th, 2008||Attempted to compile with debug and test disabled. Still Failed.|-|style= 0012ED2C"color:green;font-weight:bold"|Sept 22th, 2008||Failed to compile Firefox with PGO on Visual Studio 2008.|- Ecx |style= 02D96601 "color:green;font-weight:bold"|Sept 20th, 2008||Successfully compiled one old assignment using PGO in Visual Studio. Esi Results in Project Details.|-|style= 02D5D280"color:green;font-weight:bold"|Sept 19th, 2008||Tried to compile some old assignments using PGO in Visual Studio. Two assignments failed.|- Edx |style= 02DAAE12 Edi = 00000305"color:green;font-weight:bold"|Sept 18th, 2008||Created this Project Page. Eip = 511953E5 EFlags = 00010246|- SegCs |style= 0000001B SegDs = 00000023"color:green;font-weight:bold"|Sept 17th, 2008 SegSs = 00000023 SegEs = 00000023| SegFs = 0000003B SegGs = 00000000|Created First Build of Firefox. Dr0 = 00000000 Dr3 = 00000000|- Dr1 |style= 00000000 Dr6 = 00000000"color:green;font-weight:bold"|Sept 15th, 2008 Dr2 = 00000000 Dr7 = 00000000|</pre>|Met with Ted Mielczarek and discuss PGO Project.
|}
1
edit

Navigation menu