667
edits
Changes
Added link for compiler porters
= Project Description =
The goal of this project is to speed up Windows Mozilla Builds by spreading object compilations over several machines. This can be done by using an open source product called distcc created by Martin Pool. Unfortunately this is only available on *nix machines using gcc. Our project involves porting this software to Windows and use [http://msdn.microsoft.com/visualc/ Microsoft's Visual C++ compiler] using cygwinand msys.
= Project Leader(s) =
= Product Documentation =
The project has been focused on getting distcc to work with Mozilla, mainly because Mozilla uses GNU Makefiles which can run concurrent jobs. We have started a [[distcc_mozilla_tutorial| tutorial]] in order to help testers/developers. We have also written documentation for others who might wish to [[Adding Compilers to Distcc|add support to distcc for other compilers]] (e.g., Java, C#, etc.).
== Current Status ==
== What's still to do ==
<!-- Taken from ben's project page -->
<table style="width: 100%;" class="standard-table" cellborder=1 border=1 cellpadding=2 cellspacing=0>
<tr>
<th>Task</th>
<th style="width: 10%>Priority</th>
<th style="width: 30%">Status</th>
</tr>
<tr>
<td>Fix documentation, including website, manpage, and tutorials</td>
<td style="background-color: #ff671e; text-align: center; font-weight: bold; font-size: bigger">Medium</td>
<td>Neglected. I think Tom has worked on the man page, Cesar has worked on the tutorial</td>
</tr>
<tr>
<td>
* find a suitable replacement for fork()
** using windows threads. Need to use #ifdef directives to switch between unix fork and threads. But perhaps where is a better way to do this.
** Perhaps talk to Martian Pool to see if he has any ideas? He hasn't been in the mailing list for a while.
</td>
<td style="background-color: red; text-align: center; font-weight: bold; font-size: bigger">High</td>
<td>Have not started</td>
</tr>
<tr>
<td>
* Send .pdb files to allow debug builds. Currently blocking mozilla from ever using distcc.
** looking at the protocol. Hopefully we don't have to changed a lot.
</td>
<td style="background-color: red; text-align: center; font-weight: bold; font-size: bigger">High</td>
<td>Have not started</td>
</tr>
<tr>
<td>
* Port distcc to use mingw
** Properly link in winsock library ([http://www.foobartastic.com/2007/02/27/distcc-alpha-2-and-moving-to-mingw/ fixed] using libtool)
** use windows threads (another high priority item)
** locate and replace unix functionality that existed in cygwin, but doesn't exist in mingw.
</td>
<td style="background-color: red; text-align: center; font-weight: bold; font-size: bigger">High</td>
<td>Have only got libtool to compile a simple sockets program. We have now port it to distcc
* probably use #ifdef MINGW ... #else ... #endif in source files that use socket.h
* another possibility is to have one header file handle this, and the source files include that header file </td>
</tr>
<tr>
<td>Find more applications that use the Makefile system and can use CL</td>
<td style="background-color: #ff671e; text-align: center; font-weight: bold; font-size: bigger">Medium</td>
<td>Difficult to find. Not many open source applications use Makefile and MSVC, many choosing to opt for NMake</td>
</tr>
<tr>
<td>Compile NSPR using distcc</td>
<td style="background-color: #ff671e; text-align: center; font-weight: bold; font-size: bigger">Medium</td>
<td>Dave suggested only building NSPR because its smaller and won't take as long to compile. Cesar is responsible for this</td>
</tr>
<tr>
<td>boy there sure are lot of memory leaks... would be nice to fix that</td>
<td style="background-color: yellow; text-align: center; font-weight: bold; font-size: bigger">Low</td>
<td>We can use tools like valgrind and mtrace to help. Or we can use Boehm-GC to free the memory automatically. But this is a lot of work for such low priority.</td>
</tr>
<tr>
<td>Make sure that there are no orphan distcc processes left after make maintainer-check</td>
<td style="background-color: yellow; text-align: center; font-weight: bold; font-size: bigger">Low</td>
<td>This is a problem when tests are killed, and can leave to false-negatives when you try to rerun the tests again. But that can be fixed with god ol' kill-y mc. kill, agent 009</td>
</tr>
</table>
<!--
{|class="standard-table" border='1'
|-
| medium
|-
| <strike>Get distcc working with Moz </strike>
{| class="standard-table" border='1'
|-
| <strike>check why MSVC Preprocessor seems to be dying with firefox 2.0 release source. Possible Solution: We're doing unix to windows path conversion on the daemon, move that code to the client and everything might be good.</strike> | <strike>high (currently Cesar & Tom)</strike>
|-
| <strike>Figure out why distributed builds die but nondistributed builds don't. This issue lies in the Moz Build System not in distcc code.</strike>
| <strike>High</strike>
|}
| <strike>HIGH</strike>|-| Get a list of programs that work with our distcc{| class="standard-table" border='1' | Application | Reporter |- | [http://cdot.senecac.on.ca/software/nled/ NLED] | Cesar |- | [http://www.mozilla.org mozilla] | Tom + Cesar |}|Medium
|-
|boy there sure are lot of memory leaks... would be nice to fix that
| low
|-
|Make sure that there are no orphan distcc processes left after make maintainer-check
| low
|-
|}
-->
== How to get distcc to compile use cl ==
Tom and Cesar created this patch keeping backwards compatibility in mind. You should be able to still use distcc to compile your c programs if you wish. But if you applied the patch, you probably want to do more than that.
If it is different for your machine, you need to find these in the Makefile.in or Makefile and change them to your settings.
== Extending the program ==This will be postponed until we get distcc working properly (not fully) with cl.
= Project Details =
= Project News =
See what's up with this project! Older news can be found [[Distcc With MSVC:Older News|here]]
== May 1, 2007 ==
I've been doing a lot of #ifdef conditions, just to get it to compile (although we will be doing windows threads instead of fork, this is just a step). But now I'm stuck on the function fcntl(). It's a POSIX function, and it has POSIX flags, but some of the flags don't seem to exist in Windows. I don't have enough information to know how important the function is, and if we can just skip it.
And I forgot my power cable in a certain building, and laptop is running out of battery!
== April 30, 2007 ==
There are some header files in distcc that have the same name as some of the standard header files in /usr/include. One file is rpc.h, which is being #included by "sockets.h". Since we don't need sockets.h, this shouldn't be a problem in ''this case''. But that is still something we have to watch out for.
Bah! windows.h #includes rpc.h, dammit.
Resource : [http://www.microsoft.com/technet/interopMigration/taskstools/migrate/unix/ucamg/ch05uav3.mspx#EDHAC Microsofts Unix migration guide]
== April 28, 2007 ==
PDB files :
vc80.pdb - source file debug symbols
'''project'''.pdb - project debug symbols
==Jan 5April 23, 2007==
==Jan 4, 2007==
hello.i : fatal error LNK1107: invalid or corrupt file: cannot read at 0xEE7F
</pre></code>
