Trying the compilation procedure

Added by T.J. Yang over 3 years ago

I am trying out compilation procedure at R1.
No problem until I reach step 3 "dmake install"
Following is the error message.

Not sure what to do next ?

os132 is running OpenSolaris 134.


root@os132:~/pkg-gate/src# dmake install
dmake: defaulting to parallel mode.
See the man page dmake(1) for more information on setting up the .dmakerc file.
/root/pkg-gate/src/web
/root/pkg-gate/src/gui
os132 --> 1 job
LC_ALL=C intltool-merge -d -u \
    -c ../po/.intltool-merge-cache ../po data/packagemanager.desktop.in data/packagemanager.desktop
os132 --> 2 jobs
LC_ALL=C intltool-merge -d -u \
    -c ../po/.intltool-merge-cache ../po data/addmoresoftware.desktop.in data/addmoresoftware.desktop
--snip--
os132 --> Job output
msgfmt -o help/id/id.mo help/id/id.po
help/id/id.po:726:77: invalid control sequence
msgfmt: found 1 fatal error
*** Error code 1
dmake: Fatal error: Command failed for target `help/id/id.mo'
Current working directory /root/pkg-gate/src/gui
Waiting for 1 job to finish
*** Error code 1
The following command caused the error:
cd gui; pwd; dmake install
dmake: Fatal error: Command failed for target `gui'
root@os132:~/pkg-gate/src#


R1:http://illumos.org/projects/illumos-gate/wiki


Replies (13)

RE: Trying the compilation procedure - Added by Steve Goldthorpe over 3 years ago

I was having exactly the same problem last night. Today worked out that there are two incompatible versions of msgfmt installed and you want the Sun version rather that the GNU version (which by default is on the search path first).

Run the following before running dmake (or change your PATH in your startup profile):
export PATH=/usr/bin:$PATH

-Steve

RE: Trying the compilation procedure - Added by T.J. Yang over 3 years ago

put "/usr/bin" as the firs field of PATH variable in/etc/profile.
dmake clean
dmake install

now I got a clean "dmake install" ;)
Thanks a lot for the pointer, Steve.

creating coverage.egg-info
writing coverage.egg-info/PKG-INFO
writing top-level names to coverage.egg-info/top_level.txt
writing dependency_links to coverage.egg-info/dependency_links.txt
writing entry points to coverage.egg-info/entry_points.txt
writing manifest file 'coverage.egg-info/SOURCES.txt'
reading manifest file 'coverage.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
writing manifest file 'coverage.egg-info/SOURCES.txt'
Copying coverage.egg-info to /root/pkg-gate/proto/root_i386/usr/lib/python2.6/vendor-packages/coverage-3.2b2-py2.6.egg-info
running install_scripts
Installing coverage script to /root/pkg-gate/proto/root_i386/usr/bin
root@os134:~/pkg-gate/src#

RE: Trying the compilation procedure - Added by T.J. Yang over 3 years ago

at step here,

2) tar jxvf /opt/rl_file/on-nightly-142.i386.tar.bz2

tar should be "gtar"

RE: Trying the compilation procedure - Added by Richard PALO over 3 years ago

Hi, I'm also trying...
Got as far as the onu step and I get the following:
richard@shuttleX:/opt# ./onu.sh -Ot on-nightly-142.i386 -u http://localhost:13000
PHASE ACTIONS
Phase de suppression 54/54
Deleting content cache
pkg : les catalogues 3/4 ont été mis à jour :

Framework error: code: 60 reason: SSL certificate problem, verify that the CA cert is OK. Details:
error:14090086:SSL routines:SSL3_GET_SERVER_CERTIFICATE:certificate verify failed
URL: 'https://pkg.sun.com/opensolaris/extra/catalog/0/'.
pkg -R /tmp/onu.5GayNv refresh --full failed: exit code 3

the other window running pkg.depot.d displays:
richard@shuttleX:/export/repo# /usr/lib/pkg.depotd -d /export/repo/on-nightly-142.i386 -p 13000
[16/Aug/2010:23:07:50] INDEX Search Available
[16/Aug/2010:23:07:50] ENGINE Listening for SIGHUP.
[16/Aug/2010:23:07:50] ENGINE Listening for SIGTERM.
[16/Aug/2010:23:07:50] ENGINE Listening for SIGUSR1.
[16/Aug/2010:23:07:50] ENGINE Bus STARTING
[16/Aug/2010:23:07:50] ENGINE Started monitor thread '_TimeoutMonitor'.
[16/Aug/2010:23:07:50] ENGINE Serving on 0.0.0.0:13000
[16/Aug/2010:23:07:50] ENGINE Bus STARTED
127.0.0.1 - - [16/Aug/2010:23:10:57] "GET /versions/0/ HTTP/1.1" 200 151 "" "pkg/4ba5092f1b06 (sunos i86pc; 5.11 snv_134; full; pkg)"
127.0.0.1 - - [16/Aug/2010:23:10:57] "GET /catalog/1/catalog.attrs HTTP/1.1" 200 861 "" "pkg/4ba5092f1b06 (sunos i86pc; 5.11 snv_134; full; pkg)"
127.0.0.1 - - [16/Aug/2010:23:10:57] "GET /catalog/1/catalog.summary.C HTTP/1.1" 200 205103 "" "pkg/4ba5092f1b06 (sunos i86pc; 5.11 snv_134; full; pkg)"
127.0.0.1 - - [16/Aug/2010:23:10:57] "GET /catalog/1/catalog.base.C HTTP/1.1" 200 98583 "" "pkg/4ba5092f1b06 (sunos i86pc; 5.11 snv_134; full; pkg)"
127.0.0.1 - - [16/Aug/2010:23:10:57] "GET /catalog/1/catalog.dependency.C HTTP/1.1" 200 367915 "" "pkg/4ba5092f1b06 (sunos i86pc; 5.11 snv_134; full; pkg)"

and I had already the certificate installed from long ago for extra:
richard@shuttleX:~$ pkg publisher extra

Éditeur : extra
Alias : None
URI d'origine : https://pkg.sun.com/opensolaris/extra/
Clé SSL : /var/pkg/ssl/OpenSolaris_extras.key.pem
Certificat SSL : /var/pkg/ssl/OpenSolaris_extras.certificate.pem
Date de début de validité du certificat : 5 mai 2010 06:09:51
Date d'expiration du certificat : 13 juin 2011 06:09:51
UUID client : 00000000-19e4-cb88-0111-000000000000
Mise à jour du catalogue : 11 mai 2010 08:38:54
Activation : Oui
richard@shuttleX:~$ ls /var/pkg/ssl/
OpenSolaris_extras.certificate.pem OpenSolaris_extras.key.pem

I'm not too familiar with the certificate details, any hints as to what I might try? thanks in advance.

RE: Trying the compilation procedure - Added by Richard PALO over 3 years ago

Well, I was dubious after all of the following part of the step 3 procedure:

Copy pkg files:

tar cf - * | (cd / ; tar xvpf -)

especially the fact the I had to change to root in order to do this...

I tried pkg verify and I noticed thousands of owners and group problems (namely me)...
So I figured I'd just rollback to before the begin of the procedure (thanks ZFS!)...

And I executed ONLY step four, and I was able to successfully onu without the extra problems.
Now just to get the network working again in the new BE...

Sorry for the bad air, but perhaps the wiki should be verified thoroughly...
cheers

RE: Trying the compilation procedure - Added by Piotr Jasiukajtis over 3 years ago

Hi,

Please take a look at updated wiki site, it should be much easier now.

RE: Trying the compilation procedure - Added by Raphael Barabas over 3 years ago

Piotr Jasiukajtis wrote:

Please take a look at updated wiki site, it should be much easier now.

Thank you very much! I really appreciate it to get a single source of information about compiling and updating. I couldn't be bothered to even try it until now. Opensolaris.org just confused me with different infos dating back to different procedures.

I was able to follow that procedure nice and easy, now my test-notebook is compiling.

Feedback/Questions:
1. How long (ROUGHLY) will it take to compile on an Intel Core Duo 1.66GHz notebook?
2. Which steps do i need to run as root? It would be nice to have indicators in the instructions.

Well, thanks again. Keep writing! :)
Raphael

RE: Trying the compilation procedure - Added by Raphael Barabas over 3 years ago

Raphael Barabas wrote:

1. How long (ROUGHLY) will it take to compile on an Intel Core Duo 1.66GHz notebook?

JFYI, it took five and a half hour on this notebook. I also compiled on a faster desktop machine (intel core 2 duo E8400) and it compiled for three hours.

RE: Trying the compilation procedure - Added by T.J. Yang over 3 years ago

Hi, Raphael

Would you mind show me the output of "uname -a" ?

Thanks

tj

RE: Trying the compilation procedure - Added by Russ Price over 3 years ago

Regarding compilation time, I got about 1 hour 20 minutes on an Athlon II 630 X4, on mirrored 500 GB SATA-II disks with the cheapest OCZ Vertex SSD I could find (30 GB) for L2ARC.

Another system that I have has a Phenom II 550 X2 Black Edition, which turned out to have two unlockable cores (so it's running as a quad-core). It also has mirrored 500 GB drives and a Vertex L2ARC, and on that system it's about 1 hour 5 minutes.

Both systems have the same motherboard (ASUS M4A785-M) with 4 GB of ECC RAM.

In any case, extra cores are a Good Thing when compiling large projects. :)

RE: Trying the compilation procedure - Added by Raphael Barabas over 3 years ago

T.J. Yang wrote:

Would you mind show me the output of "uname -a" ?

sure, here tou go:

$ uname -a
SunOS shine 5.11 illumos-gate i86pc i386 i86pc Solaris
(desktop machine with intel E8400 64bit)

I had to set MACH and some things are not working (locale, splashimage).
Also ON_CRYPTO_BINS probably has been empty. See Bug #103.

5 hours compilation on a notebook didn't hold true though. It's more like 10 hours, and i didn't yet get it to compile without errors. I'll look into that next week.

RE: Trying the compilation procedure - Added by T.J. Yang over 3 years ago

I am not getting a successful build, the uname -a output after 4. step at "pfexec init 6", I am getting onnv_145.

tjyang@illumos:~$ uname -a
SunOS illumos 5.11 onnv_145 i86pc i386 i86pc
tjyang@illumos:~$

Here is the mail_msg, sorry for the long post.
Any pointer where I might did wrong ?

tj

tjyang@illumos:/code/illumos-gate/log/log.2010-08-29.19:07$ cat mail_msg

==== Nightly distributed build started:   Sun Aug 29 13:27:50 CDT 2010 ====
==== Nightly distributed build completed: Sun Aug 29 19:07:33 CDT 2010 ====

==== Total build time ====

real    5:39:42

==== Build environment ====

/usr/bin/uname
SunOS illumos 5.11 onnv_145 i86pc i386 i86pc

/code/illumos-gate/usr/src/tools/scripts/nightly illumos.sh
-rwxr-xr-x 1 tjyang staff 100011 2010-08-29 13:22 /code/illumos-gate/usr/src/tools/scripts/nightly

/opt/SUNWspro/bin/dmake
dmake: Sun Distributed Make 7.8 SunOS_i386 Patch 126504-01 2007/07/19
number of concurrent jobs = 4

32-bit compiler
/opt/onbld/bin/i386/cw -_cc
cw version 1.29
primary: /opt/SUNWspro/bin/cc
cc: Sun C 5.9 SunOS_i386 Patch 124868-10 2009/04/30
shadow: /usr/sfw/bin/gcc
gcc (GCC) 3.4.3 (csl-sol210-3_4-20050802)

64-bit compiler
/opt/onbld/bin/i386/cw -_cc
cw version 1.29
primary: /opt/SUNWspro/bin/cc
cc: Sun C 5.9 SunOS_i386 Patch 124868-10 2009/04/30
shadow: /usr/sfw/bin/gcc
gcc (GCC) 3.4.3 (csl-sol210-3_4-20050802)

/usr/java/bin/javac
java full version "1.6.0_18-b07" 

/usr/ccs/bin/as
as: Sun Compiler Common 12 SunOS_i386 snv_121 08/03/2009

/usr/ccs/bin/ld
ld: Software Generation Utilities - Solaris Link Editors: 5.11-1.1719

Build project:  group.staff
Build taskid:   96

==== Nightly argument issues ====

==== Build version ====

illumos-gate

==== Make clobber ERRORS ====

==== Make tools clobber ERRORS ====

==== Tools build errors ====

==== Build errors (DEBUG) ====

==== Build warnings (DEBUG) ====

==== Elapsed build time (DEBUG) ====

real  4:57:02.8
user  5:34:56.2
sys   1:56:44.2

==== Build noise differences (DEBUG) ====

==== package build errors (DEBUG) ====

==== Validating manifests against proto area ====

Entries present in exception list but missing from proto area:
        etc/llc2/default
        etc/llc2/llc2_start.default
        usr/lib/llc2/llc2_autoconfig
        usr/lib/llc2/llc2_config
        usr/lib/llc2/llc2_loop2
        usr/lib/llc2/llc2_loop3
        usr/lib/llc2/llc2_loop4
        usr/lib/llc2/llc2_stats
        usr/lib/llc2/llc2_tcap
        usr/lib/llc2/llc2_tparser

==== Check ELF runtime attributes ====

usr/bin/localedef:      symbol not found: __lc_messages         (/code/illumos-gate/proto/root_i386/usr/bin/localedef)  <no -zdefs?>
usr/bin/localedef:      symbol not found: __lc_time             (/code/illumos-gate/proto/root_i386/usr/bin/localedef)  <no -zdefs?>
usr/bin/localedef:      symbol not found: __lc_numeric          (/code/illumos-gate/proto/root_i386/usr/bin/localedef)  <no -zdefs?>
usr/bin/localedef:      symbol not found: __lc_monetary         (/code/illumos-gate/proto/root_i386/usr/bin/localedef)  <no -zdefs?>
usr/lib/locale/iso_8859_1/amd64/iso_8859_1.so.3:        symbol not found: __locale_init         (/code/illumos-gate/proto/root_i386/usr/lib/locale/iso_8859_1/amd64/iso_8859_1.so.3)    <no -zdefs?>
usr/lib/locale/iso_8859_1/amd64/iso_8859_1.so.3:        symbol not found: __nl_langinfo_std             (/code/illumos-gate/proto/root_i386/usr/lib/locale/iso_8859_1/amd64/iso_8859_1.so.3)    <no -zdefs?>
usr/lib/locale/iso_8859_1/amd64/iso_8859_1.so.3:        symbol not found: __localeconv_std              (/code/illumos-gate/proto/root_i386/usr/lib/locale/iso_8859_1/amd64/iso_8859_1.so.3)    <no -zdefs?>
usr/lib/locale/iso_8859_1/amd64/iso_8859_1.so.3:        symbol not found: __ctype_init          (/code/illumos-gate/proto/root_i386/usr/lib/locale/iso_8859_1/amd64/iso_8859_1.so.3)    <no -zdefs?>
usr/lib/locale/iso_8859_1/amd64/iso_8859_1.so.3: unreferenced object=/code/illumos-gate/proto/root_i386/lib/amd64/libc.so.1; unused dependency of /code/illumos-gate/proto/root_i386/usr/lib/locale/iso_8859_1/amd64/iso_8859_1.so.3    <remove lib or -zignore?>
usr/lib/locale/iso_8859_1/iso_8859_1.so.3:      symbol not found: __locale_init         (/code/illumos-gate/proto/root_i386/usr/lib/locale/iso_8859_1/iso_8859_1.so.3)  <no -zdefs?>
usr/lib/locale/iso_8859_1/iso_8859_1.so.3:      symbol not found: __nl_langinfo_std             (/code/illumos-gate/proto/root_i386/usr/lib/locale/iso_8859_1/iso_8859_1.so.3)  <no -zdefs?>
usr/lib/locale/iso_8859_1/iso_8859_1.so.3:      symbol not found: __localeconv_std              (/code/illumos-gate/proto/root_i386/usr/lib/locale/iso_8859_1/iso_8859_1.so.3)  <no -zdefs?>
usr/lib/locale/iso_8859_1/iso_8859_1.so.3:      symbol not found: __ctype_init          (/code/illumos-gate/proto/root_i386/usr/lib/locale/iso_8859_1/iso_8859_1.so.3)  <no -zdefs?>
usr/lib/locale/iso_8859_1/iso_8859_1.so.3: unreferenced object=/code/illumos-gate/proto/root_i386/lib/libc.so.1; unused dependency of /code/illumos-gate/proto/root_i386/usr/lib/locale/iso_8859_1/iso_8859_1.so.3      <remove lib or -zignore?>

==== Diff ELF runtime attributes (since last build) ====

==== cstyle/hdrchk errors ====

==== Find core files ====

==== Check lists of files ====

==== Impact on file permissions ====

==== Nightly build noise ====

/code/illumos-gate/usr/src/tools/scripts/nightly[2377]: wstypes: line 2346: http_get: not found

tjyang@illumos:/code/illumos-gate/log/log.2010-08-29.19:07$

RE: Trying the compilation procedure - Added by Raphael Barabas over 3 years ago

T.J. Yang wrote:

Here is the mail_msg, sorry for the long post. Any pointer where I might did wrong ?

My log looks the same, except for some lines mentioning lint.
be sure to follow the wiki exactly, especially part "c) Edit your illumos.sh file:"

==== Diff ELF runtime attributes (since last build) ====

==== 'dmake lint' of src ERRORS ====

==== Elapsed time of 'dmake lint' of src ====

real    40:04.4
user    46:54.0
sys      9:22.5

==== lint warnings src ====

==== lint noise differences src ====

==== cstyle/hdrchk errors ====

(1-13/13)