Sunny Chan blogs Can you see the Logic in my Madness?

I end up being Mr. Java pretty much by luck - I was in my third year and I was looking for an internship, which is a requirement for my degree. I was pretty late and got rejected in quite a few places until certain manager from IBM come and interview me for a role. The certain lab in IBM actually made quite a few products and I end up working in the Java Technology Center, and my intern project was to port the JVM to Linux/IA-64 (well no one knows it end up being the biggest white elephant of Intel history). And the rest is history.

My whole career was built on Java, and it has brought me the opportunity to work on pretty impressive projects and interesting work. Java feels like my kid and it is like a proud parent seeing that child growing up and used everywhere as it does.

I understand Java is not as "cool" as it used to be, but I believed in the technology and I know what it can and it cannot do. 

Recently, a leaked memo from Hong Kong has suggested that certain components with the new Air Traffic Control system requires reboot every time the heap is at 2.5G. A number of "high profile"(?) IT(?) blogger posted a couple of piece spreading FUD against Java. Java has its problems and if you "hate" it for the right reason backed by evidence, I would more than happy to accept the opinion. However, the blogger decided for no valid reason in his post he accused Java not being suitable for anything serious. I am not going to let that pass.

Now that blogger has accused those who criticized him spreading FUD against Java being a lefty, and they are helping the government to turn an blind eye in the bad governance/project management of the new ATC roll out. Let me be cleared - you are a respected blogger and with a lot of readers who might not know Java. By reading the FUD in the article you are affecting my career and my life work and I will come out fighting against anyone who spread FUD against Java.

Anyway, I have published my rebuttal to his article in other channel so I am not going to re-post it. If he is believe he is right feel to come and have a conversation with me in June Codeaholics meeting about Java, instead of blocking me on the Facebook. 

I am going to lead an OpenJDK hackathon in Taiwan later this month and I am trying to create an VM image so that people can get up and running quickly. Then last couple of weeks I came across Docker, which is a very simple container which allows easy deployment of images to your machine. So I have decided to try and see whether I can create some docker images for Hackathon use. Here is what I have come up with:

https://registry.hub.docker.com/u/sunnythepooh/openjdk-build

There are two images, one build with Centos 6 base image and one with Centos 7. Out of the container there are all the dependency you need to build OpenJDK 9, and an openjdk user. Once you pull the image down, you can login as openjdk and use mercurial to download openjdk and build straight away.

For Linux, you can install docker directly on any modern distribution. On Windows/MacOS you can use Boot2docker which would give you a very small Linux VM which you can run docker command from and you can take a look at the following command sequence to compile a OpenJDK 9 build:

[schan@sandybridge ~]$ sudo docker run -t -i sunnythepooh/openjdk-build:centos6 /bin/bash

bash-4.2# login openjdk

Password:

Last login: Fri Oct 31 05:02:55 on pts/1

-bash: cannot set terminal process group (-1): Inappropriate ioctl for device

-bash: no job control in this shell

[openjdk@e583ed8a4e04 ~]$ hg clone http://hg.openjdk.java.net/jdk9/dev jdk9

requesting all changes

adding changesets

adding manifests

adding file changes

added 1213 changesets with 1750 changes to 151 files

updating to branch default

93 files updated, 0 files merged, 0 files removed, 0 files unresolved

[openjdk@e583ed8a4e04 ~]$ cd jdk9

[openjdk@e583ed8a4e04 jdk9]$ ls

ASSEMBLY_EXCEPTION  Makefile  README-builds.html  common     get_source.sh  modules.xml

LICENSE             README    THIRD_PARTY_README  configure  make           test

[openjdk@e583ed8a4e04 jdk9]$ bash get_source.sh

WARNING: Mercurial version 2.6.3 or later is recommended. /bin/hg is version 2.6.2

# Repositories:  corba jaxp jaxws langtools jdk hotspot nashorn

                corba:   hg clone http://hg.openjdk.java.net/jdk9/dev/corba corba

                 jaxp:   hg clone http://hg.openjdk.java.net/jdk9/dev/jaxp jaxp

                corba:   requesting all changes

.............................................................................cut for brevity..........................................................................

              nashorn:   searching for changes

              nashorn:   no changes found

                  jdk:   searching for changes

                  jdk:   no changes found

                jaxws:   searching for changes

                jaxws:   no changes found

                 jaxp:   searching for changes

                 jaxp:   no changes found

                    .:   searching for changes

              hotspot:   searching for changes

                    .:   no changes found

              hotspot:   no changes found

                corba:   searching for changes

                corba:   no changes found

            langtools:   searching for changes

            langtools:   no changes found

[openjdk@e583ed8a4e04 jdk9]$ bash ./configure

Running generated-configure.sh

configure: Configuration created at Sat Nov  1 05:15:04 GMT 2014.

configure: configure script generated at timestamp 1414663067.

checking for basename... /bin/basename

checking for bash... /bin/bash

checking for cat... /bin/cat

checking for chmod... /bin/chmod

checking for cmp... /bin/cmp

checking for comm... /bin/comm

checking for cp... /bin/cp

checking for cut... /bin/cut

checking for date... /bin/date

.............................................................................cut for brevity..........................................................................

====================================================

A new configuration has been successfully created in

 /home/openjdk/jdk9/build/linux-x86_64-normal-server-release

using default settings.

Configuration summary:

* Debug level: release

* HS debug level: product

* JDK variant: normal

* JVM variants: server

* OpenJDK target: OS: linux, CPU architecture: x86, address length: 64
Tools summary:

* Boot JDK: openjdk version "1.8.0-internal" OpenJDK Runtime Environment (build 1.8.0-internal-openjdk_2014_10_31_05_05-b00) OpenJDK 64-Bit Server VM (build 25.20-b23, mixed mode) (at /usr/local/jvm/openjdk-1.8.0-internal)

* Toolchain: gcc (GNU Compiler Collection)

* C Compiler: Version 4.8.2 (at /bin/gcc)

* C++ Compiler: Version 4.8.2 (at /bin/g++)
Build performance summary:

* Cores to use: 7

* Memory limit: 11753 MB
WARNING: Your build output directory is not on a local disk.

This will severely degrade build performance!

It is recommended that you create an output directory on a local disk,

and run the configure script again from that directory.

[openjdk@e583ed8a4e04 jdk9]$ make images

Running make as '/bin/gmake -s VERBOSE=-s LOG_LEVEL=warn -R -I /home/openjdk/jdk9/make/common -s SPEC=/home/openjdk/jdk9//build/linux-x86_64-normal-server-release/spec.gmk'

Building OpenJDK for target 'images' in configuration 'linux-x86_64-normal-server-release'

.............................................................................cut for brevity..........................................................................

## Finished verify-modules (build time 00:00:08)
----- Build times -------

Start 2014-11-01 05:23:08

End 2014-11-01 05:30:34

00:00:08 verify-modules

00:07:26 TOTAL

-------------------------
Finished building OpenJDK for target 'images'

[openjdk@e583ed8a4e04 jdk9]$ build/linux-x86_64-normal-server-release/images/j2sdk-image/bin/java -version

openjdk version "1.9.0-internal"

OpenJDK Runtime Environment (build 1.9.0-internal-openjdk_2014_11_01_05_15-b00)

OpenJDK 64-Bit Server VM (build 1.9.0-internal-openjdk_2014_11_01_05_15-b00, mixed mode)

I have upgraded this website to:

• Apache Roller 5.0


• Apache TOmcat 6.0.35


• Java 7 Update 2

If you have following the OpenJDK build Readme and try to compile OpenJDK on Ubuntu 11.10, you may see this error: 

/home/schan/openjdk7/build/linux-amd64/tmp/sun/javax.sound/jsoundalsa/obj64/PLATFORM_API_LinuxOS_ALSA_PCM.o: In function `DAUDIO_GetFormats':

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x1fd): undefined reference to `snd_pcm_format_mask_malloc'

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x20a): undefined reference to `snd_pcm_close'

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x225): undefined reference to `snd_pcm_hw_params_malloc'

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x236): undefined reference to `snd_pcm_hw_params_get_format_mask'

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x246): undefined reference to `snd_pcm_format_mask_free'

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x259): undefined reference to `snd_pcm_hw_params_any'

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x26a): undefined reference to `snd_pcm_hw_params_get_format_mask'

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x277): undefined reference to `snd_pcm_hw_params_get_channels_min'

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x288): undefined reference to `snd_pcm_hw_params_get_channels_max'

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x2cf): undefined reference to `snd_pcm_format_mask_test'

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x45d): undefined reference to `snd_pcm_hw_params_free'

/home/schan/openjdk7/build/linux-amd64/tmp/sun/javax.sound/jsoundalsa/obj64/PLATFORM_API_LinuxOS_ALSA_PCM.o: In function `setStartThresholdNoCommit':

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x48c): undefined reference to `snd_pcm_sw_params_set_start_threshold'

/home/schan/openjdk7/build/linux-amd64/tmp/sun/javax.sound/jsoundalsa/obj64/PLATFORM_API_LinuxOS_ALSA_PCM.o: In function `setStartThreshold':

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x4bf): undefined reference to `snd_pcm_sw_params'

/home/schan/openjdk7/build/linux-amd64/tmp/sun/javax.sound/jsoundalsa/obj64/PLATFORM_API_LinuxOS_ALSA_PCM.o: In function `setHWParams':

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x518): undefined reference to `snd_pcm_hw_params_any'

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x531): undefined reference to `snd_pcm_hw_params_set_access'

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x544): undefined reference to `snd_pcm_hw_params_set_format'

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x557): undefined reference to `snd_pcm_hw_params_set_channels'

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x58a): undefined reference to `snd_pcm_hw_params_set_rate_near'

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x5dc): undefined reference to `snd_pcm_hw_params_set_buffer_size_near'

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x60b): undefined reference to `snd_pcm_hw_params_set_period_time_near'

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x61b): undefined reference to `snd_pcm_hw_params'

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x647): undefined reference to `snd_pcm_hw_params_set_periods_near'

/home/schan/openjdk7/build/linux-amd64/tmp/sun/javax.sound/jsoundalsa/obj64/PLATFORM_API_LinuxOS_ALSA_PCM.o: In function `setSWParams':

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x67e): undefined reference to `snd_pcm_sw_params_current'

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x6b4): undefined reference to `snd_pcm_sw_params_set_avail_min'

PLATFORM_API_LinuxOS_ALSA_PCM.c:(.text+0x6c4): undefined reference to `snd_pcm_sw_params'

--- old/make/javax/sound/jsoundalsa/Makefile    2011-10-28 02:28:00.000000000 -0400

+++ new/make/javax/sound/jsoundalsa/Makefile    2011-10-28 02:28:00.000000000 -0400

@@ -65,7 +65,7 @@

        $(MIDIFILES_export) \

        $(PORTFILES_export)

 

-LDFLAGS += -lasound

+EXTRA_LIBS += -lasound

 

 CPPFLAGS += \

        -DUSE_DAUDIO=TRUE \

These are the steps that I have made OpenJDK to compile on Windows platform:

1. Install Visual C++ 2010 Express (or if you are rich, get Visual Studio 2010 Professional) 


2. Install Windows 7 Platform SDK


3. Install Cygwin, install the packages suggested on OpenJDK Readme. Also install gcc for step 5


4. Install DirectX 9.0 SDK


5. The gnu make package in the current cygwin does not support Windows directory convention and you should compile your own version of the make 3.82 which has the correct support.


6. Download latest Freetype. 




• Compile it using Visual C++ - you can find the Visual C++ project file under <freetype src>/builds/win32/vc2010. 


• Make sure you have change the type of DLL it generates by going to Project->Properties, then Configuration Manager... button, set it to Release and Win32


• Make sure you have set it so that it builds a DLL - you can find that under Project->Properties, Configuration Properties, General and there should be a Configuration Type drop down box


• You can then build freetype. The DLL generated will have a version number attached to it (e.g. freetype245.dll) and you will need to make sure you rename it to freetype.dll.




7. Get latest Apache ANT


8. Make sure you have a Java 6 JDK installed


9. Download the openjdk source code, either using hg or source bundle (I will assume you put it in c:\openjdk)


10. Open a command prompt for Windows SDK by going to Start -> Windows SDK 7.1 -> Windows SDK 7.1 command prompt


11. For 32bit ONLY, you should run the Visual Studio compiler settings batch file: c:\program files\Microsoft Visual Studio 10.0\VC\bin\vcvars32.bat


12. Make sure you have override the standard cygwin bin path so that make.exe you have compiled in step 5 take precedent of the default cygwin.


13. Also check that the link.exe you run in the path is the actual Microsoft linker and not the cygwin's link command - you will need to fiddle with the path.


14. Setup a number of environment variables:




1. ALT_BOOTDIR should point to the Java 6 JDK (Step 8)


2. ALT_DXSDK_PATH is the DirectX SDK PATH (Step 4)


3. ALT_FREETYPE_LIB_PATH and ALT_FREETYPE_HEADERS_PATH.


4. ANT_HOME


5. HOTSPOT_BUILD_JOBS if you want to parallelize your build - you can't use -j options in the make command


6. ALLOW_DOWNLOADS=true so that it can download JAXP and JAXS jar


7. Make sure the path is setup correctly (Step 12/13)




15. You are ready to give it a go. First, run "make sanity" and see whether there is anything you setup incorrectly. If something is wrong, fix it.


16. If you have passed make sanity, you can run make to build the JDK! Go and make a cuppa, it will take a while. On my i7-2600 and hard drive it took 2 hours.

Important: In order to build a 32bit JDK you must use a 32bit System - ie. you cannot cross compile (ie. 64bit Windows and compile a 32bit JDK)

This is the abstract for my COSCUP talk on August 18th, 2011:

OpenJDK 7: The universal language runtime

Sunny Chan
Hong Kong Java User Group Leader

OpenJDK 7 is the latest release of the Java Platform. In this release, there are a number of major innovations in the OpenJDK's Java Virtual Machine to enable other scripting languages like Ruby, Python and PHP to run on the platform efficiently.

In this talk, I will give you 5 reasons why you should run your applications written in alternative languages like Ruby on the OpenJDK Runtime. I will also explore some of the common myths about running your application with the Java Runtime.

That's a little bit of fun for you today: You can write a 3D apps using javascript while using javascript agent!

Don't think you can do that with c# :-)

Well, the tomcat server that runs this roller weblog died last night - seems like it has running out of memory....

I am running thi weblog on a Xen VM with 128M  memory - seems like it is not enough! I can't really afford a proper hosted machine at the moment - otherwise I definitely would try to get more memory! Anyway, I have restarted the server now and it is all fine - maybe I need to switch JVM, and my old colleagues will bark!