Slow compiling with OS4.1FE

A forum for general AmigaOS 4.x support questions that are not platform-specific
xenic
Posts: 1185
Joined: Sun Jun 19, 2011 12:06 am

Slow compiling with OS4.1FE

Post by xenic »

Since I switched to OS4.1FE it seemed like compiles were taking forever. I decided to run some tests to compare OS4.1FE compile times with OS4.1u6 compile times. I tested compiling several large multifile programs with the timer command from OS4Depot and discovered that compiling takes almost twice as long with OS4.1FE as with OS4.1u6! Here are the timing comparisons for compiling the Dopus5 Program only (no library or modules):

With OS4.1 Update6:
Compile times: 225.2183 seconds & 222.6382 seconds
CleanAll times: 0.2826 seconds & 0.3621 seconds

With OS4.1FE:
Compile times: 541.3016 seconds & 546.668 seconds
CleanAll times: 1.4830 seconds & 1.3842 seconds

The above timings are for the program only. Compiling the entire Dopus5 application (Program, Library & modules) takes a huge amount of time with FE. Turnaround compile time for debugging is almost unbearable.

I also tested compiling a large single-file program with OS4.1FE and OS4.1u6 but the difference in compile times were insignificant. I could be wrong but my conclusion is that something has gone wrong with loading source files, commands and/or Sobjs in OS4.1FE.

I've had to revert to OS4.1 Update6 for compiling and debugging some open-source programs that I work on.
AmigaOne X1000 with 2GB memory - OS4.1 FE
User avatar
tonyw
AmigaOS Core Developer
AmigaOS Core Developer
Posts: 1479
Joined: Wed Mar 09, 2011 1:36 pm
Location: Sydney, Australia

Re: Slow compiling with OS4.1FE

Post by tonyw »

Intriguing results.

What is the difference between the two (boot) systems? I mean, how are the volumes arranged that hold the sources, the SDK installation, the system, etc?

Are they all on the same device (HD) ? What filesystems do they all use?
cheers
tony
xenic
Posts: 1185
Joined: Sun Jun 19, 2011 12:06 am

Re: Slow compiling with OS4.1FE

Post by xenic »

tonyw wrote:Intriguing results.

What is the difference between the two (boot) systems? I mean, how are the volumes arranged that hold the sources, the SDK installation, the system, etc?

Are they all on the same device (HD) ? What filesystems do they all use?
Both boot partitions and the SDK are all on the same hard-disk. The FE partition is an SFS partition as recommended. The Update6 partition is an FFS partition. I switch boot partitions by changing the boot priorities with Media Toolbox and cold rebooting. I check that I'm using the correct kickstart by checking the version of dos.library. The SDK is located on an SFS2 partition. The sources being compiled are on another SFS2 partition.

The results should be easy to confirm with any sources that have multiple source files and a makefile. Just D/L timer from OS4Depot if you don't already have it, enter a source directory and enter "timer make".
AmigaOne X1000 with 2GB memory - OS4.1 FE
User avatar
Slayer
Beta Tester
Beta Tester
Posts: 851
Joined: Tue Dec 21, 2010 4:19 am
Location: New Zealand

Re: Slow compiling with OS4.1FE

Post by Slayer »

That is peculiar and needs investigating! :ugeek:
~Yes I am a Kiwi, No, I did not appear as an extra in 'Lord of the Rings'~
1x AmigaOne X5000 2.0GHz 2gM RadeonR9280X AOS4.x
3x AmigaOne X1000 1.8GHz 2gM RadeonHD7970 AOS4.x
zzd10h
Posts: 546
Joined: Sun Sep 16, 2012 5:40 am
Location: France

Re: Slow compiling with OS4.1FE

Post by zzd10h »

X1000
2 SFS/2 boot partitions (4.1.6 & FE)
SDK on the same SFS2 partition

Compiling little program (SysMon) makes no difference

4.1.6
SysMon> timer make
Command duration: 12.2669 sec.

FE
SysMon> timer make
Command duration: 12.3504 sec.


Compiling bigger program (latest SMTube svn revision) seems to be slower
but only 33% slower for me not >100% like for DOpus. SMTube is not as big as DOpus.

4.1.6
SMTube > timer gmake
Command duration: 157.0790 sec.

FE
SMTube > timer gmake
Command duration: 195.6692 sec.
http://apps.amistore.net/zTools
X1000 - AmigaOS 4.1.6 / 4.1 FE
xenic
Posts: 1185
Joined: Sun Jun 19, 2011 12:06 am

Re: Slow compiling with OS4.1FE

Post by xenic »

@zzd10h
Yes. The larger the compile (number of source and header files) the bigger the time difference between Update6 and FE. Here are my compile times for the entire Dopus5 sources (program, library, 20 modules, 3 commands):

Compile time with OS4.1 Update6: 506.3468 seconds (8.44 minutes)
Compile time with OS4.1FE: 1375.7705 seconds (22.93 minutes)

That's a huge difference for anyone compiling a major application for OS4.

Here are the "clean" times for the entire Dopus5 sources:

Clean time with OS4.1 Update6: 4.3809 seconds
Clean time with OS4.1FE: 105.6004 seconds

That's 20 times slower!! Even if there are no object files to delete (clean already done) the times are about the same. It's rediculous. When the sources have already been cleaned, the clean operation is just loading sub-makes and scanning for object files.
AmigaOne X1000 with 2GB memory - OS4.1 FE
xenic
Posts: 1185
Joined: Sun Jun 19, 2011 12:06 am

Re: Slow compiling with OS4.1FE

Post by xenic »

Slayer wrote:That is peculiar and needs investigating! :ugeek:
I investigated some more and discovered that the problem is that SDK:C/make doesn't work as it should. I had to revert back to the "make" command from SDK v51.22 to get a normal compile that is just as fast as the current "make" running with OS4.1 Update6.
AmigaOne X1000 with 2GB memory - OS4.1 FE
xenic
Posts: 1185
Joined: Sun Jun 19, 2011 12:06 am

Re: Slow compiling with OS4.1FE

Post by xenic »

I did some further investigation and found that the make command works at normal speeds (as fast as with Update6) if I boot from an FFS partition. I also discovered that if I edit the startup-sequence on an SFS boot partition and change the PYTHON: assignment to the Python directory on an FFS partition, the make command will operate at normal speed when I boot from the SFS partition with the changed PYTHON: assignment. Strange.
AmigaOne X1000 with 2GB memory - OS4.1 FE
User avatar
Raziel
Posts: 1171
Joined: Sat Jun 18, 2011 4:00 pm
Location: a dying planet

Re: Slow compiling with OS4.1FE

Post by Raziel »

It would ne nice to know what exactly make has to do with Python then

It would make more sense if it's a problem in Python as this part has been updated for FE, if i recall right?
People are dying.
Entire ecosystems are collapsing.
We are in the beginning of a mass extinction.
And all you can talk about is money and fairytales of eternal economic growth.
How dare you!
– Greta Thunberg
zzd10h
Posts: 546
Joined: Sun Sep 16, 2012 5:40 am
Location: France

Re: Slow compiling with OS4.1FE

Post by zzd10h »

@Xenic
I tried the gmake that you sent me.

No difference under FE for the same SMTube source


gmake -v => GNU Make 3.81rc2-4
timer gmake => 189.0125 sec.

previous test with original gmake under FE took 195.6692 sec.
http://apps.amistore.net/zTools
X1000 - AmigaOS 4.1.6 / 4.1 FE
Post Reply