SERVER-40946 Autoset a reasonable concurrency level when icecream is enabled

1 files changed, 10 insertions, 1 deletions

diff --git a/SConstruct b/SConstruct
index beda0cec47b..a14cc81545e 100644
--- a/SConstruct
+++ b/SConstruct
@@ -3821,10 +3821,19 @@ env.Alias("distsrc", "distsrc-tgz")
 # reports the number of CPUs for the host system. Perhaps in a future version of
 # psutil it will instead report the correct number when in a container.
 #
+# The presence of the variable ICECC means the icecream tool is
+# enabled and so the default j value should scale accordingly. In this
+# scenario multiply the cpu count by 8 to set a reasonable default since the
+# cluster can handle many more jobs than your local machine but is
+# still throttled by your cpu count in the sense that you can only
+# handle so many python threads sending out jobs.
+#
 # psutil.cpu_count returns None when it can't determine the number. This always
 # fails on BSD's for example.
-if psutil.cpu_count() is not None:
+if psutil.cpu_count() is not None and 'ICECC' not in env:
     env.SetOption('num_jobs', psutil.cpu_count())
+elif psutil.cpu_count() and 'ICECC' in env:
+    env.SetOption('num_jobs', 8 * psutil.cpu_count())
 
 
 # Do this as close to last as possible before reading SConscripts, so