[Mac M3] A fatal error has been detected by the Java Runtime Environment #4807
Description
Describe the bug
~ ❯ java -Xms32g -Djava.util.logging.config.file=opengrok/etc/logging.properties -jar opengrok/dist/lib/opengrok.jar -s opengrok/src/ --ignore d:'prebuilts' -i d:'test*' -i '*.zip' -i '*.bz2' -i '*.jar' -i '*.gz' -i '*.ko' -i '*.so' -i '*.json' -i '*.apk' -d opengrok/data/ -P -S -W opengrok/etc/configuration.xml -U http://localhost:8080/source
2025-07-09 09:43:39.076+0800 INFO t1 Indexer.parseOptions: Indexer options: [-s, opengrok/src/, --ignore, d:prebuilts, -i, d:test*, -i, *.zip, -i, *.bz2, -i, *.jar, -i, *.gz, -i, *.ko, -i, *.so, -i, *.json, -i, *.apk, -d, opengrok/data/, -P, -S, -W, opengrok/etc/configuration.xml, -U, http://localhost:8080/source]
2025-07-09 09:43:39.307+0800 INFO t1 Configuration.checkConfiguration: History based reindex is on, however history is off. History has to be enabled for history based reindex.
2025-07-09 09:43:39.397+0800 INFO t1 Indexer.runMain: Indexer version 1.14.1 (0010bd7fd0bbdce260f4e517d9817fdcb232c9a4) running on Java version: 21.0.1+12-LTS-29, name: Java HotSpot(TM) 64-Bit Server VM, vendor: Oracle Corporation, arch: aarch64 with properties: ncpu: 12, maxMemory: 32.0 GiB
2025-07-09 09:43:39.476+0800 INFO t1 RuntimeEnvironment.validateUniversalCtags: Using ctags: Universal Ctags 6.2.0, Copyright (C) 2015-2025 Universal Ctags Team
Universal Ctags is derived from Exuberant Ctags.
Exuberant Ctags 5.8, Copyright (C) 1996-2009 Darren Hiebert
Compiled: Jun 12 2025, 22:31:15
URL: https://ctags.io/
Output version: 1.1
Optional compiled features: +wildcards, +regex, +gnulib_fnmatch, +gnulib_regex, +iconv, +option-directory, +xpath, +json, +interactive, +yaml, +case-insensitive-filenames, +packcc, +optscript, +pcre2
2025-07-09 09:43:39.480+0800 INFO t1 Indexer.prepareIndexer: Scanning for repositories in [/Users/zach/opengrok/src/android-15.0.0_r1] (down to 3 levels below source root)
SLF4J(W): No SLF4J providers were found.
SLF4J(W): Defaulting to no-operation (NOP) logger implementation
SLF4J(W): See https://www.slf4j.org/codes.html#noProviders for further details.
2025-07-09 09:43:42.917+0800 INFO t1 Statistics.logIt: Done scanning for repositories, found 526 repositories (took 3.437 seconds)
...
2025-07-09 09:43:42.984+0800 INFO t1 Statistics.logIt: Done history cache for all repositories (took 65 ms)
2025-07-09 09:43:42.984+0800 INFO t1 Indexer.prepareIndexer: Done generating history cache
2025-07-09 09:43:43.315+0800 INFO t1 Statistics.logIt: Done invalidating repositories (526 valid, 526 working) (took 331 ms)
2025-07-09 09:43:43.350+0800 INFO t1 Indexer.doIndexerExecution: Starting indexing
2025-07-09 09:43:43.362+0800 INFO t1 MemorySegmentIndexInputProvider.<init>: Using MemorySegmentIndexInput with Java 21; to disable start with -Dorg.apache.lucene.store.MMapDirectory.enableMemorySegments=false
2025-07-09 09:43:43.363+0800 WARNING t1 IndexDatabase.initialize: Index in '/Users/zach/opengrok/data/index/android-15.0.0_r1' is dirty, the last indexing was likely interrupted. It might be worthwhile to reindex from scratch.
2025-07-09 09:43:43.680+0800 INFO t72 IndexDatabase.getIndexDownArgs: Starting file collection using file-system traversal for directory '/android-15.0.0_r1'
2025-07-09 09:43:48.925+0800 WARNING t72 IndexDatabase.accept: Could not read '/Users/zach/opengrok/src/android-15.0.0_r1/device/generic/goldfish/fvpbase/sepolicy/hal_drm_clearkey.te'
2025-07-09 09:43:48.925+0800 WARNING t72 IndexDatabase.accept: Could not read '/Users/zach/opengrok/src/android-15.0.0_r1/device/generic/goldfish/fvpbase/sepolicy/hal_neuralnetworks_sample.te'
2025-07-09 09:43:52.364+0800 INFO t72 IndexDatabase.accept: Skipping links to parent...: '/Users/zach/opengrok/src/android-15.0.0_r1/device/google/trout/agl_services_build/yocto-layer/meta-google/recipes-trout/agl-services/files/src/device/google' '/Users/zach/opengrok/src/android-15.0.0_r1/device/google/trout/agl_services_build/yocto-layer/meta-google/recipes-trout/agl-services/files/src/device/google/trout'
2025-07-09 09:43:52.366+0800 WARNING t72 IndexDatabase.accept: Could not read '/Users/zach/opengrok/src/android-15.0.0_r1/device/google/trout/agl_services_build/yocto-layer/meta-google/recipes-trout/images/machine-image/sa81x5/google-overlay/etc/systemd/system/multi-user.target.wants/dumpstate_grpc_server.service'
2025-07-09 09:43:52.366+0800 WARNING t72 IndexDatabase.accept: Could not read '/Users/zach/opengrok/src/android-15.0.0_r1/device/google/trout/agl_services_build/yocto-layer/meta-google/recipes-trout/images/machine-image/sa81x5/google-overlay/etc/systemd/system/multi-user.target.wants/gnss_replay.service'
2025-07-09 09:43:52.366+0800 WARNING t72 IndexDatabase.accept: Could not read '/Users/zach/opengrok/src/android-15.0.0_r1/device/google/trout/agl_services_build/yocto-layer/meta-google/recipes-trout/images/machine-image/sa81x5/google-overlay/etc/systemd/system/multi-user.target.wants/vehicle_hal_grpc_server.service'
2025-07-09 09:43:55.908+0800 INFO t72 IndexDatabase.accept: Skipping links to itself...: '/Users/zach/opengrok/src/android-15.0.0_r1/external/autotest' '/Users/zach/opengrok/src/android-15.0.0_r1/external/autotest/autotest_lib'
2025-07-09 09:43:55.910+0800 INFO t72 IndexDatabase.accept: Skipping links to parent...: '/Users/zach/opengrok/src/android-15.0.0_r1/external/autotest/client/autotest_lib' '/Users/zach/opengrok/src/android-15.0.0_r1/external/autotest/client/autotest_lib/client'
2025-07-09 09:43:56.671+0800 INFO t72 IndexDatabase.accept: Skipping links to parent...: '/Users/zach/opengrok/src/android-15.0.0_r1/external/autotest/venv' '/Users/zach/opengrok/src/android-15.0.0_r1/external/autotest/venv/autotest_lib'
2025-07-09 09:44:19.150+0800 WARNING t72 IndexDatabase.accept: Could not read '/Users/zach/opengrok/src/android-15.0.0_r1/external/iptables/iptables/NOTICE'
2025-07-09 09:44:42.876+0800 WARNING t72 IndexDatabase.accept: Could not read '/Users/zach/opengrok/src/android-15.0.0_r1/external/toolchain-utils/compiler_wrapper/android_llvm_next_flags.go'
2025-07-09 09:44:51.119+0800 WARNING t72 IndexDatabase.accept: Could not read '/Users/zach/opengrok/src/android-15.0.0_r1/frameworks/native/include/private/binder'
2025-07-09 09:44:51.814+0800 WARNING t72 IndexDatabase.accept: Could not read '/Users/zach/opengrok/src/android-15.0.0_r1/frameworks/wilhelm/tools/hashgen/OpenSLES_IID.c'
2025-07-09 09:44:51.815+0800 WARNING t72 IndexDatabase.accept: Could not read '/Users/zach/opengrok/src/android-15.0.0_r1/frameworks/wilhelm/tools/hashgen/interfaces.c'
2025-07-09 09:44:55.123+0800 WARNING t72 IndexDatabase.accept: Could not read '/Users/zach/opengrok/src/android-15.0.0_r1/packages/apps/Calendar/libs/android-support-v4.jar'
2025-07-09 09:44:58.854+0800 WARNING t72 IndexDatabase.accept: Could not read '/Users/zach/opengrok/src/android-15.0.0_r1/packages/apps/ManagedProvisioning/studio-dev/ManagedProvisioningGradleProject/buildSrc/.gradle'
2025-07-09 09:44:58.854+0800 WARNING t72 IndexDatabase.accept: Could not read '/Users/zach/opengrok/src/android-15.0.0_r1/packages/apps/ManagedProvisioning/studio-dev/ManagedProvisioningGradleProject/buildSrc/build'
2025-07-09 09:45:05.783+0800 INFO t72 IndexDatabase.accept: Skipping links to parent...: '/Users/zach/opengrok/src/android-15.0.0_r1/tools/aadevtools/dev/resource/new_codebase/modified_sub_dir/sub_sub_dir' '/Users/zach/opengrok/src/android-15.0.0_r1/tools/aadevtools/dev/resource/new_codebase/modified_sub_dir/sub_sub_dir/relative_symbolic_sub_dir'
2025-07-09 09:45:05.784+0800 INFO t72 IndexDatabase.accept: Skipping links to parent...: '/Users/zach/opengrok/src/android-15.0.0_r1/tools/aadevtools/dev/resource/new_codebase/new_sub_dir/sub_sub_dir' '/Users/zach/opengrok/src/android-15.0.0_r1/tools/aadevtools/dev/resource/new_codebase/new_sub_dir/sub_sub_dir/relative_symbolic_sub_dir'
2025-07-09 09:45:05.784+0800 INFO t72 IndexDatabase.accept: Skipping links to parent...: '/Users/zach/opengrok/src/android-15.0.0_r1/tools/aadevtools/dev/resource/new_codebase/same_sub_dir/sub_sub_dir' '/Users/zach/opengrok/src/android-15.0.0_r1/tools/aadevtools/dev/resource/new_codebase/same_sub_dir/sub_sub_dir/relative_symbolic_sub_dir'
2025-07-09 09:45:05.785+0800 INFO t72 IndexDatabase.accept: Skipping links to parent...: '/Users/zach/opengrok/src/android-15.0.0_r1/tools/aadevtools/dev/resource/old_codebase/modified_sub_dir/sub_sub_dir' '/Users/zach/opengrok/src/android-15.0.0_r1/tools/aadevtools/dev/resource/old_codebase/modified_sub_dir/sub_sub_dir/relative_symbolic_sub_dir'
2025-07-09 09:45:05.786+0800 INFO t72 IndexDatabase.accept: Skipping links to parent...: '/Users/zach/opengrok/src/android-15.0.0_r1/tools/aadevtools/dev/resource/old_codebase/removed_sub_dir/sub_sub_dir' '/Users/zach/opengrok/src/android-15.0.0_r1/tools/aadevtools/dev/resource/old_codebase/removed_sub_dir/sub_sub_dir/relative_symbolic_sub_dir'
2025-07-09 09:45:05.786+0800 INFO t72 IndexDatabase.accept: Skipping links to parent...: '/Users/zach/opengrok/src/android-15.0.0_r1/tools/aadevtools/dev/resource/old_codebase/same_sub_dir/sub_sub_dir' '/Users/zach/opengrok/src/android-15.0.0_r1/tools/aadevtools/dev/resource/old_codebase/same_sub_dir/sub_sub_dir/relative_symbolic_sub_dir'
2025-07-09 09:45:06.441+0800 INFO t72 Statistics.logIt: Done file collection for directory '/android-15.0.0_r1' (took 0:01:22)
2025-07-09 09:45:06.441+0800 INFO t72 IndexDatabase.update: Starting indexing of directory '/android-15.0.0_r1'
2025-07-09 09:45:09.401+0800 WARNING t82 IndexDatabase.lambda$indexParallel$8: ERROR addFile(): '/Users/zach/opengrok/src/android-15.0.0_r1/external/cronet/third_party/icu/source/data/coll/zh.txt'
java.lang.IllegalArgumentException: Document contains at least one immense term in field="full" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped. Please correct the analyzer to not produce such terms. The prefix of the first immense term is: '[-27, -123, -103, -27, -123, -101, -27, -123, -98, -27, -123, -99, -27, -123, -95, -27, -123, -93, -27, -105, -89, -25, -109, -87, -25, -77, -114, -28, -72, -128]...', original message: bytes can be at most 32766 in length; got 39180
at org.apache.lucene.index.IndexingChain$PerField.invertTokenStream(IndexingChain.java:1267)
at org.apache.lucene.index.IndexingChain$PerField.invert(IndexingChain.java:1145)
at org.apache.lucene.index.IndexingChain.processField(IndexingChain.java:697)
at org.apache.lucene.index.IndexingChain.processDocument(IndexingChain.java:576)
at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:243)
at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:421)
at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1551)
at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1836)
at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1476)
at org.opengrok.indexer.index.IndexDatabase.addFile(IndexDatabase.java:1222)
at org.opengrok.indexer.index.IndexDatabase.lambda$indexParallel$8(IndexDatabase.java:1863)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: org.apache.lucene.util.BytesRefHash$MaxBytesLengthExceededException: bytes can be at most 32766 in length; got 39180
at org.apache.lucene.util.BytesRefBlockPool.addBytesRef(BytesRefBlockPool.java:88)
at org.apache.lucene.util.BytesRefHash.add(BytesRefHash.java:289)
at org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:195)
at org.apache.lucene.index.IndexingChain$PerField.invertTokenStream(IndexingChain.java:1249)
... 14 more
2025-07-09 09:45:09.725+0800 WARNING t109 Ctags.lambda$run$0: Error from ctags: ctags: Warning: [SCSS] 1 objects are left on the operand stack: /Users/zach/opengrok/src/android-15.0.0_r1/development/tools/winscope/src/material-theme.scss
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV[thread 37639 also had an error] (0xb)
at pc=0x00000001062d9e7c, pid=92706, tid=65031
#
# JRE version: Java(TM) SE Runtime Environment (21.0.1+12) (build 21.0.1+12-LTS-29)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (21.0.1+12-LTS-29, mixed mode, sharing, tiered, compressed class ptrs, g1 gc, bsd-aarch64)
# Problematic frame:
# [thread 67075 also had an error]
[thread 83203 also had an error]
V [libjvm.dylib+0x3bde7c] frame::sender_for_interpreter_frame(RegisterMap*) const+0xa0
#
# No core dump will be written. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# An error report file with more information is saved as:
# /Users/zach/hs_err_pid92706.log
#
# If you would like to submit a bug report, please visit:
# https://bugreport.java.com/bugreport/crash.jsp
#
[1] 92706 abort java -Xms32g -Djava.util.logging.config.file=opengrok/etc/logging.properties
ctags
Installed by 'brew install universal-ctags'
~ ❯ ctags --version
Universal Ctags 6.2.0, Copyright (C) 2015-2025 Universal Ctags Team
Universal Ctags is derived from Exuberant Ctags.
Exuberant Ctags 5.8, Copyright (C) 1996-2009 Darren Hiebert
Compiled: Jun 12 2025, 22:31:15
URL: https://ctags.io/
Output version: 1.1
Optional compiled features: +wildcards, +regex, +gnulib_fnmatch, +gnulib_regex, +iconv, +option-directory, +xpath, +json, +interactive, +yaml, +case-insensitive-filenames, +packcc, +optscript, +pcre2
Host Info
ProductName: macOS
ProductVersion: 14.1
BuildVersion: 23B2073
Darwin zachs-MacBook-Pro-2024.local 23.1.0 Darwin Kernel Version 23.1.0: Mon Oct 9 21:32:11 PDT 2023; root:xnu-10002.41.9~7/RELEASE_ARM64_T6030 arm64
opengrok
1.14.1