Log4J issues when building version 1.20

[urb99Violetipz0dm2f2vBrown]

I can build 1.19.1 with JDK21, but when I try to build version 1.20, I get the following problem

ERROR StatusLogger Unable to load services for service class org.apache.logging.log4j.spi.Provider
 java.lang.NoSuchMethodException: no such method: java.util.ServiceLoader.load(Class,ClassLoader)ServiceLoader/invokeStatic
        at java.base@21.0.6/java.lang.invoke.MemberName.makeAccessException(MemberName.java:915)
        at java.base@21.0.6/java.lang.invoke.MemberName$Factory.resolveOrFail(MemberName.java:994)
        at java.base@21.0.6/java.lang.invoke.MethodHandles$Lookup.resolveOrFail(MethodHandles.java:3750)
        at java.base@21.0.6/java.lang.invoke.MethodHandles$Lookup.findStatic(MethodHandles.java:2675)
        at org.apache.logging.log4j.util.ServiceLoaderUtil.loadClassloaderServices(ServiceLoaderUtil.java:91)
        at org.apache.logging.log4j.util.ServiceLoaderUtil.loadServices(ServiceLoaderUtil.java:74)
        at org.apache.logging.log4j.util.ServiceLoaderUtil.loadServices(ServiceLoaderUtil.java:68)
        at org.apache.logging.log4j.util.ProviderUtil.<init>(ProviderUtil.java:67)
        at org.apache.logging.log4j.util.ProviderUtil.lazyInit(ProviderUtil.java:145)
        at org.apache.logging.log4j.util.ProviderUtil.hasProviders(ProviderUtil.java:129)
        at org.apache.logging.log4j.LogManager.<clinit>(LogManager.java:90)
        at org.apache.logging.slf4j.Log4jLoggerFactory.getContext(Log4jLoggerFactory.java:55)
        at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:47)
        at org.apache.logging.slf4j.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:33)
        at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:358)
        at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:383)
        at com.mojang.logging.LogUtils.getLogger(LogUtils.java:62)
        at net.minecraft.server.Main.<clinit>(SourceFile:65)
        at java.base@21.0.6/java.lang.invoke.DirectMethodHandle.ensureInitialized(DirectMethodHandle.java:288)
        at java.base@21.0.6/java.lang.invoke.DirectMethodHandle.internalMemberNameEnsureInit(DirectMethodHandle.java:336)
Caused by: java.lang.NoSuchMethodError: java.util.ServiceLoader.load(java.lang.Class, java.lang.ClassLoader)
        at org.graalvm.nativeimage.builder/com.oracle.svm.core.methodhandles.Util_java_lang_invoke_MethodHandleNatives.resolve(Target_java_lang_invoke_MethodHandleNatives.java:335)
        at java.base@21.0.6/java.lang.invoke.MethodHandleNatives.resolve(MethodHandleNatives.java:213)
        at java.base@21.0.6/java.lang.invoke.MemberName$Factory.resolve(MemberName.java:962)
        at java.base@21.0.6/java.lang.invoke.MemberName$Factory.resolveOrFail(MemberName.java:991)
        ... 18 more
ERROR StatusLogger Log4j2 could not find a logging implementation. Please add log4j-core to the classpath. Using SimpleLogger to log to the console...
ERROR ahi Failed to load properties from file: server.properties
 java.nio.file.NoSuchFileException: server.properties
        at java.base@21.0.6/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:261)
        at java.base@21.0.6/java.nio.file.Files.newByteChannel(Files.java:379)
        at java.base@21.0.6/java.nio.file.Files.newByteChannel(Files.java:431)
        at java.base@21.0.6/java.nio.file.spi.FileSystemProvider.newInputStream(FileSystemProvider.java:420)
        at java.base@21.0.6/java.nio.file.Files.newInputStream(Files.java:159)
        at ahi.b(SourceFile:62)
        at ahf.a(SourceFile:137)
        at ahg.<init>(SourceFile:12)
        at net.minecraft.server.Main.main(SourceFile:115)
        at java.base@21.0.6/java.lang.invoke.LambdaForm$DMH/sa346b79c.invokeStaticInit(LambdaForm$DMH)

I suspect it's a problem with the json configuration in the configuration folder

Github Actions :

name: Build Native Minecraft Server

on:
  push:
    branches:
      - main
    tags:
      - 'v-*'
  pull_request:
  workflow_dispatch:

jobs:
  build:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v2
        with:
          fetch-depth: 0  

      # Create tag with format v-YYYY-MM-DD if not already running on a tag
      - name: Create tag if not exists
        if: "!startsWith(github.ref, 'refs/tags/')"
        run: |
          TAG_NAME="v-$(date +'%Y-%m-%d')"
          echo "Creating tag $TAG_NAME"
          git config --local user.email "action@github.com"
          git config --local user.name "GitHub Action"
          git tag "$TAG_NAME" || echo "Tag already exists, skipping tag creation"
          git push origin "$TAG_NAME" || echo "Tag already exists remotely, skipping push"
          echo "TAG_NAME=$TAG_NAME" >> $GITHUB_ENV

      - uses: graalvm/setup-graalvm@v1
        with:
          java-version: '21'
          github-token: ${{ secrets.GITHUB_TOKEN }}

      - name: Check build.sh
        shell: bash
        run: shellcheck build.sh

      - name: Build and run native Minecraft server
        shell: bash
        run: |
          ./build.sh

      - name: Upload Build Artifact
        uses: actions/upload-artifact@v4
        with:
          name: minecraft-server
          path: ./native-minecraft-server

      # Extract the tag name if we're running from a tag trigger
      - name: Set tag name from ref
        if: startsWith(github.ref, 'refs/tags/')
        run: echo "TAG_NAME=${GITHUB_REF#refs/tags/}" >> $GITHUB_ENV

      # Create a zip file for the release
      - name: Zip artifact for release
        run: zip -r minecraft-server.zip .
        if: env.TAG_NAME != ''

      # Create a release using the tag
      - name: Create Release
        id: create_release
        uses: softprops/action-gh-release@v1
        if: env.TAG_NAME != ''
        with:
          tag_name: ${{ env.TAG_NAME }}
          name: Release ${{ env.TAG_NAME }}
          draft: false
          prerelease: false
          files: minecraft-server.zip
          token: ${{ secrets.GITHUB_TOKEN }}

build.sh

#!/usr/bin/env bash

set -o errexit
set -o nounset

SERVER_JAR_DL="https://piston-data.mojang.com/v1/objects/8f3112a1049751cc472ec13e397eade5336ca7ae/server.jar"
SCRIPT_DIR=$( cd "$( dirname "${BASH_SOURCE[0]}" )" && pwd )
BUILD_DIR="${SCRIPT_DIR}/build"
JAR_PATH="${BUILD_DIR}/server.jar"
META_INF_PATH="${BUILD_DIR}/META-INF"
BINARY_NAME="native-minecraft-server"
NI_EXEC="${GRAALVM_HOME:-}/bin/native-image"
readonly SERVER_JAR_DL SCRIPT_DIR BUILD_DIR JAR_PATH META_INF_PATH BINARY_NAME NI_EXEC

if [[ -z "${GRAALVM_HOME:-}" ]]; then
    echo "\$GRAALVM_HOME is not set. Please provide a GraalVM installation. Exiting..."
    exit 1
fi

if ! command -v "${NI_EXEC}" &> /dev/null; then
    echo "Installing GraalVM Native Image..."
    "${GRAALVM_HOME}/bin/gu" install --no-progress native-image
fi

if [[ ! -d "${BUILD_DIR}" ]]; then
    mkdir "${BUILD_DIR}"
fi
pushd "${BUILD_DIR}" > /dev/null

if [[ ! -f "${JAR_PATH}" ]]; then
    echo "Downloading Minecraft's server.jar..."
    curl --show-error --fail --location -o "${JAR_PATH}" "${SERVER_JAR_DL}"
fi

if [[ ! -d "${META_INF_PATH}" ]]; then
    echo "Extracting resources from Minecraft's server.jar..."
    unzip -qq "${JAR_PATH}" "META-INF/*" -d "."
fi

if [[ ! -f "${META_INF_PATH}/classpath-joined" ]]; then
    echo "Unable to determine classpath. Exiting..."
    exit 1
fi
CLASSPATH_JOINED=$(cat "${META_INF_PATH}/classpath-joined")
readonly CLASSPATH_JOINED

if [[ ! -f "${META_INF_PATH}/main-class" ]]; then
    echo "Unable to determine main class. Exiting..."
    exit 1
fi
MAIN_CLASS=$(cat "${META_INF_PATH}/main-class")
readonly MAIN_CLASS

pushd "${META_INF_PATH}" > /dev/null
"${NI_EXEC}" --no-fallback \
  -H:ConfigurationFileDirectories="${SCRIPT_DIR}/configuration/" \
  --enable-url-protocols=https \
  --initialize-at-run-time=io.netty,org.apache.logging.log4j \
  -H:+AllowVMInspection \
  --initialize-at-build-time=net.minecraft.util.profiling.jfr.event \
  -H:Name="${BINARY_NAME}" \
  -cp "${CLASSPATH_JOINED//;/:}" \
  "${MAIN_CLASS}"

mv "${BINARY_NAME}" "${SCRIPT_DIR}/${BINARY_NAME}"
popd > /dev/null # Exit $META_INF_PATH
popd > /dev/null # Exit $BUILD_DIR

if command -v upx &> /dev/null; then
    echo "Compressing the native Minecraft server with upx..."
    upx "${SCRIPT_DIR}/${BINARY_NAME}"
fi

echo ""
echo "Done! The native Minecraft server is located at:"
echo "${SCRIPT_DIR}/${BINARY_NAME}"

Also why can't it build on Windows?
The following problems occurred when building 1.18.2 using jdk17 22.0.2 in this project

[22:05:21] [main/INFO]: Environment: authHost='https://authserver.mojang.com', accountsHost='https://api.mojang.com', sessionHost='https://sessionserver.mojang.com', servicesHost='https://api.minecraftservices.com', name='PROD'
[22:05:21] [main/WARN]: Assets URL 'resource:/assets/.mcassetsroot' uses unexpected schema
[22:05:21] [main/WARN]: Assets URL 'resource:/data/.mcassetsroot' uses unexpected schema
Exception in thread "main" [22:05:21] [main/INFO]: [STDERR]: java.lang.UnsatisfiedLinkError: jdk.jfr.internal.JVM.isExcluded(Ljava/lang/Class;)Z [symbol: Java_jdk_jfr_internal_JVM_isExcluded or Java_jdk_jfr_internal_JVM_isExcluded__Ljava_lang_Class_2]
[22:05:21] [main/INFO]: [STDERR]:       at org.graalvm.nativeimage.builder/com.oracle.svm.core.jni.access.JNINativeLinkage.getOrFindEntryPoint(JNINativeLinkage.java:152)
[22:05:21] [main/INFO]: [STDERR]:       at org.graalvm.nativeimage.builder/com.oracle.svm.core.jni.JNIGeneratedMethodSupport.nativeCallAddress(JNIGeneratedMethodSupport.java:54)
[22:05:21] [main/INFO]: [STDERR]:       at jdk.jfr@21.0.6/jdk.jfr.internal.JVM.isExcluded(Native Method)
[22:05:21] [main/INFO]: [STDERR]:       at jdk.jfr@21.0.6/jdk.jfr.internal.MetadataRepository.register(MetadataRepository.java:137)
[22:05:21] [main/INFO]: [STDERR]:       at jdk.jfr@21.0.6/jdk.jfr.internal.MetadataRepository.register(MetadataRepository.java:132)
[22:05:21] [main/INFO]: [STDERR]:       at jdk.jfr@21.0.6/jdk.jfr.FlightRecorder.register(FlightRecorder.java:128)
[22:05:21] [main/INFO]: [STDERR]:       at java.base@21.0.6/java.lang.Iterable.forEach(Iterable.java:75)
[22:05:21] [main/INFO]: [STDERR]:       at atd.<init>(SourceFile:75)
[22:05:21] [main/INFO]: [STDERR]:       at atd.<clinit>(SourceFile:65)
[22:05:21] [main/INFO]: [STDERR]:       at ate.<clinit>(SourceFile:18)
[22:05:21] [main/INFO]: [STDERR]:       at dn.<init>(SourceFile:211)
[22:05:21] [main/INFO]: [STDERR]:       at zc.<init>(SourceFile:43)
[22:05:21] [main/INFO]: [STDERR]:       at zc.a(SourceFile:80)
[22:05:21] [main/INFO]: [STDERR]:       at zk.a(SourceFile:44)
[22:05:21] [main/INFO]: [STDERR]:       at net.minecraft.server.Main.main(SourceFile:155)
[22:05:21] [main/INFO]: [STDERR]:       at java.base@21.0.6/java.lang.invoke.LambdaForm$DMH/sa346b79c.invokeStaticInit(LambdaForm$DMH)

[Coolchickenguy]

The issue is much of the configuration needed that changes per-version (like reflection configuration among other things) is hardwired into /configuration, I made a fork that fixes this issue, and produces working builds for 1.21.11, or basically any modern version. You will need node.js and an online minecraft account to build it though (it has to have a bot join the server to run though all of the code paths).

[fniephaus]

Cool! Could you share a pointer to your fork, @Coolchickenguy?

[Coolchickenguy]

The fork @fniephaus

[urb99Violetipz0dm2f2vBrown]

Version 1.21.11 has now been successfully compiled, including Linux, macOS, and Windows. The program runs, and players successfully enter the game, although the JSON configuration file is still being built manually because the automatically built configuration file in repository of @Coolchickenguy seems to be incomplete.
I've also written a workflow (main.yaml) that can automatically build and upload the release.

My fork

[Coolchickenguy]

My fork builds and works just fine with 1.21.11 on linux at least, it outputs the configuration file into a single file, if that is what you mean by being incomplete, @urb99Violetipz0dm2f2vBrown .
You have a good build config, but why have a separate macos and linux build script, and why comment out upx compression of the executable?

[Coolchickenguy]

And by the way @urb99Violetipz0dm2f2vBrown uploading releases counts as redistributing and is not legal, but nice idea.

[urb99Violetipz0dm2f2vBrown]

When I tried to build the repository on GitHub Actions, the build succeeded but the runtime failed. However, after manually uploading the modified JSON configuration, the build and runtime succeeded.

I used the command java -agentlib:native-image-agent=config-output-dir=./configuration -jar server.jar to generate the configuration file and manually added some missing resources or reflection configurations.

The macOS build process is separate from the Linux build process because there are some differences between Linux and macOS, such as macOS not supporting gc=G1.

The upx command is commented out because the corresponding compressed executable file seems to not run correctly on some systems.

As for uploading and redistributing the image, this is based on the automatic build by GitHub Actions and is only for learning purposes, not for profit. We can simply upload it to the GitHub Actions page without uploading a release.

[Coolchickenguy]

Still not legal, but Microsoft won't care, good point, but for my repository, it works fine for me, but only with --nogui, which is not supported by the original repository either, not sure about yours @urb99Violetipz0dm2f2vBrown . The logs get messy, but still works at least on linux:

coolchickenguy@POTATO:~/Documents/native-minecraft-server$ ./native-minecraft-server
WARNING: A terminally deprecated method in sun.misc.Unsafe has been called
WARNING: sun.misc.Unsafe::objectFieldOffset has been called by org.joml.MemUtil$MemUtilUnsafe (file:/home/coolchickenguy/Documents/native-minecraft-server/native-minecraft-server)
WARNING: Please consider reporting this to the maintainers of class org.joml.MemUtil$MemUtilUnsafe
WARNING: sun.misc.Unsafe::objectFieldOffset will be removed in a future release
[11:15:27] [main/ERROR]: Failed to load properties from file: server.properties
java.nio.file.NoSuchFileException: server.properties
        at java.base@25.0.2/sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.java:213)
        at java.base@25.0.2/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:244)
        at java.base@25.0.2/java.nio.file.Files.newByteChannel(Files.java:357)
        at java.base@25.0.2/java.nio.file.Files.newByteChannel(Files.java:399)
        at java.base@25.0.2/java.nio.file.spi.FileSystemProvider.newInputStream(FileSystemProvider.java:371)
        at java.base@25.0.2/java.nio.file.Files.newInputStream(Files.java:154)
        at asc.b(SourceFile:62)
        at arz.a(SourceFile:154)
        at asa.<init>(SourceFile:12)
        at net.minecraft.server.Main.main(SourceFile:115)
        at java.base@25.0.2/java.lang.invoke.LambdaForm$DMH/sa346b79c.invokeStaticInit(LambdaForm$DMH)
[11:15:27] [main/WARN]: Failed to load eula.txt
[11:15:27] [main/INFO]: You need to agree to the EULA in order to run the server. Go to eula.txt for more info.
chicken@FASTENOUGH:~/Documents/gr/scratch/native-minecraft-server/demo$ ./native-minecraft-server
WARNING: A terminally deprecated method in sun.misc.Unsafe has been called
WARNING: sun.misc.Unsafe::objectFieldOffset has been called by org.joml.MemUtil$MemUtilUnsafe (file:/home/coolchickenguy/Documents/native-minecraft-server/native-minecraft-server)
WARNING: Please consider reporting this to the maintainers of class org.joml.MemUtil$MemUtilUnsafe
WARNING: sun.misc.Unsafe::objectFieldOffset will be removed in a future release
[11:15:36] [main/INFO]: Environment: Environment[sessionHost=https://sessionserver.mojang.com, servicesHost=https://api.minecraftservices.com, profilesHost=https://api.mojang.com, name=PROD]
[11:15:36] [main/WARN]: Assets URL 'resource:/assets/.mcassetsroot' uses unexpected schema
[11:15:36] [main/WARN]: Assets URL 'resource:/data/.mcassetsroot' uses unexpected schema
[11:15:36] [main/INFO]: No existing world data, creating new world
[11:15:36] [main/INFO]: Loaded 1470 recipes
[11:15:36] [main/INFO]: Loaded 1584 advancements
[11:15:36] [main/ERROR]: Failed to start the minecraft server
java.lang.UnsatisfiedLinkError: Can't load library: awt | java.library.path = [/usr/lib64, /lib64, /lib, /usr/lib]
        at org.graalvm.nativeimage.builder/com.oracle.svm.core.jdk.NativeLibraries.loadLibraryRelative(NativeLibraries.java:141)
        at java.base@25.0.2/java.lang.ClassLoader.loadLibrary(ClassLoader.java:135)
        at java.base@25.0.2/java.lang.Runtime.loadLibrary0(Runtime.java:822)
        at java.base@25.0.2/java.lang.System.loadLibrary(System.java:1685)
        at java.desktop@25.0.2/java.awt.Toolkit.loadLibraries(Toolkit.java:1293)
        at java.desktop@25.0.2/java.awt.Toolkit.initStatic(Toolkit.java:1318)
        at java.desktop@25.0.2/java.awt.Toolkit.<clinit>(Toolkit.java:1299)
        at java.desktop@25.0.2/java.awt.Component.<clinit>(Component.java:614)
        at java.base@25.0.2/java.lang.Class.ensureInitialized(DynamicHub.java:778)
        at java.base@25.0.2/java.lang.Class.ensureInitialized(DynamicHub.java:778)
        at java.base@25.0.2/java.lang.Class.ensureInitialized(DynamicHub.java:778)
        at ary.bB(SourceFile:504)
        at net.minecraft.server.Main.a(SourceFile:229)
        at net.minecraft.server.MinecraftServer.a(SourceFile:308)
        at net.minecraft.server.Main.main(SourceFile:220)
        at java.base@25.0.2/java.lang.invoke.LambdaForm$DMH/sa346b79c.invokeStaticInit(LambdaForm$DMH)
coolchickenguy@POTATO:~/Documents/native-minecraft-server$ ./native-minecraft-server --nogui
WARNING: A terminally deprecated method in sun.misc.Unsafe has been called
WARNING: sun.misc.Unsafe::objectFieldOffset has been called by org.joml.MemUtil$MemUtilUnsafe (file:/home/coolchickenguy/Documents/native-minecraft-server/native-minecraft-server)
WARNING: Please consider reporting this to the maintainers of class org.joml.MemUtil$MemUtilUnsafe
WARNING: sun.misc.Unsafe::objectFieldOffset will be removed in a future release
[11:15:42] [main/INFO]: Environment: Environment[sessionHost=https://sessionserver.mojang.com, servicesHost=https://api.minecraftservices.com, profilesHost=https://api.mojang.com, name=PROD]
[11:15:42] [main/WARN]: Assets URL 'resource:/assets/.mcassetsroot' uses unexpected schema
[11:15:42] [main/WARN]: Assets URL 'resource:/data/.mcassetsroot' uses unexpected schema
[11:15:43] [main/INFO]: Loaded 1470 recipes
[11:15:43] [main/INFO]: Loaded 1584 advancements
[11:15:43] [Server thread/INFO]: Starting minecraft server version 1.21.11
[11:15:43] [Server thread/INFO]: Loading properties
[11:15:43] [Server thread/INFO]: Default game type: SURVIVAL
[11:15:43] [Server thread/INFO]: Generating keypair
[11:15:43] [Server thread/INFO]: Starting Minecraft server on *:25565
[11:15:43] [Server thread/INFO]: Preparing level "world"
[11:15:43] [Server thread/INFO]: Selecting global world spawn...
[11:15:44] [Server thread/INFO]: Loading 0 persistent chunks...
[11:15:44] [Server thread/INFO]: Preparing spawn area: 100%
[11:15:44] [Server thread/INFO]: Time elapsed: 1397 ms
[11:15:44] [Server thread/INFO]: Done (1.413s)! For help, type "help"
[11:19:31] [User Authenticator #1/INFO]: UUID of player *************** is ********-****-****-****-************
[11:19:33] [Server thread/INFO]: ***************[/127.0.0.1:48140] logged in with entity id 19 at (29.5, 70.0, -164.5)
[11:19:33] [Server thread/INFO]: *************** joined the game
[11:19:44] [Server thread/INFO]: *************** lost connection: Disconnected
[11:19:44] [Server thread/INFO]: *************** left the game

[urb99Violetipz0dm2f2vBrown]

I understand why I wasn’t able to successfully build your project: I was using the JDK 21 specifications, which use separate JSON configuration files instead of reachability-metadata.json.

We can write our own entry program with a custom main method, inject the --nogui parameter, and even write eula=true to the file before starting the service (although this violates the Mojang EULA). I have actually succeeded in implementing this, but there is currently no function to upload this version.

Additionally, third-party server implementations such as CraftBukkit can also be successfully built, but it is more difficult, because these programs often need to download dependencies when run for the first time, and the entry point is not always exactly the same.

I think the reason it can build successfully on Windows mainly depends on improvements in GraalVM 25, such as resolving issues with JFR. The build also requires more memory, so the macOS build on GitHub Actions fails due to insufficient memory.

In theory, for novice users, the AOT version of the server should have a lower barrier to entry, but it is very difficult to build; however, if one strictly adheres to the protocol, it is impossible to effectively provide tutorials to novice users, especially when implementing the above steps.

[Coolchickenguy]

@urb99Violetipz0dm2f2vBrown good point, this still could be used for a minigame server that needs low startup times for servers, as they don't need to run long, and many must run at a time.

You can get the gui to (somewhat) work, just generate the reflection data without the -nogui flag, then run the built executable like this:

 LD_LIBRARY_PATH="$(realpath .)/build/META-INF:$LD_LIBRARY_PATH" ./native-minecraft-server -Djava.home="$(dirname "$(dirname "$(realpath "$(which java)" )" )")"

That requires a java installation, but most of the files in there are not required.

As you said, this likely won't make creating a minecraft server easier, or even possible for those who don't have much ram. In that case, it does not make any sense to try to get the GUI working.