Skip to content

Conversation

jbonofre
Copy link
Member

@jbonofre jbonofre commented Oct 2, 2025

No description provided.

@jbonofre jbonofre changed the title Upgrade to Apache POM 35 and identify fixes needed to have CI happy MINOR: Upgrade to Apache POM 35 and identify fixes needed to have CI happy Oct 2, 2025
@jbonofre
Copy link
Member Author

jbonofre commented Oct 2, 2025

For the JNI Ubuntu, I see this message from archery:

    × python setup.py egg_info did not run successfully.
    │ exit code: 1
    ╰─> [1 lines of output]
        Python < 3.10 is not supported
        [end of output]

Checking for an update.

@lidavidm
Copy link
Member

lidavidm commented Oct 2, 2025

@jbonofre
Copy link
Member Author

jbonofre commented Oct 2, 2025

Yup agree. It's what I gonna try.

jbonofre and others added 2 commits October 7, 2025 06:39
and identify fixes needed to have CI happy
@raulcd
Copy link
Member

raulcd commented Oct 7, 2025

The error with cffi not being available for free-threaded means it's trying to use free-threaded wheels (an python) which is unexpected from what I understand:

        RuntimeError: CFFI does not support the free-threaded build of CPython 3.13. Upgrade to free-threaded 3.14 or newer to use CFFI with the free-threaded build.

Co-authored-by: Sutou Kouhei <kou@cozmixng.org>

This comment has been minimized.

@jbonofre jbonofre added the dependencies Pull requests that update a dependency file label Oct 8, 2025
@github-actions github-actions bot added this to the 18.4.0 milestone Oct 8, 2025
@jbonofre jbonofre mentioned this pull request Oct 10, 2025
@kou
Copy link
Member

kou commented Oct 10, 2025

We need apache/arrow#47749 and

diff --git a/ci/scripts/jni_macos_build.sh b/ci/scripts/jni_macos_build.sh
index f7543b6f..7f927d19 100755
--- a/ci/scripts/jni_macos_build.sh
+++ b/ci/scripts/jni_macos_build.sh
@@ -142,6 +142,7 @@ github_actions_group_begin "Checking shared dependencies for libraries"
 pushd "${dist_dir}"
 archery linking check-dependencies \
   --allow CoreFoundation \
+  --allow Network \
   --allow Security \
   --allow libSystem \
   --allow libarrow_cdata_jni \

for macOS.

@kou
Copy link
Member

kou commented Oct 10, 2025

We need apache/arrow#47746 and

diff --git a/.env b/.env
index d3e1c1d6..a7783537 100644
--- a/.env
+++ b/.env
@@ -40,7 +40,7 @@ ARCH_SHORT=amd64
 
 # Default repository to pull and push images from
 REPO=ghcr.io/apache/arrow-java-dev
-ARROW_REPO=apache/arrow-dev
+ARROW_REPO=ghcr.io/apache/arrow-dev
 
 # The setup attempts to generate coredumps by default, in order to disable the
 # coredump generation set it to 0
@@ -53,5 +53,4 @@ MAVEN=3.9.9
 # Versions for various dependencies used to build artifacts
 # Keep in sync with apache/arrow
 ARROW_REPO_ROOT=./arrow
-PYTHON=3.9
-VCPKG="f7423ee180c4b7f40d43402c2feb3859161ef625" # 2024.06.15 Release
+VCPKG="4334d8b4c8916018600212ab4dd4bbdc343065d1"    # 2025.09.17 Release
diff --git a/ci/docker/vcpkg-jni.dockerfile b/ci/docker/vcpkg-jni.dockerfile
index 55fa35e0..d6bd322a 100644
--- a/ci/docker/vcpkg-jni.dockerfile
+++ b/ci/docker/vcpkg-jni.dockerfile
@@ -18,24 +18,10 @@
 ARG base
 FROM ${base}
 
-# Install the libraries required by Gandiva to run
-# Use enable llvm[enable-rtti] in the vcpkg.json to avoid link problems in Gandiva
-RUN vcpkg install \
-        --clean-after-build \
-        --x-install-root=${VCPKG_ROOT}/installed \
-        --x-manifest-root=/arrow/ci/vcpkg \
-        --x-feature=dev \
-        --x-feature=flight \
-        --x-feature=gcs \
-        --x-feature=json \
-        --x-feature=parquet \
-        --x-feature=gandiva \
-        --x-feature=s3
-
 # Install Java
 # We need Java for JNI headers, but we don't invoke Maven in this build.
 ARG java=11
-RUN yum install -y java-$java-openjdk-devel && yum clean all
+RUN dnf install -y java-$java-openjdk-devel && dnf clean all
 
 # For ci/scripts/{cpp,java}_*.sh
 ENV ARROW_HOME=/tmp/local \
diff --git a/compose.yaml b/compose.yaml
index b125c3c9..f5082a22 100644
--- a/compose.yaml
+++ b/compose.yaml
@@ -99,7 +99,7 @@ services:
       cache_from:
         - ${REPO}:${ARCH}-vcpkg-jni-${VCPKG}
       args:
-        base: ${ARROW_REPO}:${ARCH}-python-${PYTHON}-wheel-manylinux-2014-vcpkg-${VCPKG}
+        base: ${ARROW_REPO}:${ARCH}-cpp-jni-${VCPKG}
     volumes:
       - .:/arrow-java:delegated
       - ${ARROW_REPO_ROOT}:/arrow:delegated

for Linux.

@jbonofre
Copy link
Member Author

I'm fixing the base image here (need to adapt).

@kou
Copy link
Member

kou commented Oct 10, 2025

apache/arrow#47749 was merged and JNI jobs on macOS passed.

@jbonofre
Copy link
Member Author

@kou macos works now thanks. But not Ubuntu yet. I'm investigating.

@kou
Copy link
Member

kou commented Oct 11, 2025

We need apache/arrow#47746 and

It's not merged yet. It's a blocker for Linux.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants