ci: all Linux packages fail to build

[lidavidm]

What happened?

Starting from a few days ago, so I assume this has to do with the recent Arrow release, but it's not clear to me what exactly is failing.

Stack Trace

~/work/arrow-adbc/arrow-adbc/adbc/ci/linux-packages ~/work/arrow-adbc/arrow-adbc
** Invoke apt:test (first_time)
** Execute apt:test
 dists/bookworm/main/binary-amd64: New 52 B 0 files 0 B 0s
 dists/bookworm/main/binary-arm64: New 52 B 0 files 0 B 0s
 pool/bookworm/main: New 32.4 kB 25 files 59.8 MB 3s
 pool/bookworm/main: New 3260 B 2 files 63.5 kB 0s
 pool/bookworm/main:  apache-arrow-adbc has no source override entry
  apache-arrow-adbc has no binary override entry either
 New 5485 B 5 pkgs in 0s
Packages done, Starting contents.
 dists/bookworm/main/Contents-amd64: New 1451 B 50 files 120 MB 3s
 dists/bookworm/main/Contents-arm64: New 147 B 4 files 127 kB 0s
Done. 59.9 MB in 27 archives. Took 6s
rake aborted!
Errno::ENOENT: No such file or directory @ rb_dir_s_empty_p - nonexistent/debian/dists/bookworm (Errno::ENOENT)
/home/runner/work/arrow-adbc/arrow-adbc/arrow/dev/release/binary-task.rb:1582:in 'Dir.empty?'
/home/runner/work/arrow-adbc/arrow-adbc/arrow/dev/release/binary-task.rb:1582:in 'block in BinaryTask#apt_update'
/home/runner/work/arrow-adbc/arrow-adbc/arrow/dev/release/binary-task.rb:1534:in 'Array#each'
/home/runner/work/arrow-adbc/arrow-adbc/arrow/dev/release/binary-task.rb:1534:in 'BinaryTask#apt_update'
/home/runner/work/arrow-adbc/arrow-adbc/arrow/dev/release/binary-task.rb:2361:in 'block (2 levels) in LocalBinaryTask#define_apt_test_task'

How can we reproduce the bug?

No response

Environment/Setup

No response

[lidavidm]

It appears @kou noticed this upstream as well - apache/arrow#47948

So we can wait for apache/arrow#47949

[kou]

Sorry...

[lidavidm]

Thank you for fixing it! 🙂

[kou]

apache/arrow#47949 has been merged. Could you try again?

[lidavidm]

https://github.com/apache/arrow-adbc/actions/runs/18835639055

[kou]

Hmm... There are another problems... I'll take a look at them later...

[lidavidm]

[libprotobuf ERROR google/protobuf/descriptor_database.cc:642] File already exists in database: orc_proto.proto
[libprotobuf FATAL google/protobuf/descriptor.cc:1988] CHECK failed: GeneratedDatabase()->Add(encoded_file_descriptor, size): 
terminate called after throwing an instance of 'google::protobuf::FatalException'
  what():  CHECK failed: GeneratedDatabase()->Add(encoded_file_descriptor, size): 
Aborted (core dumped)

It appears to be loading both arrow 21 and 22

[kou]

Ah, sorry. I forgot to work on this...

We need to rebuild our Docker images for deb/RPM to use the latest Apache Arrow packages.

[kou]

Something like..:

diff --git a/ci/linux-packages/apt/debian-bookworm/Dockerfile b/ci/linux-packages/apt/debian-bookworm/Dockerfile
index ac60132d6..f675c09f4 100644
--- a/ci/linux-packages/apt/debian-bookworm/Dockerfile
+++ b/ci/linux-packages/apt/debian-bookworm/Dockerfile
@@ -18,6 +18,8 @@
 ARG FROM=debian:bookworm
 FROM ${FROM}
 
+ENV IMAGE_VERSION=2025-10-31
+
 RUN \
   echo "debconf debconf/frontend select Noninteractive" | \
     debconf-set-selections

[lidavidm]

Trying in #3658

[kou]

Thanks!!!