Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(compute): Add pg_duckdb extension v0.2.0 #10350

Open
wants to merge 12 commits into
base: main
Choose a base branch
from
Open

feat(compute): Add pg_duckdb extension v0.2.0 #10350

Changes from 1 commit
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
4056242
feat(compute): Add pg_duckdb extension v0.2.0
ololobus Jan 10, 2025
1ae0ab2
in Neon we don't allow superuser so we need to grant some superuser o…
Bodobolero Jan 16, 2025
3e84dfb
Merge branch 'main' into alexk/add-pg_duckdb
Bodobolero Jan 16, 2025
d6a4896
use correct contrib sql file
Bodobolero Jan 16, 2025
1ffd697
forgot semicolon
Bodobolero Jan 16, 2025
b6c0100
patch for duckdb that allows to install extension httpfs even if disa…
Bodobolero Jan 17, 2025
a6a42c5
fix typo
Bodobolero Jan 17, 2025
0654c03
try to statically link some important duckdb extensions
Bodobolero Jan 19, 2025
7ab4755
remove unneeded tpch extension
Bodobolero Jan 19, 2025
aadbdf1
previous commit caused compile errors
Bodobolero Jan 19, 2025
76a4654
need another patch foro pg_duckdb which has its own cached copy of ht…
Bodobolero Jan 24, 2025
fa2657d
to install extensions we need additional trusted context (use case: S…
Bodobolero Jan 25, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
24 changes: 22 additions & 2 deletions compute/compute-node.Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,11 +34,11 @@ RUN case $DEBIAN_VERSION in \
echo "Unknown Debian version ${DEBIAN_VERSION}" && exit 1 \
;; \
esac && \
apt update && \
apt update && \
apt install --no-install-recommends --no-install-suggests -y \
ninja-build git autoconf automake libtool build-essential bison flex libreadline-dev \
zlib1g-dev libxml2-dev libcurl4-openssl-dev libossp-uuid-dev wget ca-certificates pkg-config libssl-dev \
libicu-dev libxslt1-dev liblz4-dev libzstd-dev zstd \
libicu-dev libxslt1-dev liblz4-dev libzstd-dev zstd g++ \
$VERSION_INSTALLS \
&& apt clean && rm -rf /var/lib/apt/lists/*

Expand Down Expand Up @@ -1176,6 +1176,25 @@ RUN wget https://github.com/Mooncake-Labs/pg_mooncake/releases/download/v0.1.0/p
make install -j $(getconf _NPROCESSORS_ONLN) && \
echo 'trusted = true' >> /usr/local/pgsql/share/extension/pg_mooncake.control

#########################################################################################
#
# Layer "pg-duckdb-pg-build"
# compile pg_duckdb extension
#
#########################################################################################

FROM build-deps AS pg-duckdb-pg-build
ARG PG_VERSION
COPY --from=pg-build /usr/local/pgsql/ /usr/local/pgsql/

ENV PATH="/usr/local/pgsql/bin/:$PATH"

# pg_duckdb build requires source dir to be a git repo to get submodules
RUN git clone --depth 1 --branch v0.2.0 https://github.com/duckdb/pg_duckdb.git pg_duckdb-src && \
cd pg_duckdb-src && \
make install -j $(getconf _NPROCESSORS_ONLN) && \
echo 'trusted = true' >> /usr/local/pgsql/share/extension/pg_duckdb.control

#########################################################################################
#
# Layer "pg_repack"
Expand Down Expand Up @@ -1241,6 +1260,7 @@ COPY --from=pg-ivm-build /usr/local/pgsql/ /usr/local/pgsql/
COPY --from=pg-partman-build /usr/local/pgsql/ /usr/local/pgsql/
COPY --from=pg-mooncake-build /usr/local/pgsql/ /usr/local/pgsql/
COPY --from=pg-repack-build /usr/local/pgsql/ /usr/local/pgsql/
COPY --from=pg-duckdb-pg-build /usr/local/pgsql/ /usr/local/pgsql/
COPY pgxn/ pgxn/

RUN make -j $(getconf _NPROCESSORS_ONLN) \
Expand Down
Loading