Skip to content

WIP: Adaptive selection of join algorithm #818

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wence- wants to merge 14 commits into
base: main
Choose a base branch
from
Draft

WIP: Adaptive selection of join algorithm #818

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
671cc1a
Estimate adaptive join input sizes
wence- Jan 21, 2026
43fd80b
WIP: add an adaptive join benchmark
wence- Jan 21, 2026
885fc10
Add adaptive_inner_join prototype
wence- Jan 21, 2026
3ee7bd1
Fix bug in early exit of Lineariser when output is shutdown
wence- Jan 21, 2026
93d726c
Work on adaptive join, starting to hook things up
wence- Jan 21, 2026
ca65c71
Implement a replay_channel utility node
wence- Jan 21, 2026
db4a2e2
Implement size-adaptive shuffle or broadcast join
wence- Jan 21, 2026
d69c87e
WIP: broadcast join accepts join side
wence- Jan 21, 2026
45f15e2
Refactor join chunk output assembly
wence- Jan 22, 2026
5f73606
Add send/receive metadata methods to Channel
wence- Jan 22, 2026
697d310
Add ability to shutdown metadata independently of message channel
wence- Jan 22, 2026
7379dd3
Add nodiscard to Channel coroutines
wence- Jan 22, 2026
e500302
Add basic channel tests
wence- Jan 22, 2026
76bdb97
Add more metadata tests of channel
wence- Jan 22, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion cpp/benchmarks/streaming/ndsh/CMakeLists.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ target_link_libraries(
$<TARGET_NAME_IF_EXISTS:conda_env> maybe_asan
)

set(RAPIDSMPFNDSH_QUERIES q01 q03 q09 q21 bench_read)
set(RAPIDSMPFNDSH_QUERIES q01 q03 q09 q21 bench_read adaptive_join)

foreach(query IN ITEMS ${RAPIDSMPFNDSH_QUERIES})
add_executable(${query} "${query}.cpp")
Expand Down
553 changes: 553 additions & 0 deletions cpp/benchmarks/streaming/ndsh/adaptive_join.cpp
View file
Open in desktop

Large diffs are not rendered by default.

Loading