Skip to content

chore: Add join benchmarks#4598

Open
coderfender wants to merge 2 commits into
apache:mainfrom
coderfender:add_join_benchmarks
Open

chore: Add join benchmarks#4598
coderfender wants to merge 2 commits into
apache:mainfrom
coderfender:add_join_benchmarks

Conversation

@coderfender
Copy link
Copy Markdown
Contributor

@coderfender coderfender commented Jun 5, 2026 •
edited
Loading

Which issue does this PR close?

We don't currently have benchmarks for just the join implementation. This PR essentially bridges that gap

Closes #.

Rationale for this change

What changes are included in this PR?

How are these changes tested?

@coderfender
Copy link
Copy Markdown
Contributor Author

coderfender commented Jun 5, 2026 

Running benchmark: inner count
  Running case: Spark
  Stopped after 20 iterations, 2043 ms
  Running case: Comet
  Stopped after 34 iterations, 2002 ms

OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 26.3.2
Apple M5 Pro
inner count:                              Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
Spark                                                89            102           9         11.7          85.2       1.0X
Comet                                                51             59           6         20.6          48.5       1.8X

Running benchmark: inner projected
  Running case: Spark
  Stopped after 28 iterations, 2021 ms
  Running case: Comet
  Stopped after 48 iterations, 2029 ms

OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 26.3.2
Apple M5 Pro
inner projected:                          Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
Spark                                                66             72           5         15.9          62.7       1.0X
Comet                                                36             42           3         29.1          34.4       1.8X

Running benchmark: left outer
  Running case: Spark
  Stopped after 27 iterations, 2044 ms
  Running case: Comet
  Stopped after 43 iterations, 2039 ms

OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 26.3.2
Apple M5 Pro
left outer:                               Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
Spark                                                68             76           6         15.4          64.8       1.0X
Comet                                                40             47           4         26.2          38.1       1.7X

Running benchmark: left semi
  Running case: Spark
  Stopped after 26 iterations, 2036 ms
  Running case: Comet
  Stopped after 43 iterations, 2023 ms

OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 26.3.2
Apple M5 Pro
left semi:                                Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
Spark                                                67             78           9         15.8          63.4       1.0X
Comet                                                39             47           5         27.1          36.8       1.7X

Running benchmark: right outer
  Running case: Spark
  Stopped after 8 iterations, 2152 ms
  Running case: Comet
  Stopped after 25 iterations, 2040 ms

OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 26.3.2
Apple M5 Pro
right outer:                              Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
Spark                                               264            269           4          4.0         252.2       1.0X
Comet                                                74             82           4         14.2          70.4       3.6X

@coderfender
Copy link
Copy Markdown
Contributor Author

coderfender commented Jun 5, 2026 

Running benchmark: inner count
  Running case: Spark
  Stopped after 31 iterations, 2038 ms
  Running case: Comet
  Stopped after 70 iterations, 2002 ms

OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 26.3.2
Apple M5 Pro
inner count:                              Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
Spark                                                49             66          16         21.6          46.4       1.0X
Comet                                                26             29           2         40.0          25.0       1.9X

Running benchmark: inner projected
  Running case: Spark
  Stopped after 47 iterations, 2029 ms
  Running case: Comet
  Stopped after 85 iterations, 2003 ms

OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 26.3.2
Apple M5 Pro
inner projected:                          Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
Spark                                                36             43           8         29.0          34.5       1.0X
Comet                                                22             24           1         48.8          20.5       1.7X

Running benchmark: left outer
  Running case: Spark
  Stopped after 45 iterations, 2017 ms
  Running case: Comet
  Stopped after 78 iterations, 2016 ms

OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 26.3.2
Apple M5 Pro
left outer:                               Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
Spark                                                38             45           6         27.2          36.7       1.0X
Comet                                                23             26           2         44.9          22.3       1.6X

Running benchmark: left semi
  Running case: Spark
  Stopped after 45 iterations, 2042 ms
  Running case: Comet
  Stopped after 80 iterations, 2023 ms

OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 26.3.2
Apple M5 Pro
left semi:                                Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
Spark                                                39             45           6         26.8          37.4       1.0X
Comet                                                23             25           3         46.3          21.6       1.7X

Running benchmark: right outer
  Running case: Spark
  Stopped after 14 iterations, 2142 ms
  Running case: Comet
  Stopped after 41 iterations, 2006 ms

OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 26.3.2
Apple M5 Pro
right outer:                              Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
Spark                                               138            153          15          7.6         131.7       1.0X
Comet                                                46             49           4         22.8          43.8       3.0X

@coderfender
Copy link
Copy Markdown
Contributor Author

coderfender commented Jun 5, 2026 

Running benchmark: inner count
  Running case: Spark
  Stopped after 23 iterations, 2040 ms
  Running case: Comet
  Stopped after 40 iterations, 2018 ms

OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 26.3.2
Apple M5 Pro
inner count:                              Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
Spark                                                82             89           5         12.8          78.0       1.0X
Comet                                                47             50           3         22.3          44.8       1.7X

Running benchmark: inner projected
  Running case: Spark
  Stopped after 26 iterations, 2026 ms
  Running case: Comet
  Stopped after 43 iterations, 2002 ms

OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 26.3.2
Apple M5 Pro
inner projected:                          Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
Spark                                                75             78           2         14.0          71.4       1.0X
Comet                                                44             47           3         24.1          41.5       1.7X

Running benchmark: left outer
  Running case: Spark
  Stopped after 23 iterations, 2003 ms
  Running case: Comet
  Stopped after 42 iterations, 2018 ms

OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 26.3.2
Apple M5 Pro
left outer:                               Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
Spark                                                83             87           4         12.6          79.5       1.0X
Comet                                                45             48           3         23.1          43.4       1.8X

Running benchmark: left semi
  Running case: Spark
  Stopped after 25 iterations, 2021 ms
  Running case: Comet
  Stopped after 44 iterations, 2030 ms

OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 26.3.2
Apple M5 Pro
left semi:                                Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
Spark                                                73             81           8         14.4          69.6       1.0X
Comet                                                43             46           3         24.5          40.9       1.7X

Running benchmark: right outer
  Running case: Spark
  Stopped after 27 iterations, 2044 ms
  Running case: Comet
  Stopped after 42 iterations, 2025 ms

OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 26.3.2
Apple M5 Pro
right outer:                              Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
Spark                                                72             76           3         14.6          68.6       1.0X
Comet                                                46             48           3         22.9          43.7       1.6X

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@coderfender