Skip to content

Upgrade Arrow C++ to 20.0.0 #528

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 8 commits into from
Jun 1, 2025
Merged

Conversation

adamreeve
Copy link
Contributor

@adamreeve adamreeve commented May 20, 2025

Fixes #527

@adamreeve adamreeve marked this pull request as ready for review May 23, 2025 04:12
Copy link
Contributor

@marcin-krystianc marcin-krystianc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've spot a few seemingly unnecessary changes, looks good otherwise.

.EnableWritePageIndex()
.DisableWritePageIndex()
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this change necessary?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This was flipping the order of operations so that the end state is different to the new default, to check that these methods have an effect.

@@ -56,7 +56,7 @@ public static void TestPropertiesBuilder()
Assert.AreEqual(789, p.MaxRowGroupLength);
Assert.AreEqual(ParquetVersion.PARQUET_1_0, p.Version);
Assert.AreEqual(666, p.WriteBatchSize);
Assert.True(p.WritePageIndex);
Assert.False(p.WritePageIndex);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this change necessary?

@@ -112,7 +112,7 @@ public static void TestOverrideDefaults()
DefaultWriterProperties.MaxRowGroupLength = 789;
DefaultWriterProperties.Version = ParquetVersion.PARQUET_1_0;
DefaultWriterProperties.WriteBatchSize = 666;
DefaultWriterProperties.WritePageIndex = true;
DefaultWriterProperties.WritePageIndex = false;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this change necessary?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same as above, this is changing the test to set the value to something different to the default, which changed from false to true.

@@ -130,7 +130,7 @@ public static void TestOverrideDefaults()
Assert.AreEqual(789, p.MaxRowGroupLength);
Assert.AreEqual(ParquetVersion.PARQUET_1_0, p.Version);
Assert.AreEqual(666, p.WriteBatchSize);
Assert.True(p.WritePageIndex);
Assert.False(p.WritePageIndex);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this change necessary?

@adamreeve adamreeve merged commit bf5cdfe into G-Research:master Jun 1, 2025
34 checks passed
@adamreeve adamreeve deleted the arrow-20-upgrade branch June 1, 2025 07:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Upgrade C++ Parquet to 20.0.0
3 participants