Skip to content
This repository has been archived by the owner on Jan 11, 2021. It is now read-only.

Limit writing row groups based either on size or number of records #165

Open
sadikovi opened this issue Sep 15, 2018 · 0 comments
Open

Limit writing row groups based either on size or number of records #165

sadikovi opened this issue Sep 15, 2018 · 0 comments

Comments

@sadikovi
Copy link
Collaborator

This is derived from #116.

Currently we do not limit row groups size in any way, even though we have options in WriterProperties for it, like max row group size. Parquet-mr and parquet-cpp already handle that, we could borrow the mechanism from either implementation.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

1 participant