[WIP] Add experimental BalancedParquetEngine implementation - #80

Draft

rjzamora wants to merge 8 commits into

NVIDIA-Merlin:mainfrom

rjzamora:balanced-dataset

Commits on May 2, 2022

initial BalancedParquetEngine implementation
rjzamora
committed
6499c29

Commits on May 3, 2022

use fsspec.parquet for remote storage
rjzamora
committed
9514210
align partition sizes with batch_size
rjzamora
committed
9a7ff2c
fix fsspec_parquet bug
rjzamora
committed
e95947a
remove from_map usage from now (its not even merged upstream yet)
rjzamora
committed
6f84530
add basic test coverage
rjzamora
committed
ca473f6
add warning message
rjzamora
committed
60130ec
cover num_workers argument
rjzamora
committed
a0d7e07