EDIT1:
I read data from csv files, which are stored in a location like: "rawdata/date=2018-05-20/id=32875636/0.csv", filter it (expecting filter to be pushed down to source) and do several transformations on it. I read data from csv files, which are
EDIT1:
I read data from csv files, which are stored in a location like: "rawdata/date=2018-05-20/id=32875636/0.csv", filter it (expecting filter to be pushed down to source) and do several transformations on it. I read data from csv files, which are