阅读背景:

SideInputs破坏了DataFlow管道中的数据

来源:互联网 

I have a Dataflow pipeline (SDK 2.1.0, Apache Beam 2.2.0) which simply reads RDF (in N-Triples, so it's just text files) from GCS, transforms it somehow and writes it back to GCS, but in a different bucket. In this pipeline I employ side inputs which are three single files (one file per side input) and use them in a ParDo.I have a Dataflow pipeline (SDK 2.1.0, Apache B




你的当前访问异常,请进行认证后继续阅读剩余内容。

分享到: