Why cloud dataflow designed using apache beam not Spak. Spark can do the same thing beam can do.
Syntax of beam is also not user friendly …I have not seen client using beam for transformation….Then why GCP ?
Hi! If you’d like to use Spark, you can use Cloud Dataproc. If you’d like to use Beam, you can use Cloud Dataflow. You have all the tools with GCP 🙂 Both systems have different strengths, and Beam and Dataflow are recommended by Google for streaming workloads. Hope this helps!