Google Certified Professional Data Engineer

Sign Up Free or Log In to participate!

Cloud Dataflow

Why cloud dataflow designed using apache beam not Spak. Spark can do the same thing beam can do.

Syntax of beam is also not user friendly …I have not seen client using beam for transformation….Then why GCP ?

1 Answers

Hi! If you’d like to use Spark, you can use Cloud Dataproc. If you’d like to use Beam, you can use Cloud Dataflow. You have all the tools with GCP 🙂 Both systems have different strengths, and Beam and Dataflow are recommended by Google for streaming workloads. Hope this helps!

Sign In
Welcome Back!

Psst…this one if you’ve been moved to ACG!

Get Started
Who’s going to be learning?