Practice Test 1 | Google Cloud Certified Professional Data Engineer | Dumps | Mock Test
You have several Dataflow pipelines streaming data for transformation and further analysis. At one point of the transformation, there is a need for two pipelines to share data among pipeline instances. You need to modify the architecture to allow data sharing between different pipelines.
How should this requirement be met in Google Cloud?
A. Enable data sharing option when creating Dataflow pipeline.
B. Grant pipeline instances the right IAM roles to access other pipelines instances for data sharing.
C. Use Google Storage to share data with other pipeline instances.
D. Data sharing among Dataflow pipelines is only possible if instances reside in same region.
Answer: C.
There is no Cloud Dataflow-specific cross pipeline communication mechanism for sharing data or processing context between pipelines. You can use durable storage like Cloud Storage or an in-memory cache like App Engine to share data between pipeline instances.
Answer A is incorrect: Dataflow doesn’t have a cross pipeline communication mechanism for sharing data between pipelines.
Answer B is incorrect: This approach is not recommended, if possible. Use Google Storage to share data between pipelines.
Answer D is incorrect: Sharing data is not possible unless using a reliable data storage such as Google Storage.
Source(s):
Dataflow – FAQ: https://cloud.google.com/dataflow/docs/resources/faq
Comments are closed, but trackbacks and pingbacks are open.