Practice Test 3 | Google Cloud Certified Professional Data Engineer | Dumps | Mock Test
A multinational company has multiple Google Cloud projects used by tech teams residing in different countries around the world. Each project is designed to perform data ingestion, storage, processing, cleansing, and transformation based on the country’s data such as currency and language. Dataflow pipelines are built to perform ETL/ELT processing for every project.
However, for a certain need, it was required for more than one pipeline to share the same data source while each pipeline does a part of processing implemented by different tech teams. To mitigate this issue, both pipelines should be able to share data among their different phases. Which of the following would help to achieve this?
A. Grant pipeline instances the right IAM roles to access other pipelines instances for data sharing.
B. If Dataflow instances reside in the same region, data sharing among pipelines is possible. Otherwise, a storage option should be considered.
C. Enable data sharing option while creating Dataflow pipelines.
D. Use Google Storage to share data with other pipeline instances.
Correct Answer: D
There is no Cloud Dataflow-specific cross pipeline communication mechanism for sharing data or processing context between pipelines. You can use durable storage like Cloud Storage or an in-memory cache like App Engine to share data between pipeline instances.
Option A is incorrect: This approach is not recommended. Use Google Storage to share data between pipelines.
Option B is incorrect: Sharing data is not possible unless using a reliable data storage such as Google Storage.
Option C is incorrect: Dataflow doesn’t have a cross pipeline communication mechanism for sharing data between pipelines.
Source(s):
Dataflow – FAQ:
Comments are closed, but trackbacks and pingbacks are open.