Practice Test 4 | Google Cloud Certified Professional Data Engineer | Dumps | Mock Test
Your company is building a multi-cloud data pipeline. Few of the batch jobs will be running on AWS cloud, upon completion of these batches Cloud Dataproc jobs should be triggered. You need to build an orchestration process to support multi-cloud dependencies. Which google cloud product can be used for this purpose?
A. Cloud Scheduler
B. Cloud Composer
C. Apache Airflow
D. Oozie on Cloud Dataproc.
Correct Answer – B
Option A is incorrect. Cloud Schedule is fully managed cron job scheduler. It can virtually schedule any job, including batch, big data jobs. User can run their batch and big data jobs on a recurring schedule to make them more reliable and reduce manual toil.
Option B is correct. Cloud Composer is a fully managed workflow orchestration service that empowers users to schedule and monitor pipelines that span across clouds and on-premises data centres. As cloud composer is built on popular Apache Airflow, it can be used in this scenario to build dependencies from AWS cloud.
Option C is incorrect. Cloud Composer is built on Apache Airflow and is a fully managed workflow orchestration service. It is recommended to use Cloud Composer rather than Apache Airflow.
Option D is incorrect. Using Oozie on Cloud Dataproc does not support multi-cloud dependencies. Also, Cloud composer is a better option in this scenario due to its many benefits and is fully managed.
Comments are closed, but trackbacks and pingbacks are open.