Practice Test 2 | Google Cloud Certified Professional Data Engineer | Dumps | Mock Test
A company uses Airflow to orchestrate its data pipelines and DAGs (Directed Acyclic Graphs), installed and maintained on-premise by DevOps team. The company wants to migrate the data pipelines managed in Airflow to Google Cloud. The company is looking for a migration method which can make DAGs available and migrated without extra code modifications so the data pipelines can be available once migrated. Which service should you use?
A. App Engine
B. Cloud Function
C. Dataflow
D. Cloud Composer
Answer: D.
Description:
Cloud Composer is a fully managed workflow orchestration service built on Apache Airflow. Cloud composer is built specifically to schedule and monitor workflows and take required actions. You can use Cloud Composer to orchestrate dataflow pipeline and create a custom sensor to detect file’s condition if any changes occurred, then it triggers the dataflow pipeline to run again.
Source(s):
Cloud Composer:
Comments are closed, but trackbacks and pingbacks are open.