Google Certified Professional Data Engineer Set 1 Author: CloudVikas Published Date: 18 June 2021 1 Comment on Google Certified Professional Data Engineer Set 1 Welcome to Google Certified Professional Data Engineer Set 1.Click on Next Button to proceed. 1. What is the best way to grant someone temporary access to a file if they do not have a Google account?Use a signed URL with a specific expiryMake the file publicly accessible but ask the user not to share the linkUse a long and complex name for the bucket and object2. What steps do you need to take to set up BigQuery before use?You must create processing nodes in Compute Engine.BigQuery is a serverless product and all compute and storage resources are managed for you.You must create storage buckets for BigQuery to use.3. True of False: Preemptible workers in a Dataproc cluster cannot store HDFS data.TrueFalse4. A customer wants to run Spark jobs on a low-cost ephemeral Dataproc cluster, utilizing preemptible workers wherever possible, but needs to store the results of Dataproc jobs persistently. What would you recommend?Do not use preemptible workers at all, it will prevent you from choosing any persistent storage option.Use a secondary group of preemptible worker nodes, but add custom code to a job that copies its results to Cloud Storage.Use the Cloud Storage connector, and specify GCS locations for the input and ouput of jobs.5. Which GCP product implements the Apache Beam SDK and is sometimes recommended as an alternative to Dataproc particularly for streaming data?Cloud ComposerCloud DataflowCloud Datalab6. What is the maximum retention duration for a message in Pub/Sub?30 days7 daysNo maximum retention duration7. What is a pipeline in the context of Cloud Dataflow?A pipeline represents the entire series of steps involved in ingesting data, transforming that data and writing output.A pipeline could be any of these.A pipeline represents a collection of data being prepared for transformation.8. Cloud Memorystore is essentially a managed service based on which open-source project?MongoDBRedisMemcached9. What could you consider to improve BigQuery performance for queries that use filters or aggregation against particular columns? Use clustering on non-partitioned tables. Use clustered partitioned tables Use partitioned tables10. When you run a query in BigQuery, what happens to the results?Query results exist only within the BigQuery UI and are not stored in a table.Query results are either written to a destination table specified by the user, or to a temporary cached results table.Query results exist only in BigQuery memory and are not stored in a table.11. Your company stores data in BigQuery for long-term and short-term analytics queries. Most of the jobs only need to study the last 7 days of data. Over time, the cost of queries keeps going up. How can you redesign the database to lower the cost of the most frequent queries?Create a new table every 7 days. Maintain a separate table that duplicates the weekly tables to contain all data.Create a new table every 7 days. Use JOIN statements to conduct long-term analytics queries.Use DATE partitioned tables.12. Which features are not compatible with Dataproc autoscaling?Which features are not compatible with Dataproc autoscaling? (Choose 3) Spark Structured Streaming Preemptible workers High-availability clusters MapReduce tasks HDFS Storage13. You are about to deploy the new version of your application, but you are concerned that it may need to be rolled-back and you want to preserve any Pub/Sub messages it may process in the meantime. What do you do?Create an extra subscription to the Topic to store a back up of all messages.Create a test Topic and roll out application changes against that Topic.Create a snapshot on the Subscription so that you can seek back to this point in time if you need to roll-back the application changes.14. What would be the most secure way to grant access from Dataflow in Project A to a Cloud Storage bucket in Project B?Grant storage viewer access for the bucket in Project B to the default compute service account in Project A.Create a custom service account to use as the Dataflow controller service account in Project A. Grant storage viewer access for the bucket in Project B to the custom service account in Project A.Copy data from the bucket in Project B to a new bucket in Project A.15. After a period of maintenance for your application, you want to start it up again but there is a large backlog of messages waiting in its Subscription to a Pub/Sub topic which you do not want to process. What is the best way to deal with this?Delete the Subscription and re-create it.Seek to a point in the future on the Subscription to effectively discard all the messages.Delete the Topic and re-create it.16. How can you ensure that table modifications in BigQuery are ACID compliant?Add a nominal wait time to any application queries following an update to allow for eventual consistency.Maintain a separate table that records transactions themselves so changes can be re-applied if any are lost.No special accommodations are required, BigQuery table modifications are ACID compliant by design.17. What method could you use to help compute averages when dealing with unbounded/streaming data?Change the input data to be batched/bounded to make it easier to compute averagesSession windowsSliding windows18. Which transformation can be used to process collections of key/value pairs, in a similar fashion to the shuffle phase of a map/shuffle/reduce-style algorithm?GroupByKeyPartitionCoGroupByKey19. You want to use Pub/Sub to distribute jobs to a group of Compute Engine VMs, which should each take the next job from the queue. How should you configure Pub/Sub?Create a new Topic for each individual job. Create multiple Subscriptions for each Topic, one for every Compute Engine VM in the group.Create a new Topic for each individual job. Create a Subscription for each Topic that can be shared by every Compute Engine VM in the group.Create a Topic for jobs. Create a Subscription for this Topic that can be shared by every Compute Engine VM in the group.20. You have multiple systems that all need to be notified of orders being processed. How should you configure Pub/Sub?Create a new Topic for each individual order. Create multiple Subscriptions for each Topic, one for every system that needs to be notified.Create a Topic for orders. Create multiple Subscriptions for this Topic, one for every system that needs to be notified.Create a new Topic for each individual order. Create a Subscription for each Topic that can be shared by every system that needs to be notified.21. A customer needs a JSON document store NoSQL database to help them develop a new application. Which GCP product should they choose?Cloud SQLCloud FirestoreCloud Bigtable22. What storage class would be the most cost effective for data that is only accessed once per month?NearlineLow AvailabilityRegional23. Using Cloud IAM, what is the most granular level for which you can configure access control for Pub/Sub?Across individual topcis and subscriptionsAcross individual topics, but not subscriptionsAcross the entire project, including all topics and subscriptions24. Which primary Apache services does Dataproc run?Which primary Apache services does Dataproc run? (Choose 2) Dataflow Cassandra Spark Hadoop25. How does Bigtable managed the storage of tablets?Tablets are stored on cluster nodes, but storage can dynamically grow as part of the managed serviceTablets are stored on cluster nodes, which must be sized accordingly for their storage needsTablets are stored in Google Colossus, but a cluster node has a limit on how much storage it can process26. Your customer would like to use Dataproc, but the standard image does not contain some additional Spark components required to run their jobs. What would you recommend?Use a Dataproc cluster, but specify an initialization action that installs all of the additional components.Create custom Dataproc image that fulfils the customer requirements and use it to deploy a Dataproc cluster.Create an image that fulfils the customer requirements and use it to deploy a custom Spark cluster using Compute Engine.27. Which native output connectors are supported by Dataproc?Which native output connectors are supported by Dataproc? (Choose 3) BigQuery Cloud Bigtable Cloud Storage Cloud Firestore Cloud SQL28. What is the name given to a dataset that can be acted upon within a Cloud Dataflow pipeline?BucketPCollectionAggregation29. You are required to share a subset of data from a BigQuery data set with a 3rd party analytics team. The data may change over time, and you should not grant unnecessary projects permissions to this team if you can avoid it. How should you proceed?Create an authorized view based on a specific query for the subset of data, and provide access for the team only to that view.Create an export of the data subset to a Cloud Storage bucket. Provide a signed URL for the team to download the data from the bucket.Add the team to your GCP project and assign them the BigQuery Data Viewer IAM role for the data set.30. High Availability for Cloud SQL PostgreSQL instances works because:Instances share a regional replicated persistent diskInstances replicate data directly between themselves for automatic failoverGoogle SREs are on call and can quickly bring up a new instance in the event of a failure31 out of 30Please fill in the comment box below. Email Author: CloudVikas
