Data-Engineer-Associate Exam Dumps - Amazon Web Services AWS Certified Data Engineer Questions and Answers

The AWS Glue Data Catalog is an Apache Hive metastore-compatible catalog that provides a central metadata repository for various data sources and formats. You can use the AWS Glue Data Catalog as an external Hive metastore for Amazon EMR and Amazon Athena queries, and import metadata from existing Hive metastores into the Data Catalog. This solution requires the least development effort, as you can use AWS Glue crawlers to automatically discover and catalog the metadata from Hive, and use the AWS Glue console, AWS CLI, or Amazon EMR API to configure the Data Catalog as the Hive metastore. The other options are either more complex or require additional steps, such as setting up Apache Ranger for security, managing a Hive metastore on an EMR cluster or an RDS instance, or migrating the metadata manually. References:

Using the AWS Glue Data Catalog as the metastore for Hive (Section: Specifying AWS Glue Data Catalog as the metastore)

Metadata Management: Hive Metastore vs AWS Glue (Section: AWS Glue Data Catalog)

AWS Glue Data Catalog support for Spark SQL jobs (Section: Importing metadata from an existing Hive metastore)

AWS Certified Data Engineer - Associate DEA-C01 Complete Study Guide (Chapter 5, page 131)

AWS Glue DataBrew provides a no-code way to define and run data quality rulesets for data stored in S3. You can trigger profiling jobs via Amazon EventBridge on new uploads for automated checks.

“Use AWS Glue DataBrew to define and run data quality rules on S3 datasets with minimal coding effort. Automate validation by triggering jobs through EventBridge.”

– Ace the AWS Certified Data Engineer - Associate Certification - version 2 - apple.pdf

Option B is the right approach because the requirement is to mask PII in the log destination (the CloudWatch Logs log group). The exam guide explicitly calls out security responsibilities that include “data encryption and masking” and also emphasizes enabling and preparing logs for audit and governance needs. A log-group–level masking mechanism is therefore the most direct control point to prevent sensitive values from being exposed to anyone who can view logs.

Option A (Glue security configuration) is primarily used to apply protections such as encryption settings for Glue jobs and related outputs; it does not inherently solve the problem of masking PII that has already been emitted into application logs. Option C (Macie) is intended to discover and classify sensitive data—most commonly in Amazon S3—and to produce findings; it is not a log-masking control for CloudWatch Logs. The material reinforces Macie as a discovery/classification service for PII rather than a masking mechanism. Option D adds custom code paths in the ETL job and still may miss PII that appears in framework/system logs; it also violates the “least operational effort” spirit compared to applying a centralized log policy.

Therefore, attaching a data protection policy directly to the CloudWatch Logs log group best meets the masking requirement.

Option D is correct because domain units in Amazon SageMaker Unified Studio are specifically designed to organize assets and other domain entities by business unit or team, while also enabling delegated authority to domain unit owners for authorization and governance. AWS states that domain units let selected users within each business unit log in and share assets to the catalog, and that users elsewhere in the enterprise can discover those assets and request access. This directly matches the requirement for isolated control with controlled cross-business-unit sharing upon approval. AWS also documents that Unified Studio supports authentication through AWS IAM Identity Center, which satisfies the need for centralized authentication and identity mapping.

Option A is incorrect because API keys are not the correct authentication model for Unified Studio portal access; AWS documents IAM Identity Center and related identity-provider-based sign-in instead. Option B is wrong because it prevents the required approved sharing. Option C is less suitable because the requirement is to isolate business units within a domain while still enabling governed sharing; separate domains would add more separation than needed and complicate sharing. Therefore, one domain with separate domain units, IAM Identity Center, and access-request-based sharing is the best fit.

AWS Database Migration Service (AWS DMS) is purpose-built to migrate and continuously replicate data from both AWS-hosted and on-premises databases. It supports full-load (existing data) and change data capture (CDC) for ongoing changes, making it the most cost-effective and operationally simple solution in this scenario.

“DMS supports both full-load and continuous replication via CDC. This enables replicating existing and future data from various sources to a data lake in Amazon S3.”

– Ace the AWS Certified Data Engineer - Associate Certification - version 2 - apple.pdf

AWS Glue is not suitable for real-time CDC replication across hybrid environments.

The correct answer is D because Amazon Redshift row-level security provides granular access control over sensitive records by applying security policies at the database object level. This directly supports the requirement to let researchers access only records from their own departments without creating multiple copies of the dataset. Multi-condition SQL predicates are stronger than basic department-only filters because they can include department, role, sensitivity, and authorization logic in the same policy design. Creating separate schemas and views increases administrative overhead and can become inconsistent. Datashares are useful for sharing data but the option creates unnecessary departmental copies and does not solve record-level restriction by itself. Granting EXPLAIN RLS to researchers is also not needed for normal secure access.

Option A is correct because AWS Glue crawlers are the AWS-native service for discovering metadata and updating the AWS Glue Data Catalog. AWS documentation says that crawlers can crawl data stores, infer schema, and upon completion create or update tables in the Data Catalog. For schema-change tracking on an Amazon Redshift table, the crawler can connect through JDBC, inspect the table metadata, and update the Glue Data Catalog on a schedule. This directly satisfies the requirement to implement a cataloging solution that tracks schema changes over time.

Option B is incorrect because AWS DataSync is for data transfer, not metadata cataloging. Option C is also incorrect because AWS SCT is intended for schema conversion and migration assessments, not ongoing catalog synchronization into a Hive metastore for this use case. Option D is not the best answer because the requirement is for an AWS cataloging solution, and the standard managed catalog service here is the AWS Glue Data Catalog, not an external Apache Hive metastore. The daily scheduled crawler against Redshift with Glue Data Catalog updates is the most direct and exam-aligned solution for tracking schema changes.

Option C best matches the requirement of no new code with least operational effort because it keeps the analyst’s work inside the AWS-native, visual ETL experience and produces standardized outputs that data engineers can extend. The study material emphasizes that AWS provides visual data preparation capabilities that let users “clean and normalize data without writing any code,” which is exactly what the analyst needs before advanced engineering transformations begin.

Option A requires Python and Pandas, which directly violates the “does not require writing new code” requirement and introduces dependency management and debugging overhead. Option B uses multiple services (Canvas + Data Wrangler + Glue), which increases the number of moving parts, permissions, handoffs, and operational surface area compared to a single-service preparation approach. Option D offloads the entire preparation step to engineers, which increases operational effort and delays because the analyst cannot directly implement and iterate on standardization.

Using recipe-style transformations in the Glue visual interface aligns with the documented goal of simplifying data preparation workflows while enabling the engineering team to add more complex steps later in the pipeline.

AWS Glue streaming jobs are purpose-built for low-latency, near real-time ETL pipelines.

Glue Studio allows visual job authoring and supports complex transformations, including joins with Amazon RDS databases, through JDBC connectors.

Data can be written directly to S3 in Apache Parquet format using built-in AWS Glue support.

Options B and C are more suitable for batch or development/testing. Option D is for custom batch jobs, not real-time processing.

“You can use AWS Glue streaming jobs with Glue Studio to process streaming data, perform transformations, join with RDS data sources, and write results in formats like Parquet to S3.”