AWS Certified Developer – Associate — Question 303
A company needs an application that consumes logs from Apache HTTP servers at a large scale with near real-time processing. The logs will vary in size from 300 KB to 500 KB. As part of processing, the company needs to convert the logs to JSON format and then upload the logs to an Amazon OpenSearch Service cluster.
Which combination of steps will meet these requirements? (Choose two.)
Answer options
- A. Install the Amazon CloudWatch agent on the Apache HTTP servers. Configure the CloudWatch agent to push the logs to an Amazon Simple Queue Service (Amazon SQS) queue.
- B. Install the Amazon CloudWatch agent on the Apache HTTP servers. Configure the CloudWatch agent to push the logs to the Amazon Kinesis Data Firehose delivery stream.
- C. Install the Amazon Kinesis agent on the Apache HTTP servers. Configure the Kinesis agent to push the logs to the Amazon Kinesis Data Firehose delivery stream.
- D. Create an AWS Lambda function that converts the logs to JSON format and pushes the results to the OpenSearch Service cluster. Consume the logs from the Amazon Simple Queue Service (Amazon SQS) queue by using the Lambda function.
- E. Create an Amazon Kinesis Data Firehose delivery stream. Set the source as Direct PUT. Implement an AWS Lambda function to convert the logs to JSON format. Enable source record transformation on the Kinesis Data Firehose delivery stream for the Lambda function. Set the OpenSearch Service cluster as the destination.
Correct answer: C, E
Explanation
The Amazon Kinesis agent is highly optimized for collecting and streaming log files directly from servers to Amazon Kinesis Data Firehose in near real-time. By configuring Kinesis Data Firehose with Direct PUT as the source, you can utilize built-in source record transformation via an AWS Lambda function to convert the logs to JSON format before delivering them directly to the OpenSearch Service cluster. Using SQS or CloudWatch agents does not provide this seamless, end-to-end streaming and transformation pipeline for this scale.