Monitoring and logging Part 3 - Spark History server

You can visit the spark history server from EMR console and look the execution details.

Navigate to the EMR console.

EMR on EKS cloudwatch logs

Click on View logs

EMR on EKS cloudwatch logs

Click on App ID link

EMR on EKS cloudwatch logs

From here you can navigate the spark history server to look at various metrics and details of the job.