It's valuable to know where waste in your applications and infrastructure is occurring, and to have recommendations for how to reduce that waste—but finding waste isn't necessarily fixing the problem.

Check out this conversation between Shashi Raina, AWS Partner Solution Architect, and Kirk Lewis, Pepperdata Senior Solution Architect, as they dispel the first myth of Apache Spark optimization: observability and monitoring.

For more information on cost optimization for Apache Spark on AWS, visit the Pepperdata cloud cost optimization page: https://www.pepperdata.com/cloud-cost-optimization-real-time