Announcing Spark Connect on Amazon EMR on EC2: Interactive PySpark anywhere
Amazon EC2 ยท 2026-09-23
Actions
Technical Details
| Affected Versions | emr-spark-8.0.0 or later |
|---|---|
| Regions | all AWS Regions where Amazon EMR is available, except the AWS GovCloud (US) Regions and the China Regions |
| Cost Impact | Neutral |
What This Means
For DevOps Teams
Update your Amazon EMR on EC2 clusters to emr-spark-8.0.0 or later to enable Spark Connect sessions, allowing developers to interactively develop and debug PySpark code from their local IDEs or SageMaker Studio.
For Platform Teams
Integrate Spark Connect on Amazon EMR on EC2 into your data platform to provide a consistent environment for interactive PySpark development and production-scale data processing, improving collaboration and reducing environment drift.
For Executives
Evaluate Spark Connect on Amazon EMR on EC2 to enhance developer productivity by enabling interactive PySpark development and debugging from local IDEs or SageMaker Studio, reducing time to market for data-driven applications.
Source
Related Amazon EC2 Updates
- Introducing Amazon EC2 T8i instances (2026-09-17)
- New low-cost burstable Amazon EC2 T8i instances are generally available (2026-09-17)
- Amazon ECS extends Amazon S3 Files support to the Amazon EC2 compute type (2026-09-16)
- Amazon EC2 X2idn instances are now available in Asia Pacific (Hong Kong) (2026-09-11)
- Amazon EC2 now supports specifying compatible instance types on AMIs (2026-09-04)