Tools/Apache_Spark
Apache Spark
Distributed processing engine for large-scale batch and streaming data — the open-source engine Amazon_EMR runs as a managed service. Self-hosting Spark directly on your own cluster (bare metal, Kubernetes, or any cloud VMs) trades EMR's autoscaling/spot-fleet integration for full control and lower steady-state cost.