apache/spark Docker Image
Apache Spark是由Apache软件基金会开发的开源分布式计算系统，专为大数据处理设计，支持批处理、流处理、机器学习和图计算等多种数据处理模式，通过基于内存的计算引擎显著提升处理速度，具备高效、易用且可扩展的特性，广泛应用于数据科学与大数据分析领域，为用户提供快速、灵活的大数据处理解决方案。
Apache Spark
Apache Spark™ is a multi-language engine for executing data engineering, data science, and machine learning on single-node machines or clusters. It provides high-level APIs in Scala, Java, Python, and R, and an optimized engine that supports general computation graphs for data analysis. It also supports a rich set of higher-level tools including Spark SQL for SQL and DataFrames, pandas API on Spark for pandas workloads, MLlib for machine learning, GraphX for graph processing, and Structured Streaming for stream processing.
https://spark.apache.org/
Online Documentation
You can find the latest Spark documentation, including a programming guide, on the https://spark.apache.org/documentation.html. This README file only contains basic setup instructions.
Interactive Scala Shell
The easiest way to start using Spark is through the Scala shell:
bashdocker run -it apache/spark /opt/spark/bin/spark-shell
Try the following command, which should return 1,000,000,000:
scalascala> spark.range(1000 * 1000 * 1000).count()
Running Spark on Kubernetes
https://spark.apache.org/docs/latest/running-on-kubernetes.html
To run Python on Spark
Use the images on https://hub.docker.com/r/apache/spark-py
To run R on Spark
Use the images on https://hub.docker.com/r/apache/spark-r
镜像拉取方式
您可以使用以下命令拉取该镜像。请将 <标签> 替换为具体的标签版本。如需查看所有可用标签版本，请访问 标签列表页面。
