2.1.x release versions

Component 2.1.73-debian11/-ubuntu20/-ubuntu20-arm/-rocky8
2024/10/31
2.1.72-debian11/-ubuntu20/-ubuntu20-arm/-rocky8
2024/10/25
2.1.71-debian11/-ubuntu20/-ubuntu20-arm/-rocky8
2024/10/18
2.1.70-debian11/-ubuntu20/-ubuntu20-arm/-rocky8
2024/10/14
2.1.69-debian11/-ubuntu20/-ubuntu20-arm/-rocky8
2024/10/08
Apache Atlas
initialization action
2.2.0 2.2.0 2.2.0 2.2.0 2.2.0
Apache Flink
optional component
1.15.4 1.15.4 1.15.4 1.15.4 1.15.4
Apache Hadoop
installed
3.3.6 3.3.6 3.3.6 3.3.6 3.3.6
Apache Hive
installed
3.1.3 3.1.3 3.1.3 3.1.3 3.1.3
Apache Hive WebHCat
optional component
3.1.3 3.1.3 3.1.3 3.1.3 3.1.3
Apache Hudi
optional component
0.12.3 0.12.3 0.12.3 0.12.3 0.12.3
Apache Kafka
initialization action
3.1.0 3.1.0 3.1.0 3.1.0 3.1.0
Apache Pig
installed
0.18.0-SNAPSHOT 0.18.0-SNAPSHOT 0.18.0-SNAPSHOT 0.18.0-SNAPSHOT 0.18.0-SNAPSHOT
Apache Spark
installed
3.3.2 3.3.2 3.3.2 3.3.2 3.3.2
Apache Sqoop
initialization action
1.5.0-SNAPSHOT 1.5.0-SNAPSHOT 1.5.0-SNAPSHOT 1.5.0-SNAPSHOT 1.5.0-SNAPSHOT
Apache Tez
installed
0.10.2 0.10.2 0.10.2 0.10.2 0.10.2
BigQuery Connector
installed
0.27.1 0.27.1 0.27.1 0.27.1 0.27.1
Cloud Storage Connector
installed
hadoop3-2.2.25 hadoop3-2.2.25 hadoop3-2.2.25 hadoop3-2.2.25 hadoop3-2.2.25
Conscrypt
installed
2.5.2 2.5.2 2.5.2 2.5.2 2.5.2
Docker
optional component
20.10 20.10 20.10 20.10 20.10
Hue
initialization action
4.10.0 4.10.0 4.10.0 4.10.0 4.10.0
Java
installed
11 11 11 11 11
JupyterLab Notebook
optional component
3.4 3.4 3.4 3.4 3.4
Oozie
initialization action
5.2.1 5.2.1 5.2.1 5.2.1 5.2.1
Python
installed
conda 22.9.0 with Python 3.10 conda 22.9.0 with Python 3.10 conda 22.9.0 with Python 3.10 conda 22.9.0 with Python 3.10 conda 22.9.0 with Python 3.10
R
installed
R 4.1 R 4.1 R 4.1 R 4.1 R 4.1
Ranger
optional component
2.2.0 2.2.0 2.2.0 2.2.0 2.2.0
Scala
installed
2.12.18 2.12.18 2.12.18 2.12.18 2.12.18
Solr
optional component
9.0.0 9.0.0 9.0.0 9.0.0 9.0.0
Trino
optional component
376 376 376 376 376
Zeppelin Notebook
optional component
0.10.1 0.10.1 0.10.1 0.10.1 0.10.1
Zookeeper
optional component
3.8.3 3.8.3 3.8.3 3.8.3 3.8.3

Notes:

  1. 2.1.x-*-arm images support only the installed components and the following optional components (the remaining 2.1 optional components and all initialization actions are unsupported):
    • Apache Hive WebHCat
    • Docker
    • Zookeeper (installed in HA clusters; optional component in non-HA clusters)
  2. Apache Hive installations on Dataproc clusters include HCatalog, but do not include Hive WebHCat (see the Hive WebHCat Optional Component to install Hive WebHCat on a cluster).
  3. The Presto Optional Component is available as Trino Optional Component in 2.1 and later image versions.
  4. The HBase and Druid components are not supported in 2.1 and later image versions.
  5. The source code to image 2.1 libraries that are licensed under Reciprocal and Restricted licenses is available at the /usr/local/share/google/dataproc/third-party-sources filepath on Dataproc cluster VMs.