HERE Data SDK for Java & Scala Release 2.75.5

Author: heremaps-bot

data-archive/java/avro-example/README.md

@@ -147,11 +147,13 @@ After the application has been configured, you can run it locally by running the
 As the `argument`, you must provide the `-Padd-dependencies-for-local-run` parameter that adds all the dependencies
 needed for a local run of the archiving application.
 
+To run your Flink application locally with Java 17, you should provide `--add-opens=java.base/java.util=ALL-UNNAMED` to the command arguments.
+
 Execute the following command in the [`avro-example`](../avro-example) directory to run the Avro Archiving Application:
 
 ```bash
 mvn compile exec:exec \
--Dexec.args="-cp %classpath com.here.platform.data.archive.example.Main" -Padd-dependencies-for-local-run
+-Dexec.args="--add-opens=java.base/java.util=ALL-UNNAMED -cp %classpath com.here.platform.data.archive.example.Main" -Padd-dependencies-for-local-run
 ```
 
 At a certain point after start, the application pauses and waits for you to ingest data you want to archive.
@@ -445,7 +447,7 @@ Use the [`olp pipeline template create`](https://developer.here.com/documentatio
 
 ```bash
 olp pipeline template create avro-pipeline-template \
-    stream-6.0 \
+    stream-6.1 \
     $PATH_TO_JAR \
     com.here.platform.dal.DALMain \
     --input-catalog-ids=source \
@@ -462,7 +464,7 @@ HERE platform uses pipelines to process data from HERE geospatial resources and
 Use the [`olp pipeline create`](https://developer.here.com/documentation/open-location-platform-cli/user_guide/topics/pipeline/pipeline-commands.html#pipeline-create) command to create a pipeline:
 
 ```bash
-olp pipeline create avro-pipeline --scope $PROJECT_HRN
+olp pipeline create avro-pipeline --email $OLP_EMAIL --scope $PROJECT_HRN
 ```
 
 Save the pipeline ID to the `PIPELINE_ID` variable as you will need it later in this tutorial.

data-archive/java/avro-example/pom.xml

@@ -4,7 +4,7 @@
 
     <groupId>com.here.platform.data.archive</groupId>
     <artifactId>data-archive-avro-example</artifactId>
-    <version>0.0.950</version>
+    <version>0.0.957</version>
     <packaging>jar</packaging>
 
     <!-- Meta information section start -->
@@ -23,17 +23,17 @@
         <connection>scm:git:https://github.com/heremaps/here-workspace-examples-java-scala.git</connection>
         <developerConnection>scm:git:git@github.com:heremaps/here-workspace-examples-java-scala.git</developerConnection>
         <url>https://github.com/heremaps/here-workspace-examples-java-scala</url>
-        <tag>2.74.4</tag>
+        <tag>2.75.5</tag>
     </scm>
 
     <!-- Meta information section end -->
     <properties>
         <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
-        <java.version>1.8</java.version>
+        <java.version>17</java.version>
         <exec.classpathScope>compile</exec.classpathScope>
         <exec.executable>java</exec.executable>
 
-        <sdk-bom.version>2.74.4</sdk-bom.version>
+        <sdk-bom.version>2.75.5</sdk-bom.version>
         <scala.compat.version>2.12</scala.compat.version>
         <artifact.wagon.version>2.0.24</artifact.wagon.version>
 

data-archive/java/parquet-example/README.md

@@ -147,11 +147,13 @@ After the application has been configured, you can run it locally by running the
 As the `argument`, you must provide the `-Padd-dependencies-for-local-run` parameter that adds all the dependencies
 needed for a local run of the archiving application.
 
+To run your Flink application locally with Java 17, you should provide `--add-opens=java.base/java.util=ALL-UNNAMED` to the command arguments.
+
 Execute the following command in the [`parquet-example`](../parquet-example) directory to run the Parquet Archiving Application:
 
 ```bash
 mvn compile exec:exec \
--Dexec.args="-cp %classpath com.here.platform.data.archive.example.Main" -Padd-dependencies-for-local-run
+-Dexec.args="--add-opens=java.base/java.util=ALL-UNNAMED -cp %classpath com.here.platform.data.archive.example.Main" -Padd-dependencies-for-local-run
 ```
 
 At a certain point after start, the application pauses and waits for you to ingest data you want to archive.
@@ -456,7 +458,7 @@ Use the [`olp pipeline template create`](https://developer.here.com/documentatio
 
 ```bash
 olp pipeline template create parquet-pipeline-template \
-    stream-6.0 \
+    stream-6.1 \
     $PATH_TO_JAR \
     com.here.platform.dal.DALMain \
     --input-catalog-ids=source \
@@ -473,7 +475,7 @@ HERE platform uses pipelines to process data from HERE geospatial resources and
 Use the [`olp pipeline create`](https://developer.here.com/documentation/open-location-platform-cli/user_guide/topics/pipeline/pipeline-commands.html#pipeline-create) command to create a pipeline:
 
 ```bash
-olp pipeline create parquet-pipeline --scope $PROJECT_HRN
+olp pipeline create parquet-pipeline --email $OLP_EMAIL --scope $PROJECT_HRN
 ```
 
 Save the pipeline ID to the `PIPELINE_ID` variable as you will need it later in this tutorial.

data-archive/java/parquet-example/pom.xml

@@ -4,7 +4,7 @@
 
     <groupId>com.here.platform.data.archive</groupId>
     <artifactId>data-archive-parquet-example</artifactId>
-    <version>0.0.950</version>
+    <version>0.0.957</version>
     <packaging>jar</packaging>
 
     <!-- Meta information section start -->
@@ -23,17 +23,17 @@
         <connection>scm:git:https://github.com/heremaps/here-workspace-examples-java-scala.git</connection>
         <developerConnection>scm:git:git@github.com:heremaps/here-workspace-examples-java-scala.git</developerConnection>
         <url>https://github.com/heremaps/here-workspace-examples-java-scala</url>
-        <tag>2.74.4</tag>
+        <tag>2.75.5</tag>
     </scm>
 
     <!-- Meta information section end -->
     <properties>
         <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
-        <java.version>1.8</java.version>
+        <java.version>17</java.version>
         <exec.classpathScope>compile</exec.classpathScope>
         <exec.executable>java</exec.executable>
 
-        <sdk-bom.version>2.74.4</sdk-bom.version>
+        <sdk-bom.version>2.75.5</sdk-bom.version>
         <scala.compat.version>2.12</scala.compat.version>
         <artifact.wagon.version>2.0.24</artifact.wagon.version>
 

data-archive/java/sensoris-protobuf-example/README.md

@@ -147,11 +147,13 @@ After the application has been configured, you can run it locally by running the
 As the `argument`, you must provide the `-Padd-dependencies-for-local-run` parameter that adds all the dependencies
 needed for a local run of the archiving application.
 
+To run your Flink application locally with Java 17, you should provide `--add-opens=java.base/java.util=ALL-UNNAMED` to the command arguments.
+
 Execute the following command in the [`sensoris-protobuf-example`](../sensoris-protobuf-example) directory to run the Sensoris Protobuf Archiving Application:
 
 ```bash
 mvn compile exec:exec \
--Dexec.args="-cp %classpath com.here.platform.data.archive.example.Main" -Padd-dependencies-for-local-run
+-Dexec.args="--add-opens=java.base/java.util=ALL-UNNAMED -cp %classpath com.here.platform.data.archive.example.Main" -Padd-dependencies-for-local-run
 ```
 
 At a certain point after start, the application pauses and waits for you to ingest data you want to archive.
@@ -471,7 +473,7 @@ Use the [`olp pipeline template create`](https://developer.here.com/documentatio
 
 ```bash
 olp pipeline template create sensoris-protobuf-pipeline-template \
-    stream-6.0 \
+    stream-6.1 \
     $PATH_TO_JAR \
     com.here.platform.dal.DALMain \
     --input-catalog-ids=source \
@@ -488,7 +490,7 @@ HERE platform uses pipelines to process data from HERE geospatial resources and
 Use the [`olp pipeline create`](https://developer.here.com/documentation/open-location-platform-cli/user_guide/topics/pipeline/pipeline-commands.html#pipeline-create) command to create a pipeline:
 
 ```bash
-olp pipeline create sensoris-protobuf-pipeline --scope $PROJECT_HRN
+olp pipeline create sensoris-protobuf-pipeline --email $OLP_EMAIL --scope $PROJECT_HRN
 ```
 
 Save the pipeline ID to the `PIPELINE_ID` variable as you will need it later in this tutorial.

data-archive/java/sensoris-protobuf-example/pom.xml

@@ -4,7 +4,7 @@
 
     <groupId>com.here.platform.examples</groupId>
     <artifactId>data-archive-sensoris-protobuf-example</artifactId>
-    <version>0.0.950</version>
+    <version>0.0.957</version>
     <packaging>jar</packaging>
 
     <!-- Meta information section -->
@@ -25,18 +25,18 @@
         <connection>scm:git:https://github.com/heremaps/here-workspace-examples-java-scala.git</connection>
         <developerConnection>scm:git:git@github.com:heremaps/here-workspace-examples-java-scala.git</developerConnection>
         <url>https://github.com/heremaps/here-workspace-examples-java-scala</url>
-        <tag>2.74.4</tag>
+        <tag>2.75.5</tag>
     </scm>
 
     <properties>
         <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
-        <java.version>1.8</java.version>
+        <java.version>17</java.version>
         <exec.classpathScope>compile</exec.classpathScope>
         <exec.executable>java</exec.executable>
 
         <artifact.wagon.version>2.0.24</artifact.wagon.version>
 
-        <sdk-bom.version>2.74.4</sdk-bom.version>
+        <sdk-bom.version>2.75.5</sdk-bom.version>
         <scala.compat.version>2.12</scala.compat.version>
 
         <commons-logging.version>1.2</commons-logging.version>

data-processing/java/geometry-lifter/README.md

@@ -32,6 +32,7 @@ In the commands that follow, replace the variable placeholders with the followin
 - `$CATALOG_HRN` is your output catalog's `HRN` (returned by the `olp catalog create` command).
 - `$HRN_PARTITION` is the platform environment you are in. The value should be `here`.
 - `$PROJECT_HRN` is your project's `HRN` (returned by the `olp project create` command).
+- `$OLP_EMAIL` is a single contact e-mail address for the pipeline.
 - `$REALM` The ID of your organization, also called a realm. Consult your platform
   invitation letter to learn your organization ID.
 - `$CATALOG_RIB` is the HRN of the public _HERE Map Content_ catalog in your pipeline configuration ([HERE environment](./config/here/pipeline-config.conf)).
@@ -104,18 +105,34 @@ parameter.
 
 Set the environment variable `$PATH_TO_CONFIG_FOLDER` to [`./config/here`](config/here).
 
+To run your Spark application locally with Java 17, you should provide the following add-opens parameters to the command arguments:
+
+```
+--add-opens=java.base/java.util=ALL-UNNAMED
+--add-opens=java.base/java.lang=ALL-UNNAMED
+--add-opens=java.base/java.lang.invoke=ALL-UNNAMED
+--add-opens=java.base/sun.nio.ch=ALL-UNNAMED
+--add-opens=java.base/java.nio=ALL-UNNAMED
+```
+
 Use all the above settings to run the following command in the [`geometry-lifter`](../geometry-lifter)
 directory to run the Geometry Lifter Compiler.
 
 For the HERE platform environment:
 
 ```bash
-mvn compile exec:java \
--Dexec.mainClass=com.here.platform.data.processing.example.java.geometry.lifter.Main \
--Dpipeline-config.file=./config/here/local-pipeline-config.conf \
--Dpipeline-job.file=./config/here/pipeline-job.conf \
--Dconfig.file=./config/here/local-application.conf \
--Dspark.master=local[*]
+mvn compile exec:exec \
+-Dexec.args="--add-opens=java.base/java.util=ALL-UNNAMED \
+             --add-opens=java.base/java.lang=ALL-UNNAMED \
+             --add-opens=java.base/java.lang.invoke=ALL-UNNAMED \
+             --add-opens=java.base/sun.nio.ch=ALL-UNNAMED \
+             --add-opens=java.base/java.nio=ALL-UNNAMED \
+             -cp %classpath \
+             -Dpipeline-config.file=./config/here/local-pipeline-config.conf \
+             -Dpipeline-job.file=./config/here/pipeline-job.conf \
+             -Dconfig.file=./config/here/local-application.conf \
+             -Dspark.master=local[*] \
+             com.here.platform.data.processing.example.java.geometry.lifter.Main"
 ```
 
 After one run, in the HERE platform environment, you can inspect the local catalog with the OLP CLI:
@@ -255,8 +272,8 @@ partition of HERE Map Content. Make sure you update the layer coverage to reflec
 geographical region.
 
 ```bash
-olp pipeline create $COMPONENT_NAME_Pipeline --scope $PROJECT_HRN
-olp pipeline template create $COMPONENT_NAME_Template batch-4.0 $PATH_TO_JAR \
+olp pipeline create $COMPONENT_NAME_Pipeline --email $OLP_EMAIL --scope $PROJECT_HRN
+olp pipeline template create $COMPONENT_NAME_Template batch-4.1 $PATH_TO_JAR \
                 com.here.platform.data.processing.example.java.geometry.lifter.Main \
                 --workers=4 --worker-units=3 --supervisor-units=2 --input-catalog-ids=rib \
                 --scope $PROJECT_HRN

data-processing/java/geometry-lifter/pom.xml

@@ -4,7 +4,7 @@
 
   <groupId>com.here.platform.data.processing.example.java.geometry.lifter</groupId>
   <artifactId>geometry-lifter</artifactId>
-  <version>0.0.950</version>
+  <version>0.0.957</version>
   <packaging>jar</packaging>
 
   <name>Batch Processor compiler for Geometry Lifter in Java</name>
@@ -23,18 +23,20 @@
     <connection>scm:git:https://github.com/heremaps/here-workspace-examples-java-scala.git</connection>
     <developerConnection>scm:git:git@github.com:heremaps/here-workspace-examples-java-scala.git</developerConnection>
     <url>https://github.com/heremaps/here-workspace-examples-java-scala</url>
-    <tag>2.74.4</tag>
+    <tag>2.75.5</tag>
   </scm>
 
   <properties>
-    <java.version>1.8</java.version>
+    <java.version>17</java.version>
     <maven.compiler.source>${java.version}</maven.compiler.source>
     <maven.compiler.target>${java.version}</maven.compiler.target>
-    <sdk-bom.version>2.74.4</sdk-bom.version>
+    <sdk-bom.version>2.75.5</sdk-bom.version>
     <exec-maven-plugin.version>1.6.0</exec-maven-plugin.version>
     <maven-shade-plugin.version>3.6.0</maven-shade-plugin.version>
     <scala-maven-plugin.version>4.5.4</scala-maven-plugin.version>
     <scala.compat.version>2.12</scala.compat.version>
+    <artifact.wagon.version>2.0.24</artifact.wagon.version>
+    <exec.executable>java</exec.executable>
   </properties>
 
   <dependencyManagement>
@@ -102,6 +104,16 @@
     </dependency>
   </dependencies>
 
+  <repositories>
+    <repository>
+      <id>HERE_PLATFORM_ARTIFACT</id>
+      <layout>here</layout>
+      <!-- The 'here+' prefix serves to invoke the HERE wagon extention that handles OAUTH
+           and re-writes Maven URIs for the HERE secure repository.-->
+      <url>here+artifact-service://artifact-service</url>
+    </repository>
+  </repositories>
+
   <build>
     <plugins>
       <plugin>
@@ -114,6 +126,13 @@
         <version>${exec-maven-plugin.version}</version>
       </plugin>
     </plugins>
+    <extensions>
+      <extension>
+        <groupId>com.here.platform.artifact</groupId>
+        <artifactId>artifact-wagon</artifactId>
+        <version>${artifact.wagon.version}</version>
+      </extension>
+    </extensions>
   </build>
 
   <profiles>

data-processing/java/heremapcontent-difftool/README.md

@@ -40,6 +40,7 @@ In the commands that follow, replace the variable placeholders with the followin
 
 - `$HRN_PARTITION` is the platform environment you are in. The value should be `here`.
 - `$PROJECT_HRN` is your project's `HRN` (returned by the `olp project create` command).
+- `$OLP_EMAIL` is a single contact e-mail address for the pipeline.
 - `$REALM` is the ID of your organization, also called a realm. Consult your platform
   invitation letter to learn your organization ID.
 - `$CATALOG_RIB` is the HRN of the public _HERE Map Content_ catalog in your pipeline configuration ([HERE environment](./config/here/local-pipeline-config.conf).
@@ -132,6 +133,16 @@ parameter.
 
 Set the environment variable `$PATH_TO_CONFIG_FOLDER` to [`./config/here`](config/here).
 
+To run your Spark application locally with Java 17, you should provide the following add-opens parameters to the command arguments:
+
+```
+--add-opens=java.base/java.util=ALL-UNNAMED
+--add-opens=java.base/java.lang=ALL-UNNAMED
+--add-opens=java.base/java.lang.invoke=ALL-UNNAMED
+--add-opens=java.base/sun.nio.ch=ALL-UNNAMED
+--add-opens=java.base/java.nio=ALL-UNNAMED
+```
+
 The first run of the pipeline will use the job configuration [`pipeline-job-first.conf`](config/here/pipeline-job-first.conf). As
 mentioned before, the first run will compute the differences between the catalog version specified
 in [`pipeline-job-first.conf`](config/here/pipeline-job-first.conf) and an empty catalog. That means that all segments contained in the
@@ -141,12 +152,18 @@ input catalog will be considered as newly added segments. Run the following comm
 For the HERE platform environment:
 
 ```bash
-mvn exec:java \
--Dexec.mainClass=com.here.platform.data.processing.example.java.difftool.processor.Main \
--Dpipeline-config.file=./config/here/local-pipeline-config.conf \
--Dpipeline-job.file=./config/here/pipeline-job-first.conf \
--Dconfig.file=./config/here/local-application.conf \
--Dspark.master=local[*]
+mvn compile exec:exec \
+-Dexec.args="--add-opens=java.base/java.util=ALL-UNNAMED \
+             --add-opens=java.base/java.lang=ALL-UNNAMED \
+             --add-opens=java.base/java.lang.invoke=ALL-UNNAMED \
+             --add-opens=java.base/sun.nio.ch=ALL-UNNAMED \
+             --add-opens=java.base/java.nio=ALL-UNNAMED \
+             -cp %classpath \
+             -Dpipeline-config.file=./config/here/local-pipeline-config.conf \
+             -Dpipeline-job.file=./config/here/pipeline-job-first.conf \
+             -Dconfig.file=./config/here/local-application.conf \
+             -Dspark.master=local[*] \
+             com.here.platform.data.processing.example.java.difftool.processor.Main"
 ```
 
 In the second run, we can now compute the differences between the version used in the first run and
@@ -156,12 +173,18 @@ the version specified in [`pipeline-job-second.conf`](config/here/pipeline-job-s
 For the HERE platform environment:
 
 ```bash
-mvn exec:java \
--Dexec.mainClass=com.here.platform.data.processing.example.java.difftool.processor.Main \
--Dpipeline-config.file=./config/here/local-pipeline-config.conf \
--Dpipeline-job.file=./config/here/pipeline-job-second.conf \
--Dconfig.file=./config/here/local-application.conf \
--Dspark.master=local[*]
+mvn compile exec:exec \
+-Dexec.args="--add-opens=java.base/java.util=ALL-UNNAMED \
+             --add-opens=java.base/java.lang=ALL-UNNAMED \
+             --add-opens=java.base/java.lang.invoke=ALL-UNNAMED \
+             --add-opens=java.base/sun.nio.ch=ALL-UNNAMED \
+             --add-opens=java.base/java.nio=ALL-UNNAMED \
+             -cp %classpath \
+             -Dpipeline-config.file=./config/here/local-pipeline-config.conf \
+             -Dpipeline-job.file=./config/here/pipeline-job-second.conf \
+             -Dconfig.file=./config/here/local-application.conf \
+             -Dspark.master=local[*] \
+             com.here.platform.data.processing.example.java.difftool.processor.Main"
 ```
 
 After the second run, in the HERE platform environment you can inspect the local catalog with the OLP CLI:
@@ -310,8 +333,8 @@ partition of HERE Map Content. Make sure you update the layer coverage to reflec
 geographical region.
 
 ```bash
-olp pipeline create $COMPONENT_NAME_Pipeline --scope $PROJECT_HRN
-olp pipeline template create $COMPONENT_NAME_Template batch-4.0 $PATH_TO_JAR \
+olp pipeline create $COMPONENT_NAME_Pipeline --email $OLP_EMAIL --scope $PROJECT_HRN
+olp pipeline template create $COMPONENT_NAME_Template batch-4.1 $PATH_TO_JAR \
                 com.here.platform.data.processing.example.java.difftool.processor.Main \
                 --workers=4 --worker-units=3 --supervisor-units=2 --input-catalog-ids=rib \
                 --scope $PROJECT_HRN