Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 12 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ SAP HANA requires that password for DB is provided through url.
Convenience script ```docker-compose/db-plugins-env/saphana-password-server.sh```
provided for this purpose.

Netezza requires VMware Player for running Netezza emulator.
Netezza and Teradata require VMware Player for running emulator.

* [Install Docker Compose](https://docs.docker.com/compose/install/)
* Build local docker images
Expand Down Expand Up @@ -66,6 +66,11 @@ grant all on *.* to 'root'@'%' identified by 'root' with grant option;
* [Install and start Netezza emulator](http://dwgeek.com/install-vmware-player-netezza-emulator.html/)
* Create database `mydb` in Netezza emulator


* [Install and start Teradata Express](https://downloads.teradata.com/download/files/7671/200652/1/B035-5948-018K.pdf)
* Create database `mydb` in Teradata Express
* Create user `test` with password `test` in Teradata Express

### Properties
#### MySQL
* **mysql.host** - Server host. Default: localhost.
Expand Down Expand Up @@ -110,6 +115,12 @@ grant all on *.* to 'root'@'%' identified by 'root' with grant option;
* **memsql.database** - Server namespace for test databases. Default: mydb.
* **memsql.username** - Server username. Default: root.
* **memsql.password** - Server password. Default: root.
#### Teradata
* **teradata.host** - Server host. Default: localhost.
* **teradata.port** - Server port. Default: 1025.
* **teradata.database** - Server namespace for test databases. Default: mydb.
* **teradata.username** - Server username. Default: test.
* **teradata.password** - Server password. Default: test.
#### Aurora MySQL
* **auroraMysql.clusterEndpoint** - Cluster endpoint.
* **auroraMysql.port** - Server port.
Expand Down
4 changes: 2 additions & 2 deletions aurora-mysql-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,12 +20,12 @@
<parent>
<artifactId>database-plugins</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
</parent>

<name>Aurora DB MySQL plugin</name>
<artifactId>aurora-mysql-plugin</artifactId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
<modelVersion>4.0.0</modelVersion>

<dependencies>
Expand Down
4 changes: 2 additions & 2 deletions aurora-postgresql-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,12 +20,12 @@
<parent>
<artifactId>database-plugins</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
</parent>

<name>Aurora DB PostgreSQL plugin</name>
<artifactId>aurora-postgresql-plugin</artifactId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
<modelVersion>4.0.0</modelVersion>

<dependencies>
Expand Down
4 changes: 2 additions & 2 deletions cloudsql-mysql-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,12 +20,12 @@
<parent>
<artifactId>database-plugins</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
</parent>

<name>CloudSQL MySQL plugin</name>
<artifactId>cloudsql-mysql-plugin</artifactId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
<modelVersion>4.0.0</modelVersion>

<dependencies>
Expand Down
6 changes: 3 additions & 3 deletions cloudsql-postgresql-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,12 +20,12 @@
<parent>
<artifactId>database-plugins</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
</parent>

<name>CloudSQL PostgreSQL plugin</name>
<artifactId>cloudsql-postgresql-plugin</artifactId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
<modelVersion>4.0.0</modelVersion>

<dependencies>
Expand All @@ -46,7 +46,7 @@
<dependency>
<groupId>io.cdap.plugin</groupId>
<artifactId>postgresql-plugin</artifactId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
</dependency>
<dependency>
<groupId>io.cdap.cdap</groupId>
Expand Down
2 changes: 1 addition & 1 deletion database-commons/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
<parent>
<artifactId>database-plugins</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
</parent>

<name>Database Commons</name>
Expand Down
4 changes: 2 additions & 2 deletions db2-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,12 +20,12 @@
<parent>
<artifactId>database-plugins</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
</parent>

<name>IBM DB2 plugin</name>
<artifactId>db2-plugin</artifactId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
<modelVersion>4.0.0</modelVersion>

<dependencies>
Expand Down
4 changes: 2 additions & 2 deletions generic-database-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,12 +20,12 @@
<parent>
<artifactId>database-plugins</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
</parent>

<name>Generic database plugin</name>
<artifactId>generic-database-plugin</artifactId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
<modelVersion>4.0.0</modelVersion>

<dependencies>
Expand Down
4 changes: 2 additions & 2 deletions mariadb-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,12 +20,12 @@
<parent>
<artifactId>database-plugins</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
</parent>

<name>Maria DB plugin</name>
<artifactId>mariadb-plugin</artifactId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
<modelVersion>4.0.0</modelVersion>

<dependencies>
Expand Down
4 changes: 2 additions & 2 deletions memsql-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,12 +20,12 @@
<parent>
<artifactId>database-plugins</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
</parent>

<name>Memsql plugin</name>
<artifactId>memsql-plugin</artifactId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
<modelVersion>4.0.0</modelVersion>

<dependencies>
Expand Down
4 changes: 2 additions & 2 deletions mssql-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,12 +20,12 @@
<parent>
<artifactId>database-plugins</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
</parent>

<name>Microsoft SQL Server plugin</name>
<artifactId>mssql-plugin</artifactId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
<modelVersion>4.0.0</modelVersion>

<dependencies>
Expand Down
4 changes: 2 additions & 2 deletions mysql-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,12 +20,12 @@
<parent>
<artifactId>database-plugins</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
</parent>

<name>Mysql plugin</name>
<artifactId>mysql-plugin</artifactId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
<modelVersion>4.0.0</modelVersion>

<dependencies>
Expand Down
4 changes: 2 additions & 2 deletions netezza-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,12 +20,12 @@
<parent>
<artifactId>database-plugins</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
</parent>

<name>Netezza plugin</name>
<artifactId>netezza-plugin</artifactId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
<modelVersion>4.0.0</modelVersion>

<dependencies>
Expand Down
4 changes: 2 additions & 2 deletions oracle-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,12 +20,12 @@
<parent>
<artifactId>database-plugins</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
</parent>

<name>Oracle plugin</name>
<artifactId>oracle-plugin</artifactId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
<modelVersion>4.0.0</modelVersion>

<dependencies>
Expand Down
3 changes: 2 additions & 1 deletion pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@

<groupId>io.cdap.plugin</groupId>
<artifactId>database-plugins</artifactId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
<packaging>pom</packaging>
<name>Database Plugins</name>
<description>Collection of database plugins</description>
Expand All @@ -42,6 +42,7 @@
<module>saphana-plugin</module>
<module>cloudsql-mysql-plugin</module>
<module>cloudsql-postgresql-plugin</module>
<module>teradata-plugin</module>
</modules>

<licenses>
Expand Down
4 changes: 2 additions & 2 deletions postgresql-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,12 +20,12 @@
<parent>
<artifactId>database-plugins</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
</parent>

<name>PostgreSQL plugin</name>
<artifactId>postgresql-plugin</artifactId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
<modelVersion>4.0.0</modelVersion>

<dependencies>
Expand Down
2 changes: 1 addition & 1 deletion saphana-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
<parent>
<artifactId>database-plugins</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.5.0-SNAPSHOT</version>
<version>1.5.0</version>
</parent>

<name>SAP HANA plugin</name>
Expand Down
48 changes: 48 additions & 0 deletions teradata-plugin/docs/Teradata-action.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,48 @@
# Teradata Action


Description
-----------
Action that runs a Teradata command.


Use Case
--------
The action can be used whenever you want to run a Teradata command before or after a data pipeline.
For example, you may want to run a sql update command on a database before the pipeline source pulls data from tables.


Properties
----------
**Driver Name:** Name of the JDBC driver to use.

**Database Command:** Database command to execute.

**Host:** Host that Teradata is running on.

**Port:** Port that Teradata is running on.

**Database:** Teradata database name.

**Username:** User identity for connecting to the specified database.

**Password:** Password to use to connect to the specified database.

**Connection Arguments:** A list of arbitrary string key/value pairs as connection arguments. These arguments
will be passed to the JDBC driver as connection arguments for JDBC drivers that may need additional configurations.

Example
-------
Suppose you want to execute a query against a Teradata database named "prod" that is running on "localhost"
port 1025 (Ensure that the driver for Teradata is installed. You can also provide driver name for some specific driver,
otherwise "teradata" will be used), then configure the plugin with:

```
Driver Name: "teradata"
Database Command: "UPDATE table_name SET price = 20 WHERE ID = 6"
Host: "localhost"
Port: 1025
Database: "prod"
Username: "dbc"
Password: "dbc"
```
Loading