Not a valid partitioner class: io.confluent.connect.hdfs.partitioner.DefaultPartitioner

[anandreddyakidi]

Hi

I am getting below issue while submitting job. Could you please help me on this issue?

{"error_code":400,"message":"Connector configuration is invalid and contains the following 5 error(s):\nNot a valid partitioner class: io.confluent.connect.hdfs.partitioner.DefaultPartitioner\nNot a valid partitioner class: io.confluent.connect.hdfs.partitioner.DefaultPartitioner\nNot a valid partitioner class: io.confluent.connect.hdfs.partitioner.DefaultPartitioner\nNot a valid partitioner class: io.confluent.connect.hdfs.partitioner.DefaultPartitioner\nNot a valid partitioner class: io.confluent.connect.hdfs.partitioner.DefaultPartitioner\nYou can also find the above list of errors at the endpoint /{connectorType}/config/validate"}

My properties looks like below

{
"name": "s3-streamx-test",
"config": {
"connector.class": "com.qubole.streamx.s3.S3SinkConnector",
"tasks.max": "4",
"topics": "event",
"s3.url": "s3://bucket",
"flush.size": "2",
"format.class": "io.confluent.connect.hdfs.parquet.ParquetFormat",
"hadoop.conf.dir": "/opt/streamx/hadoop-conf/",
"name": "s3-streamx-test"
}
}

and hdfs-site.xml
<configuration> <property> <name>fs.s3.impl</name> <value>org.apache.hadoop.fs.s3native.NativeS3FileSystem</value> </property> <property> <name>fs.s3.awsAccessKeyId</name> <value>mykey</value> <property> <name>fs.s3.awsSecretAccessKey</name> value>mysecretkey</value> </property> </configuration>

Regards
Anand.

[Chintanvpatel]

Hello @anandreddyakidi

I was facing the same issue. Confluent team has already fix the issue in kafka-connect-hdfs, confluentinc/kafka-connect-hdfs#150

You can rebuild the package with above fix to make it work.

Hope it helps you :)

[AlexStanovsky]

I am using confluent-5.0.1 and still having this issue, Any idea on how to resolve it ?