Available Kafka Connectors and Connector Classes

The default Kafka Connect image shipped with Streaming Data Manager contains the following commonly-used free connectors from Confluent Hub:

  • JDBC Connector (Source and Sink)
  • HDFS 2 Sink Connector
  • ElasticSearch Sink Connector
  • Amazon S3 Sink Connector
  • Kafka Connect Avro Converter
  • Spooldir Source Connector

The available connector classes are:

[
  {
    "class": "io.confluent.connect.elasticsearch.ElasticsearchSinkConnector",
    "type": "sink",
    "version": "14.0.2"
  },
  {
    "class": "io.confluent.connect.hdfs.HdfsSinkConnector",
    "type": "sink",
    "version": "10.1.13"
  },
  {
    "class": "io.confluent.connect.jdbc.JdbcSinkConnector",
    "type": "sink",
    "version": "10.5.4"
  },
  {
    "class": "io.confluent.connect.s3.S3SinkConnector",
    "type": "sink",
    "version": "10.2.2"
  },
  {
    "class": "com.github.jcustenborder.kafka.connect.spooldir.SpoolDirAvroSourceConnector",
    "type": "source",
    "version": "2.0.64"
  },
  {
    "class": "com.github.jcustenborder.kafka.connect.spooldir.SpoolDirBinaryFileSourceConnector",
    "type": "source",
    "version": "2.0.64"
  },
  {
    "class": "com.github.jcustenborder.kafka.connect.spooldir.SpoolDirCsvSourceConnector",
    "type": "source",
    "version": "2.0.64"
  },
  {
    "class": "com.github.jcustenborder.kafka.connect.spooldir.SpoolDirJsonSourceConnector",
    "type": "source",
    "version": "2.0.64"
  },
  {
    "class": "com.github.jcustenborder.kafka.connect.spooldir.SpoolDirLineDelimitedSourceConnector",
    "type": "source",
    "version": "2.0.64"
  },
  {
    "class": "com.github.jcustenborder.kafka.connect.spooldir.SpoolDirSchemaLessJsonSourceConnector",
    "type": "source",
    "version": "2.0.64"
  },
  {
    "class": "com.github.jcustenborder.kafka.connect.spooldir.elf.SpoolDirELFSourceConnector",
    "type": "source",
    "version": "2.0.64"
  },
  {
    "class": "io.confluent.connect.hdfs.tools.SchemaSourceConnector",
    "type": "source",
    "version": "7.2.2-ccs"
  },
  {
    "class": "io.confluent.connect.jdbc.JdbcSourceConnector",
    "type": "source",
    "version": "10.5.4"
  },
  {
    "class": "io.confluent.connect.storage.tools.SchemaSourceConnector",
    "type": "source",
    "version": "7.2.2-ccs"
  },
  {
    "class": "org.apache.kafka.connect.mirror.MirrorCheckpointConnector",
    "type": "source",
    "version": "7.2.2-ccs"
  },
  {
    "class": "org.apache.kafka.connect.mirror.MirrorHeartbeatConnector",
    "type": "source",
    "version": "7.2.2-ccs"
  },
  {
    "class": "org.apache.kafka.connect.mirror.MirrorSourceConnector",
    "type": "source",
    "version": "7.2.2-ccs"
  }
]

To add more connectors feel free to edit the Dockerfile our stock image is based on. To use your own image edit the KafkaConnect Custom Resource:

apiVersion: kafka.banzaicloud.io/v1beta1
kind: KafkaConnect
spec:
  image: # your custom image