Available Kafka Connectors and Connector Classes
The default Kafka Connect image shipped with Streaming Data Manager contains the following commonly-used free connectors from Confluent Hub:
- JDBC Connector (Source and Sink)
- HDFS 2 Sink Connector
- ElasticSearch Sink Connector
- Amazon S3 Sink Connector
- Kafka Connect Avro Converter
- Spooldir Source Connector
The available connector classes are:
[
{
"class": "io.confluent.connect.elasticsearch.ElasticsearchSinkConnector",
"type": "sink",
"version": "14.0.2"
},
{
"class": "io.confluent.connect.hdfs.HdfsSinkConnector",
"type": "sink",
"version": "10.1.13"
},
{
"class": "io.confluent.connect.jdbc.JdbcSinkConnector",
"type": "sink",
"version": "10.5.4"
},
{
"class": "io.confluent.connect.s3.S3SinkConnector",
"type": "sink",
"version": "10.2.2"
},
{
"class": "com.github.jcustenborder.kafka.connect.spooldir.SpoolDirAvroSourceConnector",
"type": "source",
"version": "2.0.64"
},
{
"class": "com.github.jcustenborder.kafka.connect.spooldir.SpoolDirBinaryFileSourceConnector",
"type": "source",
"version": "2.0.64"
},
{
"class": "com.github.jcustenborder.kafka.connect.spooldir.SpoolDirCsvSourceConnector",
"type": "source",
"version": "2.0.64"
},
{
"class": "com.github.jcustenborder.kafka.connect.spooldir.SpoolDirJsonSourceConnector",
"type": "source",
"version": "2.0.64"
},
{
"class": "com.github.jcustenborder.kafka.connect.spooldir.SpoolDirLineDelimitedSourceConnector",
"type": "source",
"version": "2.0.64"
},
{
"class": "com.github.jcustenborder.kafka.connect.spooldir.SpoolDirSchemaLessJsonSourceConnector",
"type": "source",
"version": "2.0.64"
},
{
"class": "com.github.jcustenborder.kafka.connect.spooldir.elf.SpoolDirELFSourceConnector",
"type": "source",
"version": "2.0.64"
},
{
"class": "io.confluent.connect.hdfs.tools.SchemaSourceConnector",
"type": "source",
"version": "7.2.2-ccs"
},
{
"class": "io.confluent.connect.jdbc.JdbcSourceConnector",
"type": "source",
"version": "10.5.4"
},
{
"class": "io.confluent.connect.storage.tools.SchemaSourceConnector",
"type": "source",
"version": "7.2.2-ccs"
},
{
"class": "org.apache.kafka.connect.mirror.MirrorCheckpointConnector",
"type": "source",
"version": "7.2.2-ccs"
},
{
"class": "org.apache.kafka.connect.mirror.MirrorHeartbeatConnector",
"type": "source",
"version": "7.2.2-ccs"
},
{
"class": "org.apache.kafka.connect.mirror.MirrorSourceConnector",
"type": "source",
"version": "7.2.2-ccs"
}
]
To add more connectors feel free to edit the Dockerfile our stock image is based on.
To use your own image edit the KafkaConnect
Custom Resource:
apiVersion: kafka.banzaicloud.io/v1beta1
kind: KafkaConnect
spec:
image: # your custom image