kafka connector之sink

1.kafka connector基本架构模型图

topic log

consumer

connector

Kafka connect有两个概念，一个source，另一个是sink。source是把数据从一个系统拷贝到kafka里，sink是从kafka拷贝到另一个系统里

Connectors – the high level abstraction that coordinates data streaming by managing tasks

Tasks – the implementation of how data is copied to or from Kafka

Workers – the running processes that execute connectors and tasks

Converters – the code used to translate data between Connect and the system sending or receiving data

Converters

2.kafka consumer与connector区别

Kafka Connect provides built-in support for parallelism and scalable data copying

每个task在独立线程中启动consumer，不断轮询；

3.connector sink流程图

版权声明：本文来源CSDN，感谢博主原创文章，遵循 CC 4.0 by-sa 版权协议，转载请附上原文出处链接和本声明。
原文链接：https://blog.csdn.net/qnamqj/article/details/53390804
站方申明：本站部分内容来自社区用户分享，若涉及侵权，请联系站方删除。

发表于 2020-06-06 09:38:19
阅读 ( 1459 )
分类：