admin管理员组

文章数量:1356215

I get the following error when trying create a stream in KSQL that has a STRUCT as the key:

Key format does not support schema.
format: KAFKA
schema: Persistence{columns=[`topic` STRUCT<`topic` STRING, `ID` INTEGER> KEY], features=[]}
reason: The 'KAFKA' format does not support type 'STRUCT'

The output (from Lenses MQTT Source Connector using ByteArrayConverter):

kcat -C -b broker:29092 -t t10 -f 'Key is %k, and message payload is: %s \n'

Key is Struct{topic=m/bgmdev/af1/t5/test,id=0}, and message payload is: {"val":39}
Key is Struct{topic=m/bgmdev/af1/t5/test,id=0}, and message payload is: {"val":40}

tried creating stream with ksql: Note that topic is reserved word so had to use back ticks:

 CREATE STREAM TEST50 (`topic` STRUCT<`topic` VARCHAR, id INT> KEY, val INT)
  WITH (KAFKA_TOPIC='t10', PARTITIONS=1, VALUE_FORMAT='JSON');

error:

Key format does not support schema.
format: KAFKA
schema: Persistence{columns=[`topic` STRUCT<`topic` STRING, `ID` INTEGER> KEY], features=[]}
reason: The 'KAFKA' format does not support type 'STRUCT'

I followed format from:

/

Create a stream with a struct key in KSQL

Also noticed this from a much previous version:

I also tried to force the KEY format as JSON:

 CREATE STREAM TEST50 (`topic` STRUCT<`topic` VARCHAR, id INT> KEY, val INT)
  WITH (KAFKA_TOPIC='t10', PARTITIONS=1, KEY_FORMAT='JSON', VALUE_FORMAT='JSON');

ksql> describe TEST51;

Name                 : TEST51
 Field | Type
---------------------------------------------------------
 topic | STRUCT<topic VARCHAR(STRING), ID INTEGER> (key)
 VAL   | INTEGER
---------------------------------------------------------

But I don't get any messages coming in and no errors in the logs. Even turned up logging levels. I'm sure I'm doing something wrong with creating the STRUCT.

本文标签：

版权声明：本文标题：ksqldb - The &#39;KAFKA&#39; format does not support type &#39;STRUCT&#39; when trying to create STREAM with STR 内容由网友自发贡献，该文观点仅代表作者本人， 转载请联系作者并注明出处：http://www.betaflare.com/web/1744059169a2583807.html， 本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌抄袭侵权/违法违规的内容，一经查实，本站将立刻删除。