admin管理员组

文章数量:1125794

Using JDBC sink connector to push events from Kafka topic to Google BigQuery, below is the config

connector.class=io.confluent.connect.jdbc.JdbcSinkConnector
schema.evolution=basic
topics=TEST.EMPLOYEE_DETAILS
tasks.max=1
connection.provider=com.simba.googlebigquery.jdbc42.Driver
connection.url=jdbc:bigquery://:443;XXXXX

Creating the connector giving below error.

[2025-01-09 03:28:38,175] INFO Unable to connect to database on attempt 1/3. Will retry in 10000 ms. (io.confluent.connect.jdbc.util.CachedConnectionProvider)
Caused by: org.apache.kafka.connect.errors.ConnectException: java.sql.SQLException: No suitable driver found for jdbc:bigquery://:443;XXXXX

The jar GoogleBigQueryJDBC42.jar is placed under /usr/share/confluent-hub-components/confluentinc-kafka-connect-jdbc/lib/

Using JDBC sink connector to push events from Kafka topic to Google BigQuery, below is the config

connector.class=io.confluent.connect.jdbc.JdbcSinkConnector
schema.evolution=basic
topics=TEST.EMPLOYEE_DETAILS
tasks.max=1
connection.provider=com.simba.googlebigquery.jdbc42.Driver
connection.url=jdbc:bigquery://https://www.googleapis.com/bigquery/v2:443;XXXXX

Creating the connector giving below error.

[2025-01-09 03:28:38,175] INFO Unable to connect to database on attempt 1/3. Will retry in 10000 ms. (io.confluent.connect.jdbc.util.CachedConnectionProvider)
Caused by: org.apache.kafka.connect.errors.ConnectException: java.sql.SQLException: No suitable driver found for jdbc:bigquery://https://www.googleapis.com/bigquery/v2:443;XXXXX

The jar GoogleBigQueryJDBC42.jar is placed under /usr/share/confluent-hub-components/confluentinc-kafka-connect-jdbc/lib/

  • jdbc
  • google-bigquery
  • debezium-connect
Share Improve this question asked Jan 9 at 3:40 GopiGopi 7121 gold badge8 silver badges19 bronze badges 1
  • Hi @Gopi,I have posted an answer. I hope it will help you. do consider accepting and upvoting if it helps, as per Stack Overflow guidelines, helping more Stack contributors with their research. – Sourav Dutta Commented 4 hours ago
Add a comment  | 

1 Answer 1

Reset to default 0

the error suggest com.simba.googlebigquery.jdbc42.Driver is not properly configured .

you can use the following format jdbc:bigquery://https://www.googleapis.com/bigquery/v2:443;ProjectId=YOUR_PROJECT_ID;DatasetId=YOUR_DATASET_ID and if possible use Use the BigQuery Sink Connector . If you are looking to completely resolve the issue you can raise request in an issue tracker with a complete description of the issue,The Engineering team will look into the issue .

本文标签： JDBC Sink connector in Debezium to set the target as Google BigQueryStack Overflow

版权声明：本文标题：JDBC Sink connector in Debezium to set the target as Google BigQuery - Stack Overflow 内容由网友自发贡献，该文观点仅代表作者本人， 转载请联系作者并注明出处：http://www.betaflare.com/web/1736673996a1947077.html， 本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌抄袭侵权/违法违规的内容，一经查实，本站将立刻删除。