azure - Data Factory to Snowflake copy task Fails with Failed to open the database error - Stack Overflow

admin管理员组

文章数量:1322031

We are copying data from an ODBC source to snowflake using azure storage for the staging area. The linked service is a blob linked service using a SAS token. The data sets connect just fine and pull through the meta data for the snowflake connection but when i run the copy I get the following error:

ErrorCode=GenericAdoNetConnectionOpenError,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Failed to open the database connection.,Source=Microsoft.DataTransfer.Connectors.GenericAdoNet,''Type=Apache.Arrow.Adbc.AdbcException,Message=[Snowflake] Post ":443/session/v1/login-request?databaseName=OUR_DB&requestId=0de84404-17f7-4379-7b69-cb4e98a46f50&request_guid=05486636-80a0-4ccc-6172-e55102d87ae8&roleName=snowflake_data_factory_dev_role&warehouse=OUR_WH": context deadline exceeded (Client.Timeout exceeded while awaiting headers),Source=Apache.Arrow.Adbc,'

The weird part is that the datasets connect to Snowflake just fine and are able to pull back the meta data. Calling stored procedures also works just fine. The only thing that doesnt work is the copy task step from azure storage to Snowflake.

Here is the service integration called out and the stage settings.

this was working in our original data factory in a different subscription before we tore it down and recreated it in the new/correct subscription. I dont understand why I can get the meta data just fine but cant connect in the copy.

We are copying data from an ODBC source to snowflake using azure storage for the staging area. The linked service is a blob linked service using a SAS token. The data sets connect just fine and pull through the meta data for the snowflake connection but when i run the copy I get the following error:

ErrorCode=GenericAdoNetConnectionOpenError,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Failed to open the database connection.,Source=Microsoft.DataTransfer.Connectors.GenericAdoNet,''Type=Apache.Arrow.Adbc.AdbcException,Message=[Snowflake] Post "https://OurAccount.snowflakecomputing:443/session/v1/login-request?databaseName=OUR_DB&requestId=0de84404-17f7-4379-7b69-cb4e98a46f50&request_guid=05486636-80a0-4ccc-6172-e55102d87ae8&roleName=snowflake_data_factory_dev_role&warehouse=OUR_WH": context deadline exceeded (Client.Timeout exceeded while awaiting headers),Source=Apache.Arrow.Adbc,'

The weird part is that the datasets connect to Snowflake just fine and are able to pull back the meta data. Calling stored procedures also works just fine. The only thing that doesnt work is the copy task step from azure storage to Snowflake.

Here is the service integration called out and the stage settings.

this was working in our original data factory in a different subscription before we tore it down and recreated it in the new/correct subscription. I dont understand why I can get the meta data just fine but cant connect in the copy.

• azure
• snowflake-cloud-data-platform
• azure-data-factory

Share Improve this question Follow edited Jan 20 at 16:47 lem asked Jan 17 at 20:35 lemlem 11711 silver badge1111 bronze badges 1

• have you paseed correct credentials? – Pratik Lad Commented Jan 20 at 3:24

Add a comment  | 

1 Answer 1

Sorted by: Reset to default 0

The solution was to change the integration runtime of the blob storage account, used to stage the snowflake data, from the self hosted agent used in the source to an azure managed integration runtime.

本文标签： azureData Factory to Snowflake copy task Fails with Failed to open the database errorStack Overflow