azure data factory - ADF_Error when writing output execution details - Stack Overflow

admin管理员组

文章数量:1386656

I have a simple ADF copy activity where source is oracle table and sink is ADLSGen2 Blob container. This pipeline runs without any errors.

I added a new activity to log execution details after the copy activity.

This log activity is set to run on completion of the copy activity. I pretty much followed the script here except for changing reference to copy activity name / /

This is what I m passing in query parameter ''' SELECT '@{pipeline().DataFactory}' as DataFactory_Name,

'@{pipeline().Pipeline}' as Pipeline_Name,

'@{activity('CMIC to ADLS2 Append Folder').output.executionDetails[0].source.type}' as Source_Type, '@{activity('CMIC to ADLS2 Append Folder').output.executionDetails[0].sink.type}' as Sink_Type,

'@{activity('CMIC to ADLS2 Append Folder').output.executionDetails[0].status}' as Execution_Status,

'@{activity('CMIC to ADLS2 Append Folder').output.rowsRead}' as RowsRead,

'@{activity('CMIC to ADLS2 Append Folder').output.rowsCopied}' as RowsWritten '@{activity('CMIC to ADLS2 Append Folder').output.copyDuration}' as CopyDurationInSecs,

'@{activity('CMIC to ADLS2 Append Folder').output.executionDetails[0].start}' as CopyActivity_Start_Time,

'@{utcnow()}' as CopyActivity_End_Time,

'@{pipeline().RunId}' as RunId,

'@{pipeline().TriggerType}' as TriggerType,

'@{pipeline().TriggerName}' as TriggerName,

'@{pipeline().TriggerTime}' as TriggerTime '''

I keep getting this error

Failure happened on 'Source' side. ErrorCode=UserErrorOdbcOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ERROR [HY000] [Microsoft][ODBC Oracle Wire Protocol driver]General error. setStmtType failed ERROR [HY000] [Microsoft][ODBC Oracle Wire Protocol driver]Error in SQL Parser.,Source=Microsoft.DataTransfer.ClientLibrary.Odbc.OdbcConnector,''Type=System.Data.Odbc.OdbcException,Message=ERROR [HY000] [Microsoft][ODBC Oracle Wire Protocol driver]General error. setStmtType failed ERROR [HY000] [Microsoft][ODBC Oracle Wire Protocol driver]Error in SQL Parser.,Source=msora28.dll,'>

I have a simple ADF copy activity where source is oracle table and sink is ADLSGen2 Blob container. This pipeline runs without any errors.

I added a new activity to log execution details after the copy activity.

This log activity is set to run on completion of the copy activity. I pretty much followed the script here except for changing reference to copy activity name https://blogs.perficient/2021/12/08/azure-data-factory-overview/ https://www.mssqltips/sqlservertip/6320/logging-azure-data-factory-pipeline-audit-data/

This is what I m passing in query parameter ''' SELECT '@{pipeline().DataFactory}' as DataFactory_Name,

'@{pipeline().Pipeline}' as Pipeline_Name,

'@{activity('CMIC to ADLS2 Append Folder').output.executionDetails[0].source.type}' as Source_Type, '@{activity('CMIC to ADLS2 Append Folder').output.executionDetails[0].sink.type}' as Sink_Type,

'@{activity('CMIC to ADLS2 Append Folder').output.executionDetails[0].status}' as Execution_Status,

'@{activity('CMIC to ADLS2 Append Folder').output.rowsRead}' as RowsRead,

'@{activity('CMIC to ADLS2 Append Folder').output.rowsCopied}' as RowsWritten '@{activity('CMIC to ADLS2 Append Folder').output.copyDuration}' as CopyDurationInSecs,

'@{activity('CMIC to ADLS2 Append Folder').output.executionDetails[0].start}' as CopyActivity_Start_Time,

'@{utcnow()}' as CopyActivity_End_Time,

'@{pipeline().RunId}' as RunId,

'@{pipeline().TriggerType}' as TriggerType,

'@{pipeline().TriggerName}' as TriggerName,

'@{pipeline().TriggerTime}' as TriggerTime '''

I keep getting this error

Failure happened on 'Source' side. ErrorCode=UserErrorOdbcOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ERROR [HY000] [Microsoft][ODBC Oracle Wire Protocol driver]General error. setStmtType failed ERROR [HY000] [Microsoft][ODBC Oracle Wire Protocol driver]Error in SQL Parser.,Source=Microsoft.DataTransfer.ClientLibrary.Odbc.OdbcConnector,''Type=System.Data.Odbc.OdbcException,Message=ERROR [HY000] [Microsoft][ODBC Oracle Wire Protocol driver]General error. setStmtType failed ERROR [HY000] [Microsoft][ODBC Oracle Wire Protocol driver]Error in SQL Parser.,Source=msora28.dll,'>

• azure-data-factory

Share Improve this question Follow asked Mar 17 at 22:19 Swati VishwanathanSwati Vishwanathan 6199 bronze badges 0

Add a comment  | 

2 Answers 2

Sorted by: Reset to default 0

I have tried the same scenario and its working fine for me.

SELECT '@{pipeline().DataFactory}' as DataFactory_Name,
'@{pipeline().Pipeline}' as Pipeline_Name,
'@{activity('CMIC to ADLS2 Append Folder').output.executionDetails[0].source.type}' as Source_Type, '@{activity('CMIC to ADLS2 Append Folder').output.executionDetails[0].sink.type}' as Sink_Type,
'@{activity('CMIC to ADLS2 Append Folder').output.executionDetails[0].status}' as Execution_Status,
'@{activity('CMIC to ADLS2 Append Folder').output.rowsRead}' as RowsRead,
'@{activity('CMIC to ADLS2 Append Folder').output.rowsCopied}' as RowsWritten, '@{activity('CMIC to ADLS2 Append Folder').output.copyDuration}' as CopyDurationInSecs,
'@{activity('CMIC to ADLS2 Append Folder').output.executionDetails[0].start}' as CopyActivity_Start_Time,
'@{utcnow()}' as CopyActivity_End_Time,
'@{pipeline().RunId}' as RunId,
'@{pipeline().TriggerType}' as TriggerType,
'@{pipeline().TriggerName}' as TriggerName,
'@{pipeline().TriggerTime}' as TriggerTime

Result csv file:

You can cross-check the below things to make it work out.

• Your query has some syntax errors, so once try with my query.
• First, check the query in a lookup activity and if its working, then publish the copy activity pipeline and re-check.
• Also, the above query won't work if first copy activity fails. So, make sure you handle the failure case of the first copy activity as well.

Thanks for your help. This worked after I changed the source dataset; SQL database. I think there is some weird behavior with Oracle database.

The preceding copy activity was against an Oracle database so I kept the log activity against the same source. When I changed the source to a SQL database it worked

本文标签： azure data factoryADFError when writing output execution detailsStack Overflow