admin管理员组

文章数量:1122832

I want to trigger an Azure DevOps (ADO) pipeline based off of the timestamp of data in Snowflake.

If there is new data, trigger ADO pipeline, else keep monitoring until 12pm and if there is still no new data then trigger the pipeline anyways.

I have a list of dependencies (Snowflake tables) which I want to monitor. When the updated date = today, i.e. there is new data, the condition to trigger the ADO pipeline is met.

So, how can I trigger my pipeline based off of the timestamp in dependant tables and if no new data is present by 12pm, how can I trigger my build to run anyways?

I want to trigger an Azure DevOps (ADO) pipeline based off of the timestamp of data in Snowflake.

If there is new data, trigger ADO pipeline, else keep monitoring until 12pm and if there is still no new data then trigger the pipeline anyways.

I have a list of dependencies (Snowflake tables) which I want to monitor. When the updated date = today, i.e. there is new data, the condition to trigger the ADO pipeline is met.

So, how can I trigger my pipeline based off of the timestamp in dependant tables and if no new data is present by 12pm, how can I trigger my build to run anyways?

  • azure
  • azure-devops
  • snowflake-cloud-data-platform
  • data-engineering
Share Improve this question asked Nov 22, 2024 at 21:17 BShardzBShardz 33 bronze badges
Add a comment  | 

1 Answer 1

Reset to default 0

I want to trigger an Azure DevOps (ADO) pipeline based off of the timestamp of data in Snowflake.

Azure DevOps pipeline can be used for CI-CD and can also be triggered by external services. However, the triggering behavior should be issued by the external service. Snowflake should provide features for monitoring data and sending "events" to the outside service. However, based on my knowledge, Snowflake currently has no such feature.

Based on the current situation, I would suggest you create a function app to periodically check your Snowflake and trigger Azure DevOps pipeline using REST API.

本文标签： Azure DevOps Snowflake AutomationStack Overflow

版权声明：本文标题：Azure DevOps Snowflake Automation - Stack Overflow 内容由网友自发贡献，该文观点仅代表作者本人， 转载请联系作者并注明出处：http://www.betaflare.com/web/1736300810a1930952.html， 本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌抄袭侵权/违法违规的内容，一经查实，本站将立刻删除。