admin管理员组

文章数量:1419198

Is there any way to stop or pause an already running optmize on delta table started using

val deltaTable = DeltaTable.forPath(spark, deltaTablePath) 
deltaTable.optimize().executeCompaction()

Is there any way to stop or pause an already running optmize on delta table started using

val deltaTable = DeltaTable.forPath(spark, deltaTablePath) 
deltaTable.optimize().executeCompaction()
  • apache-spark
  • databricks
  • delta
Share Improve this question asked Jan 29 at 8:27 Shailendra KirtikarShailendra Kirtikar 474 bronze badges
Add a comment  | 

1 Answer 1

Reset to default 0

To stop or pause a running OPTIMIZE operation on a Delta table (started via executeCompaction()), there is no direct API in Delta Lake 2.x or earlier. If the OPTIMIZE is running as a Spark job, you can kill the associated Spark job.

本文标签： apache sparkCan we stop or pause already running optimize on delta tableStack Overflow

版权声明：本文标题：apache spark - Can we stop or pause already running optimize on delta table - Stack Overflow 内容由网友自发贡献，该文观点仅代表作者本人， 转载请联系作者并注明出处：http://www.betaflare.com/web/1745304673a2652574.html， 本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌抄袭侵权/违法违规的内容，一经查实，本站将立刻删除。