admin管理员组文章数量:1387304
I want to validate the schema of a .parquet file against a defined AVRO schema file. I am able to fetch the schema of .parquet file using pyarrow.parquet.ParquetFile but I am not sure what's the best way to validate this schema against the defined schema in .avsc file.
from pyarrow.parquet import ParquetFile
ParquetFile(source).schema_arrow
I am able to fetch the schema of .parquet file using pyarrow.parquet.ParquetFile but I am not sure what's the best way to validate this schema against the defined schema in .avsc file.
本文标签: How to validate the schema of a parquet against AVRO (avsc) schema using PythonStack Overflow
版权声明:本文标题:How to validate the schema of a .parquet against AVRO (.avsc) schema using Python - Stack Overflow 内容由网友自发贡献,该文观点仅代表作者本人, 转载请联系作者并注明出处:http://www.betaflare.com/web/1744520208a2610410.html, 本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌抄袭侵权/违法违规的内容,一经查实,本站将立刻删除。
发表评论