admin管理员组

文章数量:1410689

I have a data lake implemented using AWS s3. Bronze and silver layer are implemented, with data in silver layer exposed for access via API and also via jdbc/odbc based sql client.

We have a requirement to drop/hide a field from the consumable Athena table, so far below is the option I've known and related limitations:

Option 1: Drop data for the table from silver layer and reprocess with glue script updated to drop the field

Limitation: costly, need to reprocess huge volume

Athena doesn't support dropping field, and using views every time crawler updates the silver table catalogue gets stale.

Could anyone please suggest whats a proper way handling this?

本文标签： amazon web servicesDrophide fields from s3 based data lake consumable Athena tableStack Overflow

版权声明：本文标题：amazon web services - Drophide fields from s3 based data lake consumable Athena table - Stack Overflow 内容由网友自发贡献，该文观点仅代表作者本人， 转载请联系作者并注明出处：http://www.betaflare.com/web/1744802681a2625957.html， 本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌抄袭侵权/违法违规的内容，一经查实，本站将立刻删除。