admin管理员组文章数量:1356554
It was working well before adding the following change in the spark driver pod yaml specification to make driver pod use a PVC backed by externally provisioned storage for spilling files to a custom path:
spec:
containers:
env:
- name: SPARK_LOCAL_DIRS
value: /ephemeral
volumeMounts:
- name: spark-local-dir-1
mountPath: /ephemeral
volumes:
- name: spark-local-dir-1
persistentVolumeClaim:
claimName: shared-persistence
Then the pod gets stuck at ContainerCreating state and there aren't any events or errors in kubectl describe pod
. PVC shared-persistence
is bound.
One potential reason I can think of is that we also have ephemeral-storage definitions in the resources section:
containers:
- resources:
limits:
cpu: '1'
ephemeral-storage: 4Gi
memory: 2457Mi
requests:
cpu: '1'
ephemeral-storage: 500Mi
memory: 2457Mi
Are they conflicting? It is difficult to remove the ephemeral-storage definitions due to some issues in our codebase so I would like to confirm first. Thanks.
本文标签:
版权声明:本文标题:kubernetes - spark driver pod gets stuck at ContainerCreating state after be configured to use persisted volume for scratch spac 内容由网友自发贡献,该文观点仅代表作者本人, 转载请联系作者并注明出处:http://www.betaflare.com/web/1744019556a2576967.html, 本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌抄袭侵权/违法违规的内容,一经查实,本站将立刻删除。
发表评论