Justin
04/03/2023, 7:50 AM# apiVersion: v1
# kind: PersistentVolumeClaim
# metadata:
# name: composer-bigtechmomentum-v1-pvc
# spec:
# accessModes:
# - ReadWriteOnce
# resources:
# requests:
# storage: 1Mi
# ---
apiVersion: batch/v1
kind: CronJob
metadata:
name: composer-bigtechmomentum-v1
spec:
schedule: "42 3 * * *"
suspend: false
concurrencyPolicy: Forbid
jobTemplate:
spec:
template:
spec:
containers:
- name: composer-bigtechmomentum-v1
image: guestros/xxxxxxxxxx:latest
imagePullPolicy: Always
# volumeMounts:
# - mountPath: /app/persistent/
# name: composer-bigtechmomentum-v1-pv
redsquare
04/03/2023, 7:57 AMJustin
04/03/2023, 7:59 AMredsquare
04/03/2023, 8:29 AMJustin
04/03/2023, 1:49 PMredsquare
04/03/2023, 1:51 PMJustin
04/03/2023, 1:52 PMredsquare
04/03/2023, 1:58 PMJustin
04/03/2023, 1:59 PMjob_task = KubernetesJobOperator(
task_id="from-image",
dag=dag,
image="ubuntu",
command=["bash", "-c", 'echo "all ok"'],
)
https://github.com/LamaAni/KubernetesJobOperator
I just think that Airflow is a) quite resource heavy and b) prefect has a nicer UI, so would be a shame to switchredsquare
04/03/2023, 2:02 PMJustin
04/03/2023, 2:03 PMredsquare
04/03/2023, 2:10 PM