You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is there a way to define all-purpose job clusters? Looking at default_python_job, it seems that the clusters are defined per job. I don't see any way to reference the cluster from another job (at least using ${resources.jobs.job-name.job_clusters} doesn't work. Just using the cluster key doesn't work either.
The text was updated successfully, but these errors were encountered:
ryanhubbell
changed the title
Define shared job clusters
Define all-purpose job clusters
Feb 5, 2024
I was not able to do it using Databricks Asset Bundles. I instead defined it via Terraform. In fact, I'm moving all of our stuff over to just using Terraform. It supports a lot more than DAB does, and it doesn't use yaml (not my favorite).
Is there a way to define all-purpose job clusters? Looking at
default_python_job
, it seems that the clusters are defined per job. I don't see any way to reference the cluster from another job (at least using ${resources.jobs.job-name.job_clusters} doesn't work. Just using the cluster key doesn't work either.The text was updated successfully, but these errors were encountered: