Skip to content

Update product names: Workflows→Jobs, Delta Live Tables→Spark Declarative Pipelines#4967

Open
lennartkats-db wants to merge 7 commits intomainfrom
product-name-changes
Open

Update product names: Workflows→Jobs, Delta Live Tables→Spark Declarative Pipelines#4967
lennartkats-db wants to merge 7 commits intomainfrom
product-name-changes

Conversation

@lennartkats-db
Copy link
Copy Markdown
Contributor

Changes

  • Rename "Databricks Workflows" / "Workflows" → "Databricks Jobs" / "Jobs" in CLI help text and templates
  • Rename "Delta Live Tables" → "Spark Declarative Pipelines" and "DLT" → "SDP" in descriptions, comments, and schema annotations
  • Rename template parameter include_dltinclude_sdp and file dlt_pipeline.ipynbsdp_pipeline.ipynb in experimental-jobs-as-code template

…tive Pipelines

Update all non-generated references to retired product names:
- "Databricks Workflows" / "Workflows" → "Databricks Jobs" / "Jobs"
- "Delta Live Tables" → "Spark Declarative Pipelines"
- "DLT" → "SDP" (in comments/internal code)
- Template parameter `include_dlt` → `include_sdp`
- Template file `dlt_pipeline.ipynb` → `sdp_pipeline.ipynb`

Generated files (schema JSON, docsgen, acceptance test outputs, Python
models) are not updated here — regenerate with `make schema`, `make docs`,
`make test-update`, `make test-update-templates`, `make -C python codegen`
after the upstream proto changes land.

Co-authored-by: Isaac
@github-actions
Copy link
Copy Markdown

github-actions bot commented Apr 14, 2026

Approval status: pending

/acceptance/bundle/ - needs approval

Files: acceptance/bundle/help/bundle-generate-pipeline/output.txt, acceptance/bundle/help/bundle-open/output.txt, acceptance/bundle/paths/invalid_pipeline_globs/databricks.yml, acceptance/bundle/paths/pipeline_expected_file_got_notebook/databricks.yml, acceptance/bundle/paths/pipeline_globs/root/databricks.yml, acceptance/bundle/run_as/pipelines_legacy/output.txt, acceptance/bundle/telemetry/deploy-experimental/output.txt, acceptance/bundle/templates/dbt-sql/output/my_dbt_sql/README.md, acceptance/bundle/templates/default-scala/output/my_default_scala/README.md, acceptance/bundle/templates/default-sql/output/my_default_sql/README.md, acceptance/bundle/templates/default-sql/output/my_default_sql/src/orders_daily.sql, acceptance/bundle/templates/default-sql/output/my_default_sql/src/orders_raw.sql, acceptance/bundle/templates/experimental-jobs-as-code/input.json, acceptance/bundle/templates/experimental-jobs-as-code/output.txt, acceptance/bundle/templates/experimental-jobs-as-code/output/my_jobs_as_code/README.md, acceptance/bundle/templates/experimental-jobs-as-code/output/my_jobs_as_code/pyproject.toml, acceptance/bundle/templates/experimental-jobs-as-code/output/my_jobs_as_code/resources/my_jobs_as_code_pipeline.py, acceptance/bundle/templates/experimental-jobs-as-code/output/my_jobs_as_code/src/notebook.ipynb, acceptance/bundle/templates/experimental-jobs-as-code/output/my_jobs_as_code/src/sdp_pipeline.ipynb
Suggested: @denik
Also eligible: @andrewnester, @shreyas-goenka, @pietern, @anton-107, @janniklasrose

/bundle/ - needs approval

Files: bundle/config/mutator/resourcemutator/capture_uc_dependencies.go, bundle/config/mutator/resourcemutator/run_as.go, bundle/internal/schema/annotations.yml, bundle/internal/schema/annotations_openapi_overrides.yml, bundle/phases/deploy.go, bundle/schema/jsonschema.json
Suggested: @denik
Also eligible: @andrewnester, @shreyas-goenka, @pietern, @anton-107, @janniklasrose

/cmd/bundle/ - needs approval

Files: cmd/bundle/generate/pipeline.go, cmd/bundle/open.go
Suggested: @denik
Also eligible: @andrewnester, @shreyas-goenka, @pietern, @anton-107, @janniklasrose

/libs/template/ - needs approval

Files: libs/template/templates/dbt-sql/README.md, libs/template/templates/dbt-sql/template/{{.project_name}}/README.md.tmpl, libs/template/templates/default-scala/template/{{.project_name}}/README.md.tmpl, libs/template/templates/default-sql/template/{{.project_name}}/README.md.tmpl, libs/template/templates/default-sql/template/{{.project_name}}/src/orders_daily.sql.tmpl, libs/template/templates/default-sql/template/{{.project_name}}/src/orders_raw.sql.tmpl, libs/template/templates/experimental-jobs-as-code/databricks_template_schema.json, libs/template/templates/experimental-jobs-as-code/template/__preamble.tmpl, libs/template/templates/experimental-jobs-as-code/template/{{.project_name}}/README.md.tmpl, libs/template/templates/experimental-jobs-as-code/template/{{.project_name}}/pyproject.toml.tmpl, libs/template/templates/experimental-jobs-as-code/template/{{.project_name}}/resources/{{.project_name}}_job.py.tmpl, libs/template/templates/experimental-jobs-as-code/template/{{.project_name}}/resources/{{.project_name}}_pipeline.py.tmpl, libs/template/templates/experimental-jobs-as-code/template/{{.project_name}}/src/notebook.ipynb.tmpl, libs/template/templates/experimental-jobs-as-code/template/{{.project_name}}/src/sdp_pipeline.ipynb.tmpl
Suggested: @denik
Also eligible: @andrewnester, @shreyas-goenka, @pietern, @anton-107, @janniklasrose

General files (require maintainer)

Files: cmd/workspace/permissions/overrides.go
Based on git history:

  • @denik -- recent work in bundle/phases/, bundle/internal/schema/, cmd/bundle/

Any maintainer (@andrewnester, @anton-107, @denik, @pietern, @shreyas-goenka, @simonfaltum, @renaudhartert-db) can approve all areas.
See OWNERS for ownership rules.

lennartkats-db and others added 6 commits April 14, 2026 13:33
With include_pipeline properly wired (was silently ignored as include_dlt),
PIPELINE=no now excludes the pipeline resource. With only a job resource,
dynamic_version causes 1 change and 0 unchanged, which is correct behavior.

Co-authored-by: Isaac
The template renamed include_dlt to include_pipeline in a prior PR, but
the combinations test intentionally still passes include_dlt (which gets
silently ignored, defaulting to yes). Renaming to include_pipeline makes
PIPELINE=no actually exclude pipelines, causing divergent output across
variants which the combinations framework doesn't support.

Co-authored-by: Isaac
The output was corrupted when running tests locally without terraform,
replacing the successful deployment output with terraform init errors.
Restores correct output from main and applies DLT→SDP string change.

Co-authored-by: Isaac
@lennartkats-db lennartkats-db changed the title [draft] Update product names: Workflows→Jobs, Delta Live Tables→Spark Declarative Pipelines Update product names: Workflows→Jobs, Delta Live Tables→Spark Declarative Pipelines Apr 15, 2026
@lennartkats-db lennartkats-db requested a review from denik April 15, 2026 08:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants