Skip to content

Releases

3.1.5

Choose a tag to compare

@dataform-team dataform-team released this 10 Nov 14:13
489ab20

What's Changed

  • docs: add BigQuery property graphs user guide (docs/property_graphs.md) by @rafal-hawrylak in #2422
  • feat(cli): generate the CLI reference tables in cli/README.md from the option definitions by @mbiernacik in #2419
  • feat(cli)!: allow --json to be used without --dry-run in run by @Ford544 in #2418
  • feat(cli): make location optional in init and init-creds by @Ford544 in #2402
  • Add warning if set @@dataset_id used with no defaultLocation by @Ford544 in #2421
  • fix(cli): attach ClientInfo gRPC metadata header to lineage run events by @rafal-hawrylak in #2425
  • chore(cli): address review comments from #2425 on lineage ClientInfo header by @rafal-hawrylak in #2429
  • Bump DF_VERSION from 3.1.4 to 3.1.5 by @rafal-hawrylak in #2430

Full Changelog: 3.1.4...3.1.5

3.1.4

Choose a tag to compare

@dataform-team dataform-team released this 06 Nov 12:28
2d6675b

What's Changed

New Contributors

Full Changelog: 3.1.3...3.1.4

3.1.3

Choose a tag to compare

@dataform-team dataform-team released this 02 Nov 14:33
d7afead

What's Changed

  • test(api): use explicit unknownProperty in credentials unknown-field test by @SergikL in #2398
  • fix(cli): use the pinned @dataform/core for JiT compilation by @mbiernacik in #2392
  • Pass JiT compiler arguments as an options object by @mbiernacik in #2400
  • fix(cli): emit lineage inputs/outputs on COMPLETE for actions with a BigQuery output and use 3-part actionName by @rafal-hawrylak in #2399
  • docs(core): fix Operation JS API example to use queries() and config arg by @apilaskowski in #2409
  • Prefetch npm dependencies for Dependabot PRs by @apilaskowski in #2405
  • fix(core): require defaultDataset for incremental Lakehouse tables by @SergikL in #2406
  • docs(cli): add user guide and config reference for data lineage emission by @rafal-hawrylak in #2411
  • fix(cli): disable lineage emitter and display a warning if location is not set by @Ford544 in #2393
  • docs(cli): specify roles/datalineage.producer and processOpenLineageMessage permission by @rafal-hawrylak in #2412
  • support defaultJobLabels and action-level jobLabels by @zaptot in #2344
  • Update markdown-it to 14.3.3 by @Ford544 in #2410
  • fix(cli): concatenateQueries comment issues by @Ford544 in #2414
  • feat(cli)!: concatenate operations queries into a single task by @Ford544 in #2413
  • Publishing Dataform security patches by @dataform-team in #2415

Full Changelog: 3.1.2...3.1.3

3.1.2

Choose a tag to compare

@dataform-team dataform-team released this 21 Oct 07:44
51fccc7

What's Changed

Full Changelog: 3.1.1...3.1.2

3.1.1

Choose a tag to compare

@dataform-team dataform-team released this 20 Oct 13:55
5617aa8

What's Changed

  • refactor(cli): migrate BigQuery integration tests from KMS-encrypted test key to ADC by @mbiernacik in #2362
  • fix(cli): filter out non-existent tables in BigQueryDbAdapter.search by @rafal-hawrylak in #2388
  • test: Make bigquery search integration test ignore leftover datasets by @apilaskowski in #2390
  • fix(tests): Ensure concurrent test runs do not operate on the same BQ datasets by @Ford544 in #2385
  • feat(core): add support for 4-part Lakehouse Catalog targets by @SergikL in #2384
  • fix(cli): Use defaultLocation for BigQuery jobs and datasets in dataform run by @apilaskowski in #2389
  • Canary test (with GCP bucket) by @Ford544 in #2354
  • fix(cli): remove unused sql and errorMessage OpenLineage facets by @rafal-hawrylak in #2391
  • test(cli): add location resolution e2e tests by @Ford544 in #2394
  • Bump DF_VERSION from 3.1.0 to 3.1.1 by @SergikL in #2395

New Contributors

Full Changelog: 3.1.0...3.1.1

3.1.0

Choose a tag to compare

@dataform-team dataform-team released this 15 Oct 12:28
5cc970f

What's Changed

Full Changelog: 3.0.71...3.1.0

3.0.71

Choose a tag to compare

@dataform-team dataform-team released this 25 Sep 09:01
cf7d6e5

What's Changed

Full Changelog: 3.0.70...3.0.71

3.0.70

Choose a tag to compare

@dataform-team dataform-team released this 17 Sep 19:18
c05f101

What's Changed

New Contributors

Full Changelog: 3.0.69...3.0.70

3.0.69

Choose a tag to compare

@dataform-team dataform-team released this 07 Sep 10:02
de116ea

🕸️ BigQuery Graph Integration (Property Graphs)

With this release, Dataform CLI delivers full support and native integration for BigQuery Graph (Property Graphs). You can now declaratively define, orchestrate, and manage BigQuery Property Graphs directly in your Dataform projects via YAML.
Key Integration Capabilities:

  • Declarative YAML Definitions: Define property graph schemas using definitions/graph.yaml to specify node tables (entities), edge tables (relationships), source/destination endpoints, labels, and properties.
  • Automated Node & Edge DAG Dependencies: Reference upstream Dataform models in entities/relationships using ref data sources (dataSourceRef), automatically resolving dataset targets and ensuring correct execution ordering after underlying tables.
  • Tagging & Selective Execution: Full tags support in graph.yaml to filter and run property graphs during selective executions (e.g., dataform run --tags graph).
  • Assertion Propagation Control: Explicitly control whether dependent assertions run before property graph creation (dependOnDependencyAssertions: false / includeDependentAssertions: false).
  • Automated BigQuery DDL Lifecycle: Compiles declarative YAML definitions into BigQuery CREATE OR REPLACE PROPERTY GRAPH DDL statements and executes them in BigQuery.

What's Changed

Full Changelog: 3.0.68...3.0.69

3.0.68

Choose a tag to compare

@dataform-team dataform-team released this 03 Sep 12:05
d62ba04

What's Changed

Full Changelog: 3.0.67...3.0.68

⌂ 换网址