Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add new snapshot spec - main #6187

Merged
merged 75 commits into from
Oct 3, 2024
Merged
Show file tree
Hide file tree
Changes from 3 commits
Commits
Show all changes
75 commits
Select commit Hold shift + click to select a range
bb32310
add new spec to spanpshot page
mirnawong1 Oct 1, 2024
49e0c87
add space
mirnawong1 Oct 1, 2024
76cc8a4
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 1, 2024
b6a7308
Merge branch 'current' into add/new-snapshot-spec-main
mirnawong1 Oct 1, 2024
3e52968
add snapshot rn
mirnawong1 Oct 1, 2024
c5a1522
Update website/docs/docs/build/snapshots.md
mirnawong1 Oct 1, 2024
b70d801
update configs
mirnawong1 Oct 1, 2024
66f65b5
add properites adn configs
mirnawong1 Oct 1, 2024
c699609
update all content under snapshots
mirnawong1 Oct 1, 2024
b81da15
Update check_cols.md
mirnawong1 Oct 1, 2024
dc6b25e
Update check_cols.md
mirnawong1 Oct 1, 2024
261dcff
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 1, 2024
966cf41
Update check_cols.md
mirnawong1 Oct 1, 2024
78706d6
Update pre-hook-post-hook.md
mirnawong1 Oct 1, 2024
388e303
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 1, 2024
dcba81a
Update website/docs/docs/dbt-versions/release-notes.md
mirnawong1 Oct 1, 2024
396c170
Update website/docs/docs/dbt-versions/release-notes.md
mirnawong1 Oct 1, 2024
1a3ff6d
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 1, 2024
1a3f9cd
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 1, 2024
d93d65a
Update website/docs/reference/snapshot-configs.md
mirnawong1 Oct 1, 2024
5ef956a
Update website/docs/reference/snapshot-configs.md
mirnawong1 Oct 1, 2024
7f600ba
update and triple check
mirnawong1 Oct 1, 2024
648afc0
Merge branch 'current' into add/new-snapshot-spec-main
mirnawong1 Oct 1, 2024
8aa509d
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 1, 2024
16974cc
Merge branch 'add/new-snapshot-spec-reference' of github.com:dbt-labs…
mirnawong1 Oct 1, 2024
b9c2937
update
mirnawong1 Oct 1, 2024
73a13b0
update ref to downstream
mirnawong1 Oct 1, 2024
1a3d975
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 1, 2024
4ad11d7
Merge branch 'current' into add/new-snapshot-spec-main
mirnawong1 Oct 1, 2024
4252fa4
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 1, 2024
16973a0
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 1, 2024
6de9454
Update release-notes.md
mirnawong1 Oct 1, 2024
4274930
Merge branch 'current' into add/new-snapshot-spec-main
mirnawong1 Oct 2, 2024
b8bd967
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 2, 2024
b523a38
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 2, 2024
1b37fe9
Merge branch 'current' into add/new-snapshot-spec-main
mirnawong1 Oct 2, 2024
9107f59
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 2, 2024
6b11685
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 2, 2024
0402729
Merge branch 'current' into add/new-snapshot-spec-main
mirnawong1 Oct 2, 2024
0c8fb12
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 2, 2024
c9f9bbf
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 2, 2024
776eaf9
Merge branch 'current' into add/new-snapshot-spec-main
mirnawong1 Oct 2, 2024
7552e63
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 2, 2024
4e7e1d2
Merge branch 'current' into add/new-snapshot-spec-main
mirnawong1 Oct 2, 2024
e21535c
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 2, 2024
a867ef7
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 2, 2024
9de1420
Merge branch 'current' into add/new-snapshot-spec-main
mirnawong1 Oct 2, 2024
be5a4ba
Merge branch 'current' into add/new-snapshot-spec-main
runleonarun Oct 2, 2024
dfec38c
Merge branch 'current' into add/new-snapshot-spec-main
runleonarun Oct 2, 2024
78c8ade
Merge branch 'current' into add/new-snapshot-spec-main
mirnawong1 Oct 3, 2024
98ad8ac
Update website/docs/reference/resource-configs/strategy.md
mirnawong1 Oct 3, 2024
b0191c6
Update website/docs/reference/snapshot-configs.md
mirnawong1 Oct 3, 2024
2076f26
Update website/docs/reference/resource-configs/unique_key.md
mirnawong1 Oct 3, 2024
18826b7
Update website/docs/reference/resource-configs/updated_at.md
mirnawong1 Oct 3, 2024
7fbb2fe
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 3, 2024
d99fb72
Update website/docs/reference/snapshot-configs.md
mirnawong1 Oct 3, 2024
23bb87a
Update website/docs/reference/snapshot-configs.md
mirnawong1 Oct 3, 2024
2dbdeed
Update website/docs/reference/snapshot-configs.md
mirnawong1 Oct 3, 2024
4882c66
Update website/docs/reference/snapshot-configs.md
mirnawong1 Oct 3, 2024
7906a09
Update website/docs/reference/snapshot-configs.md
mirnawong1 Oct 3, 2024
ffc8b3f
Update website/docs/reference/snapshot-configs.md
mirnawong1 Oct 3, 2024
4028bc3
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 3, 2024
dfa67f9
doug's feedback
mirnawong1 Oct 3, 2024
cfb296b
add file name
mirnawong1 Oct 3, 2024
ab15fe1
fix close tag
mirnawong1 Oct 3, 2024
44ed450
Merge branch 'current' into add/new-snapshot-spec-main
mirnawong1 Oct 3, 2024
e0d4277
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 3, 2024
d7fb25c
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 3, 2024
32ac285
Merge branch 'current' into add/new-snapshot-spec-main
mirnawong1 Oct 3, 2024
f0417c6
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 3, 2024
3ac664e
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 3, 2024
8b5bd3b
add new spec to references pages (#6190)
mirnawong1 Oct 3, 2024
793cba3
Merge branch 'add/new-snapshot-spec-main' into add/new-snapshot-spec-…
mirnawong1 Oct 3, 2024
4e06cd2
add new spec to snapshot page (#6188)
mirnawong1 Oct 3, 2024
271eb62
Update website/docs/docs/build/snapshots.md
mirnawong1 Oct 3, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions website/docs/docs/dbt-versions/release-notes.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,9 @@ Release notes are grouped by month for both multi-tenant and virtual private clo

## September 2024

- **New**: In dbt Cloud Versionless, [Snapshots](/docs/build/snapshots) have been updated to use YAML configuration files instead of SQL snapshot blocks. This new feature simplifies snapshot management and improves performance, and will soon be released in dbt Core 1.9.
- Who does this affect? New user on Versionless can define snapshots using the new YAML specification. Users upgrading to Versionless who use snapshots need to migrate their snapshot definitions to YAML.
mirnawong1 marked this conversation as resolved.
Show resolved Hide resolved
- Users on dbt 1.8 and earlier: No action needed; existing snapshots will continue to work as before. However, we recommend upgrading to Versionless to take advantage of the new snapshot features.
mirnawong1 marked this conversation as resolved.
Show resolved Hide resolved
- **Enhancement**: You can now run [Semantic Layer commands](/docs/build/metricflow-commands) commands in the [dbt Cloud IDE](/docs/cloud/dbt-cloud-ide/develop-in-the-cloud). The supported commands are `dbt sl list`, `dbt sl list metrics`, `dbt sl list dimension-values`, `dbt sl list saved-queries`, `dbt sl query`, `dbt sl list dimensions`, `dbt sl list entities`, and `dbt sl validate`.
- **New**: Microsoft Excel, a dbt Semantic Layer integration, is now generally available. The integration allows you to connect to Microsoft Excel to query metrics and collaborate with your team. Available for [Excel Desktop](https://pages.store.office.com/addinsinstallpage.aspx?assetid=WA200007100&rs=en-US&correlationId=4132ecd1-425d-982d-efb4-de94ebc83f26) or [Excel Online](https://pages.store.office.com/addinsinstallpage.aspx?assetid=WA200007100&rs=en-US&correlationid=4132ecd1-425d-982d-efb4-de94ebc83f26&isWac=True). For more information, refer to [Microsoft Excel](/docs/cloud-integrations/semantic-layer/excel).
- **New**: [Data health tile](/docs/collaborate/data-tile) is now generally available in dbt Explorer. Data health tiles provide a quick at-a-glance view of your data quality, highlighting potential issues in your data. You can embed these tiles in your dashboards to quickly identify and address data quality issues in your dbt project.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -27,3 +27,4 @@ A snapshot must have a materialized value of 'snapshot'
This tells you to change your `materialized` config to `snapshot`. But when you make that change, you might encounter an error message saying that certain fields like `dbt_scd_id` are missing. This error happens because, previously, when dbt treated snapshots as tables, it didn't include the necessary [snapshot meta-fields](/docs/build/snapshots#snapshot-meta-fields) in your target table. Since those meta-fields don't exist, dbt correctly identifies that you're trying to create a snapshot in a table that isn't actually a snapshot.

When this happens, you have to start from scratch — re-snapshotting your source data as if it was the first time by dropping your "snapshot" which isn't a real snapshot table. Then dbt snapshot will create a new snapshot and insert the snapshot meta-fields as expected.

Loading