Publish to Dataset

Write pipeline output to a dataset that updates automatically whenever the pipeline runs.

Publish to Dataset is one of the pipeline’s output steps. It creates a dataset that is automatically kept up to date by the pipeline.

Once you have made every transformation you need, publish the result as a dataset. The step lets you choose the dataset name and the repository it is stored in.

After naming and saving, click the link to navigate to the new dataset.

You need write access to the destination repository. See Repositories for how permission levels work.

A published dataset is a first-class dataset: it can be queried through the API, read with the Python SDK, and fetched by other pipelines with Fetch Dataset.

Next steps

Chart data

Chart the result instead of, or as well as, publishing it.

Data snapshot

Produce a downloadable, embeddable snapshot.