kedro-docker-0.5.0

Major features and improvements

• Add compatibility with kedro 0.19

Breaking changes

• kedro-docker was updated to use the 0.19 version of the Kedro starters. If you need to use kedro-docker for an old project, you can either use an older version or move the requirements file up from src to the top-level project directory.

kedro-airflow-0.8.0

• Added support for Kedro 0.19.x

kedro-telemetry-0.3.1

• Fixed double execution of after_catalog_created hook by moving the logic of determining and sending of project statistics from after_context_created to the after_catalog_created hook.
• Updated the plugin to also share the tools selected during project creation with Heap.
• Loosen bound for Kedro to support >=0.18.0

kedro-datasets-2.0.0

Major features and improvements

• Removed Dataset classes ending with "DataSet", use the "Dataset" spelling instead.
• Added Hugging Face datasets huggingface.HFDataset and huggingface.HFTransformerPipelineDataset.
• Removed support for Python 3.7 and 3.8.
• Spark and Databricks based datasets now support databricks-connect>=13.0.
• Bump s3fs to latest calendar-versioned release.
• PartitionedDataset and IncrementalDataset now both support versioning of the underlying dataset.

Bug fixes and other changes

• Fixed bug with loading models saved with TensorFlowModelDataset.
• Make dataset parameters keyword-only.
• Correct pandas-gbq as py311 dependency

Community contributions

Many thanks to the following Kedroids for contributing PRs to this release:

• Edouard59
• Miguel Rodriguez Gutierrez
• felixscherz
• Onur Kuru

kedro-telemetry-0.3.0

• Added support for Python 3.11
• Removed support for Python 3.7

kedro-docker-0.4.0

• Migrate all project metadata to static pyproject.toml.
• Removed support for Python 3.7

Major features and improvements

• Added support for Python 3.11

kedro-datasets-1.8.0

Major features and improvements

• Moved PartitionedDataSet and IncrementalDataSet from the core Kedro repo to kedro-datasets and renamed to PartitionedDataset and IncrementalDataset.
• Added polars.LazyPolarsDataset, a GenericDataSet using polars's Lazy API.
• Renamed polars.GenericDataSet to polars.EagerPolarsDataset to better reflect the difference between the two dataset classes.
• Added a deprecation warning when using polars.GenericDataSet or polars.GenericDataset that these have been renamed to polars.EagerPolarsDataset
• Delayed backend connection for pandas.SQLTableDataset, pandas.SQLQueryDataset, and snowflake.SnowparkTableDataset. In practice, this means that a dataset's connection details aren't used (or validated) until the dataset is accessed. On the plus side, the cost of connection isn't incurred regardless of when or whether the dataset is used.

Bug fixes and other changes

• Fix erroneous warning when using an cloud protocol file path with SparkDataSet on Databricks.
• Updated PickleDataset to explicitly mention cloudpickle support.

Community contributions

Many thanks to the following Kedroids for contributing PRs to this release:

• PtrBld
• Alistair McKelvie
• Felix Wittmann
• Matthias Roels

kedro-airflow-0.7.0

• Added support for Python 3.11
• Added the --all CLI argument to kedro-airflow to convert registered all pipelines at once.
• Simplify the output of the kedro airflow create command.
• Fixed compatibility of kedro-airflow with older versions of the config loaders (kedro<=0.18.2).
• Removed support for Python 3.7

Community contributions

Many thanks to the following Kedroids for contributing PRs to this release:

• sbrugman

kedro-datasets-1.7.1

Bug fixes and other changes

• Pin tables version on kedro-datasets for Python < 3.8.

Upcoming deprecations for Kedro-Datasets 2.0.0

• Renamed dataset and error classes, in accordance with the Kedro lexicon. Dataset classes ending with "DataSet" are deprecated and will be removed in 2.0.0.

Community contributions

kedro-datasets-1.7.0

Major features and improvements

• Added polars.GenericDataSet, a GenericDataSet backed by polars, a lightning fast dataframe package built entirely using Rust.

Bug fixes and other changes

• Fixed broken links in docstrings.
• Reverted PySpark pin to <4.0.

Community contributions

Many thanks to the following Kedroids for contributing PRs to this release:

• Walber Moreira