CHANGELOG.md

Change Log

1.2.0

• Parameters lists passing feature from 1.1.0 was removed due to cli api issues it caused.
• Piping papermill into nbconvert no longer triggers an encoding error on Python 2
• Added BOTO3_ENDPOINT_URL environment variable to override boto session url
• stdout / stderr can now be streamed to a file via --stdout-file /dev/stdout and --stderr-file /dev/stderr.
• The CLI option --not-report-mode is now --no-report-mode
• GCFS connectors should now retry under all conditions that the upstream library defines as retryable. Papermill now uses the is_retryable method from the upstream dependency.

1.1.0 (This version should be avoided for several known issues fixed in 1.2.0)

• Read content from stdin/to stdout when the path is - or a pipe. This allows for <generate input>... | papermill | ...<process output>, with papermill - - being implied by the pipes.
• The built-in ADLHandler for Azure Pipelines should now work properly again.
• Many documentation improvements
• IPython is now lazily imported only when progress bars are needed.
• A MATLAB translator is now available for parameters being passed to MATLAB notebooks.
• Parameters lists can more easily be passed to the command line via: -p name value1 value2 3 ... which results in adding to notebooks a parameter list assignment name = ["value1", "value2", 3].

1.0.1

• Cleaned up some dependency and build issues around pip 19 and pandas
• execute_notebook can now take notebook as strings instead of only as a path
• kwargs are now passed through the default engine to nbconvert's wrapper class
• Passing dates through yaml as parameters will no longer raise an exception (i.e. -y "a_date: 2019-01-01" without having to quote ala -y "a_date: '2019-01-01'")

1.0.0

We made it to our 1.0 milestone goals! The largest change here is removal of record, Notebook, and NotebookCollection abstractions which are now living in scrapbook and requirement of nbconvert 5.5 as a dependency.

• Input and output paths can now reference input parameters. my_nb_{nb_type}.ipynb out_{nb_type}.ipynb -p nb_type test will substitute values into the paths passed in with python format application patterns.
• read_notebook, read_notebooks, record, and display api functions are now removed.
• [upstream] ipywidgets are now supported. See nbconvert docs for details.
• [upstream] notebook executions which run out of memory no longer hang indefinitely when the kernel dies.

0.19.1

• Added a warning when no parameter tag is present but parameters are being passed
• Replaced retry with tenacity to help with conda builds and to use a non-abandoned library

0.19.0

DEPRECATION CHANGE The record, read_notebook, and read_notebooks functions are now officially deprecated and will be removed in papermill 1.0.

• scrapbook functionality is now deprecated
• gcsfs support is expanded to cover recent releases

0.18.2

Fixes

• Addressed an issue with reading encoded notebook .ipynb files in python 3.5

0.18.1

Fixes

• azure missing environment variable now has a better error message and only fails lazily
• gcs connector now has a backoff to respect service rate limits

0.18.0

INSTALL CHANGE The iorw extensions now use optional dependencies. This means that installation for s3, azure, and gcs connectors are added via:

pip install papermill[s3,azure,gcs]

or for all dependencies

pip install papermill[all]

Features

• Optional IO extensions are now separated into different dependencies.
• Added gs:// optional dependency for google cloud storage support.
• null json fields in parmaeters now translate correctly to equivilent fields in each supported language

Fixes

• tqdm dependencies are pinned to fetch a minimum version for auto tqdm

Dev Improvements

• Releases and versioning patterns were made easier
• Tox is now used to capture all test and build requirements

0.17.0

Features

• Log level can now be set with --log-level
• The working directory of papermill can be set with the --cwd option. This will set the executing context of the kernel but not impact input/output paths. papermill --cwd foo bar/input_nb.ipynb bar/output_nb.ipynb would make the notebook able to reference files in the foo directoy without ../foo but still save the output notebook in the bar directory.
• Tox has been added for testing papermill. This makes it easier to catch linting and manifest issues without waiting for a failed Travis build.

Fixes

• Fixed warnings for reading non-ipynb files
• Fixed --report-mode with parameters (and made it more compatible with JupyterLab)
• Papermill execution progress bars now render within a notebook correctly after importing seaborn
• The --prepare-only option no longer requires that kernels be installed locally (you can parameterize a notebook without knowing how to execute it)
• Azure IO adapter now correctly prefixes paths with the adl:// scheme
• Tests on OSX should pass again

Docs

• Install doc improvements
• Guide links are updated in the README
• Test docs updated for tox usage

0.16.2

• Injected parameter cells now respect --report-mode
• Logging level is only set for logger through CLI commands
• Output and input paths can be automatically passed to notebooks with the --inject-paths option
• Entrypoints have been added for registration of new papermill.io and papermill.engine plugins via setup files

0.16.1

• Fixed issue with azure blob io operations

0.16.0

• Added engines abstraction and command line argument
• Moved some nbconvert wrappers out of papermill
• Added Azure blob storage support
• Fixed botocore upgrade comptability issue (all version of boto now supported again)
• Removed whitelisted environment variable assignment

0.15.1

• Added support for Julia kernels
• Many improvements to README.md and documentation
• nbconvert dependency pinned to >= 5.3
• Improved error handling for missing directories
• Warnings added when an unexpected file extension is used
• Papermill version is visible to the CLI
• More messages us logging module now (and can be filtered accordingly)
• Binder link from README was greatly improved to demostrate papermill features

0.15.0

• Moved translator functions into registry
• Added development guide to help new contributors
• Travis, coverage, linting, and doc improvements
• Added support for Azure data lake sources
• Added python 3.7 testing

0.14.2

• Added output flushing for log-output option

0.14.1

• Upgraded executor to stream outputs during execution
• Fixed UTF-8 encoding issues for windows machines
• Added black code formatter rules (experimental)
• Contributors document added
• Added report-mode option for hiding inputs

0.13.4 (no code changes)

• Release manifest fix

0.13.3

• Fixed scala int vs long assignment

0.13.2

• Pip 10 fixes

0.13.1

• iPython pin to circumvent upstream issue

0.13.0

• Added prepare-only flag for parameterizing without processing a notebook
• Fixed cell number display on failed output notebooks
• Added scala language support

0.12.6

• Changed CLI outputs from papermill messaging to stderr
• Changed IOResolvers to perseve ordering of definition in resolving paths

0.12.5

• Set click disable_unicode_literals_warning=True to disable unicode literals

0.12.4

• Added universal wheel support
• Test coverage for s3 improved

0.12.3

• Added start timeout option for slow booting kernels

0.12.2

• Added options around tqdm
• Fixed an S3 decoding issue

0.12.1

• ip_display improvements
• Docstring improvements

0.12.0

• Added type preservation for r and python parameters
• Massive test coverage improvements
• Codebase style pass