Skip to content

Releases: airbnb/omniduct

v1.1.12

08 Feb 07:43
Compare
Choose a tag to compare

This is a quick fix for breaking changes to werkzeug, from which we were only using its lazy object wrapper. We replace it with lazy-object-proxy.

v1.1.11

08 Feb 07:42
Compare
Choose a tag to compare

This is a minor release allowing the override of automatic logging scope names, as well as a rewrite of the registry proxy classes.

v1.1.10

22 Jan 23:55
Compare
Choose a tag to compare

A minor release that fixes pruning of empty caches.

v1.1.9

31 Oct 21:26
Compare
Choose a tag to compare

This is a minor release adding several new features.

New Features:

  • Support for pruning the cache by specifying the target number of cached items.
  • A more flexible configuration parser that is backward compatible with configurations from previous versions but relaxes the requirement that all duct configurations are equally nested (in response to #97).

Minor improvements:

  • Omniduct will no longer insert its version into the source string during presto queries, better allowing downstream users to use it for query policies / etc.

v1.1.8

12 Sep 21:20
Compare
Choose a tag to compare

This is a minor release which fixes an invalid version constraint on the interface-meta dependency that prevents Anaconda environments from correctly parsing Omniduct's dependencies.

v1.1.7

21 Jun 04:48
Compare
Choose a tag to compare

This is a minor release with the addition of a new database backend for Exasol (contributed by @Foxyblue in #99; thanks!).

v1.1.6

14 May 21:57
Compare
Choose a tag to compare

This is a minor release which does not install enum34 on Python 3.4+ where it is not necessary, and has caused some trouble with other packages.

It also has some documentation fixes from @Foxyblue (#100 #102). Thank you!

v1.1.5

06 May 22:33
Compare
Choose a tag to compare

This is a minor release fixing a bug introduced in v1.1.4 for SSH clients preventing connections due to cyclic references in the connect() method of SSHClient.

v1.1.4

10 Apr 03:55
Compare
Choose a tag to compare

This is a minor release with several significant improvements over v1.1.3 that do not break the API. Most of the changes revolve around improving the filesystem clients and their performance.

  • Improve performance of all Duct instances by skipping connection checks for every operation, and instead only check if actions fail. This was achieved by replacing self.connect() patterns with a requires_connection decorator, which only lazily checks the connection.
  • Expose a wrapper around all Omniduct FileSystemClient implementations for use with pyarrow as _.pyarrow_fs.
  • Fix serialization of pandas dataframes when using filehandles.
  • Improve the robustness of cached methods when the serializer fails to serialize (or deserialize) objects.
  • FileSystemFile fixes and improvements:
    • Fix a seek implementation bug whereby whence was not passed through to the internal buffer.
    • Fix the spelling of the writable attribute: "writeable" -> "writable"
    • Add a few extra methods to the API to match that offered by io file implementations.
  • S3Client fixes and improvements:
    • Fix enumerating root "directory".
    • Add support for passing in a pre-configured boto3 session.
    • Refactor class to allow for subclasses to override boto3 session generation.

v1.1.3

05 Apr 23:36
Compare
Choose a tag to compare

This is a minor release fixing two nits:

  • Use yaml.safe_load instead of yaml.load for configuration import.
  • Avoid unnecessary keyword arguments in PySparkClient._execute.