Releases: airbnb/omniduct
v1.1.12
This is a quick fix for breaking changes to werkzeug, from which we were only using its lazy object wrapper. We replace it with lazy-object-proxy
.
v1.1.11
This is a minor release allowing the override of automatic logging scope names, as well as a rewrite of the registry proxy classes.
v1.1.10
A minor release that fixes pruning of empty caches.
v1.1.9
This is a minor release adding several new features.
New Features:
- Support for pruning the cache by specifying the target number of cached items.
- A more flexible configuration parser that is backward compatible with configurations from previous versions but relaxes the requirement that all duct configurations are equally nested (in response to #97).
Minor improvements:
- Omniduct will no longer insert its version into the source string during presto queries, better allowing downstream users to use it for query policies / etc.
v1.1.8
This is a minor release which fixes an invalid version constraint on the interface-meta
dependency that prevents Anaconda environments from correctly parsing Omniduct's dependencies.
v1.1.7
v1.1.6
v1.1.5
This is a minor release fixing a bug introduced in v1.1.4 for SSH clients preventing connections due to cyclic references in the connect()
method of SSHClient
.
v1.1.4
This is a minor release with several significant improvements over v1.1.3 that do not break the API. Most of the changes revolve around improving the filesystem clients and their performance.
- Improve performance of all
Duct
instances by skipping connection checks for every operation, and instead only check if actions fail. This was achieved by replacingself.connect()
patterns with arequires_connection
decorator, which only lazily checks the connection. - Expose a wrapper around all Omniduct
FileSystemClient
implementations for use withpyarrow
as_.pyarrow_fs
. - Fix serialization of
pandas
dataframes when using filehandles. - Improve the robustness of cached methods when the serializer fails to serialize (or deserialize) objects.
FileSystemFile
fixes and improvements:- Fix a
seek
implementation bug wherebywhence
was not passed through to the internal buffer. - Fix the spelling of the
writable
attribute: "writeable" -> "writable" - Add a few extra methods to the API to match that offered by
io
file implementations.
- Fix a
S3Client
fixes and improvements:- Fix enumerating root "directory".
- Add support for passing in a pre-configured boto3 session.
- Refactor class to allow for subclasses to override boto3 session generation.
v1.1.3
This is a minor release fixing two nits:
- Use
yaml.safe_load
instead ofyaml.load
for configuration import. - Avoid unnecessary keyword arguments in
PySparkClient._execute
.