Martin Durant
Staff Software Engineer at Anaconda, Inc. Creator of fastparquet, fsspec, intake and kerchunk.
Sessions
12-06
17:30
30min
Intake 2
Martin Durant
Intake is a python library for describing, cataloging, finding and loading data. It has had the
ethos of "load and get out of the way", which limited scope but provided a lot of convenience.
However, complexity built up over years, providing a barrier for new users to start with Intake.
In this talk, I will resent Intake 2, a complete rewrite of the package, featuring a much simpler
reader interface and removal of many complex and unused features. This overhaul also enabled the
development of a general purpose data pipelining description, making intake both simpler and
much more powerful.
General Track
General Track