Master Data Wrangling with Python & DuckDB at PyCon AU 2024 ๐๐ฆ
Join Simon Aubury at PyCon AU 2024 to learn how to efficiently handle billion-row datasets, convert complex file formats, and work with geospatial data using Python and DuckDB. Perfect for data enthusiasts facing big data challenges!

PyCon AU
1.4K views โข Nov 30, 2024

About this video
(Simon Aubury) Got a billion rows of data in a weird file format? Wishing you could wrangle a dataframe from a geospatial dataset? A bit lost interacting with a remote API? Letโs wrangle some data with Python and DuckDB.
DuckDB executes analytical SQL queries without the need for a server. DuckDB features a deep and deceptively simple integration with the Python ecosystem, allowing us to query, wrangle, and output data, alongside all your favourite Python tools.. Its powerful analytical features and rich integrations position DuckDB as an invaluable tool for anyone working with analytical data in Python, helping you solve complex problems with ease and elegance.
In this practical talk, weโll introduce DuckDB, a fast and versatile analytical database to keep in your data toolkit. Weโll go through how to use the DuckDB Python client effectively, taking advantage of DuckDBโs efficient data processing features, as well as its integrations with libraries like Pandas and Ibis.
https://pretalx.com/pycon-au-2024/talk/TWFSTJ/
python, pycon, australia, programming, conference, technical, developers, panel, sessions, libraries, frameworks, community, sysadmins, students, education, data, science
Videos licensed as CC-BY-NC-SA 4.0
PyCon AU is the national conference for the Python programming community, bringing together professional, student and enthusiast developers, sysadmins and operations folk, students, educators, scientists, statisticians, and many others besides, all with a love for working with Python.
Licensed as CC BY-NC-SA - http://creativecommons.org/licenses/by-nc-sa/4.0/
Produced by Next Day Video Australia: https://nextdayvideo.com.au
Sat Nov 23 11:20:00 2024 at Door 12 / Goldfields Theatre
DuckDB executes analytical SQL queries without the need for a server. DuckDB features a deep and deceptively simple integration with the Python ecosystem, allowing us to query, wrangle, and output data, alongside all your favourite Python tools.. Its powerful analytical features and rich integrations position DuckDB as an invaluable tool for anyone working with analytical data in Python, helping you solve complex problems with ease and elegance.
In this practical talk, weโll introduce DuckDB, a fast and versatile analytical database to keep in your data toolkit. Weโll go through how to use the DuckDB Python client effectively, taking advantage of DuckDBโs efficient data processing features, as well as its integrations with libraries like Pandas and Ibis.
https://pretalx.com/pycon-au-2024/talk/TWFSTJ/
python, pycon, australia, programming, conference, technical, developers, panel, sessions, libraries, frameworks, community, sysadmins, students, education, data, science
Videos licensed as CC-BY-NC-SA 4.0
PyCon AU is the national conference for the Python programming community, bringing together professional, student and enthusiast developers, sysadmins and operations folk, students, educators, scientists, statisticians, and many others besides, all with a love for working with Python.
Licensed as CC BY-NC-SA - http://creativecommons.org/licenses/by-nc-sa/4.0/
Produced by Next Day Video Australia: https://nextdayvideo.com.au
Sat Nov 23 11:20:00 2024 at Door 12 / Goldfields Theatre
Tags and Topics
Browse our collection to discover more content in these categories.
Video Information
Views
1.4K
Likes
53
Duration
29:03
Published
Nov 30, 2024
User Reviews
4.5
(1) Related Trending Topics
LIVE TRENDSRelated trending topics. Click any trend to explore more videos.