"Serpents and Ducks: wrangling data with Python and DuckDB" - Simon Aubury (Pycon AU 2024)

(Simon Aubury) Got a billion rows of data in a weird file format? Wishing you could wrangle a dataframe from a geospatial dataset? A bit lost interacting with a remote API? Let’s wrangle some data with Python and DuckDB. DuckDB executes analytical SQL queries without the need for a server. DuckDB features a deep and deceptively simple integration with the Python ecosystem, allowing us to query, wrangle, and output data, alongside all your favourite Python tools.. Its powerful analytical features and rich integrations position DuckDB as an invaluable tool for anyone working with analytical data in Python, helping you solve complex problems with ease and elegance. In this practical talk, we’ll introduce DuckDB, a fast and versatile analytical database to keep in your data toolkit. We’ll go through how to use the DuckDB Python client effectively, taking advantage of DuckDB’s efficient data processing features, as well as its integrations with libraries like Pandas and Ibis. https://pretalx.com/pycon-au-2024/talk/TWFSTJ/ python, pycon, australia, programming, conference, technical, developers, panel, sessions, libraries, frameworks, community, sysadmins, students, education, data, science Videos licensed as CC-BY-NC-SA 4.0 PyCon AU is the national conference for the Python programming community, bringing together professional, student and enthusiast developers, sysadmins and operations folk, students, educators, scientists, statisticians, and many others besides, all with a love for working with Python. Licensed as CC BY-NC-SA - http://creativecommons.org/licenses/by-nc-sa/4.0/ Produced by Next Day Video Australia: https://nextdayvideo.com.au Sat Nov 23 11:20:00 2024 at Door 12 / Goldfields Theatre