OpenTube

Pandas 2.0 : Everything You Need to Know

Rob Mulla

125,015 views

In this video I give an overview of pandas 2.0 and the main changes related to the apache arrow backend.

Marc Garcia's Article: https://datapythonista.me/blog/pandas...

Timeline:
00:00 Intro
01:04 Legacy Numpy
02:49 Arrow Backend
03:44 Missing Values
04:33 Speed
05:47 Interoperability
07:42 Arrow Data Types

Check out my other videos:
Data Pipelines: Polars vs PySpark vs Pandas: The BEST library for building Data Pipelin...
Polars for Data Science: Polars: The Next Big Python Data Science L...
Speed up Pandas Dataframes: This INCREDIBLE trick will speed up your d...
Avoid These Pandas Mistakes: 25 Nooby Pandas Coding Mistakes You Should...

Links to my stuff:
Youtube: https://youtube.com/@robmulla?sub_con...
Discord: Discord: discord
Twitch: Twitch: medallionstallion_
Twitter: Twitter: Rob_Mulla
Kaggle: https://www.kaggle.com/robikscube

::::::::::::::::::::
Music: Head Candy - William Rosati
Support by RFM - NCM: https://bit.ly/3jpOhJn
::::::::::::::::::::

20 Comments

@irfanshaikh262 3 years ago

I'm not sure what'd i'd be without you and this YT channel Rob. Thanks for being and amazing teacher to a rookie like myself
lots of respect and love

@Alexr26 3 years ago

Your channel is pure gold.

@farazahmed1668 3 years ago

thank you so much for such a kind information.

@TheMacister 3 years ago

Thanks Rob! Couple months seeing your videos and your content is on the spot ! 🎉

@sitrakaforler1896 3 years ago

Pandas is life.
Even if Polars is cool.

@mrdbourke 3 years ago

Epic video Rob!

I use pandas everyday and glad to hear it’s getting faster!

@edwardCYHsu 3 years ago

I am working exactly on my programming assignment of the date manipulation and it is very confusing. With the PyArrow datatype support, it is a lot easier from now. Thank you for highlighting the significance to us. You are a saint.

@gustavojuantorena 3 years ago

Great video Rob! I think Pandas will continue to be very useful in the data science community.

@AFlockOfToasters 3 years ago (edited)

Good job pronouncing Interoperability!

@vincentverdugo 3 years ago

Hey, your DS videos are awesome! I was using ChatGPT to learn more about Apache Arrow, Polars, etc from all your videos. Can you do a coding livestream or video about bioinformatics data like biological sequence data or drug development data? Thank you!

@AbrahamMendoza 3 years ago

Thanks, Rob. Great video!

@incremental_failure 3 years ago

I was about to switch to Polars but now with Pandas Arrow dtypes, I need to do more research. Speed is one thing but lazy processing and memory usage are very important.

@BabakFiFoo 3 years ago

Rob, you are making the best videos. I am always watching them and learn new stuff. I learned python and pandas myself, and your videos helped me improve them several times fold. thank you!