Data Science

Efficient Pandas: Using Chunksize for Large Data Sets

Exploring large data sets efficiently using Pandas

Lawrence Alaso Krukrubo
Towards AI
Published in
10 min readJan 27, 2020

--

Data Science professionals often encounter very large data sets with hundreds of dimensions and millions of observations. There are multiple ways to handle large data sets. We all know about the distributed file systems like Hadoop and Spark

--

--

Fair and Explainable AI | Data Science | Machine Learning | Deep Learning| Writer@towardsAI| AI-Nanodegree