The Best File Format To Store A Pandas DataFrame
In the image above, you can find the run-time comparison of storing a Pandas DataFrame in various file formats.
Although CSVs are a widely adopted format, it is the slowest format in this list.
Thus, CSVs should be avoided unless you want to open the data outside Python (in Excel, for instance).
Read more in my blog: Medium.
Share this post on LinkedIn: Post Link.
The code snippets for the posts I have shared here are available on GitHub. Check out this repository: GitHub.
I like to explore, experiment and write about data science concepts and tools. You can read my articles on Medium. Also, you can connect with me on LinkedIn.