Pandas and Databases for Data Analysis

Using a database for data analysis and persistance but should it be SQLite or DuckDB

A couple of articles here about the use of a database for data analysis and persisting pandas dataframes. Also the difference in use between OLAP and OLTP databases.

Click on the titles to read them on Medium (and apologies if you’ve already seen them - this is a little late coming out).

Python Pandas and SQLite

Using SQLite to store your Pandas dataframes gives you a persistent store and a way of easily selecting and filtering your data

and

DuckDB — SQLite for Data Analysis

SQLite is the most popular database in the world and great for transaction processing but for analytics DuckDB is faster