Data Science

Dataframe operations form the foundation of modern data science workflows, yet researchers often face vendor lock-in when choosing between different dataframe frameworks. My work addresses this by developing a unified operations library that abstracts away framework-specific implementations. The challenge lies in handling the fundamental differences between these systems—some pandas-like dataframes use row-by-row operations, others employ lazy evaluation with native expressions, some require distributed execution patterns, while others focus on parallelization.