Hadoop stores massive amounts of data across many computers safely.Spark processes big data much faster than traditional ...

This project represents Phase 0 of my quantitative trading infrastructure. It is an end-to-end data engineering pipeline and financial analytics library built from scratch. It extracts raw ...

A production-style YouTube ETL pipeline built with Python and SQL Server. The project extracts channel information, playlists, playlist items and videos from the YouTube Data API v3 and loads them ...

The annual Florida Python Challenge is only a few weeks away, but participants will have trouble matching a new record set earlier this month. Between November 2025 and April 2026, researchers removed ...

Kaarvi unveils its Living Data Platform for governed agentic AI, no-code pipelines, dashboards, and live data workflows.

Our client is seeking an experienced Data Architect with strong expertise in modern cloud data platforms, including Azure Databricks, AWS, Snowflake, Azure Synapse, and Azure Data Factory (ADF). The ...