Stock Data Platform

Unified batch + streaming market data warehouse. 10 tickers, 25 years of history, 4 data sources, refreshed every 15 seconds.

Source
KafkaAirflowTimescaleDBDashDocker
10
Tickers
25 yrs
History
4
Sources
15s
Updates
AAPL$250.12-0.50%NVDA$117.92-0.50%MSFT$388.45-0.50%GOOG$171.30+0.50%AMZN$197.52+1.50%META$597.81+1.00%TSLA$249.30+1.50%JPM$238.75+0.50%NFLX$922.67-0.50%DIS$101.20-1.50%AAPL$250.12+1.00%NVDA$117.92+1.00%MSFT$388.45+1.00%GOOG$171.30-1.50%AMZN$197.52-0.50%META$597.81-1.00%TSLA$249.30-0.50%JPM$238.75-1.50%NFLX$922.67+1.00%DIS$101.20+0.00%

Live Data

LIVE FEED
15s POLL
AAPL+2.34%
SMA(20): 152.34EMA(50): 148.90

Sources

What It Tracks

yfinance
OHLCV prices, fundamentals, earnings
SEC EDGAR
10-K/10-Q financial statements
FRED
Fed funds rate, CPI, GDP, unemployment
Kafka
Live streaming ingestion every 15s

Architecture

From Ingestion to Dashboard

1
Ingest

Kafka producers poll 4 sources every 15 seconds

2
Orchestrate

~18 Airflow DAGs schedule batch + streaming jobs

3
Store

8-table star schema in TimescaleDB

4
Visualize

Interactive Dash dashboards with SMA/EMA

7 Docker Services

TimescaleDBAirflow WebAirflow SchedulerZookeeperKafkaProducerConsumer
8-Table Star Schema

Dimensional modeling — fact tables for prices, fundamentals, earnings, SEC filings, and macro data with company and date dimensions.

7 Services~18 DAGs8 Tables
Source