Learning Notes & Reflections
Documenting my learning journey — from technical deep dives to life lessons and personal reflections.
Technical Blog
Data engineering, AI, and cloud technologies — published on
Medium
Technical Blog
Data engineering, AI, and cloud technologies — published on Medium
Building EcoPulse: A Scalable Batch Pipeline for Economic Data
A deep dive into building a scalable batch pipeline for economic data, focusing on end-to-end automation with cloud-native tools.
Mastering Kestra: Workflow Orchestration for Modern Data Pipelines
A comprehensive guide on workflow orchestration, from Postgres ETL to managing GCS and BigQuery pipelines.
Terraform Foundations: Infrastructure as Code for Data Engineers
Practical guides on Infrastructure as Code (IaC) for managing cloud resources reliably and reproducibly.
Spark Internals: Why Spark Outperforms Hadoop
Analysis of cluster architecture and why Spark outperforms Hadoop for modern big data workloads.
Running Spark in the Cloud: GCS and Cloud Jobs
Step-by-step guides on connecting Spark to Google Cloud Storage (GCS) and submitting cloud jobs.
Analytics Engineering with dbt: From Models to Production
Comprehensive guides on building dbt models, testing, and deploying documentation in production environments.
BigQuery ML: Machine Learning in SQL
Implementing machine learning workflows directly within SQL-based queries for faster iteration and deployment.
Data Warehousing Deep Dive: BigQuery Best Practices
Deep dives into BigQuery concepts, including external vs. native tables and partitioning strategies.
The "dlt" Workshop: Simplifying API Data Extraction
Exploring data ingestion and normalization with dlt to simplify API data extraction workflows.
Reflections
Life lessons, personal growth, and insights from books — published on
Substack
Reflections
Life lessons, personal growth, and insights from books — published on Substack
Learning to Learn: Three "Shortcuts" to Shift from Passive Consumption to Active Learning
What I learned when I stopped equating finishing lecture videos with understanding ideas — three key lessons to become an output-first learner.
The 6-Skill Moat: How to Remain Indispensable
Exploring the essential skills that create a lasting competitive advantage in your career and make you indispensable.
Charlie Munger's Latticework: 5 Fundamental Mental Models
Exploring Charlie Munger's approach to decision-making through fundamental mental models from his latticework of knowledge.