Harish Kesava Rao

I am a Data Engineer, with a majority of my recent roles involving Data Platforms. My journey in data started in technical presales in the relational world, involving databases such as Oracle, Postgres and SQL Server, ETL tooling such as Ab Initio or Informatica and eventually moving onto on-premise big data with Hadoop, Hive, Presto, Spark, Kubernetes and Docker. Later, I began working with the cloud on AWS, Azure and Databricks, also managing infrastructure with AWS CDK or Terraform. More recently, I have been utilizing my skills to cater to AI and ML use cases to power agents, and ML models for sentiments, themes and features. I have worked in teams of different sizes and objectives, ranging from one member teams to 30 member teams, across a variety of tech stacks. I am also an open-source contributor and I blog about data.

news

Oct 29, 2025
[Open Source] PR approved: Improved error observability in SnapshotManager.getLogSegmentForVersion — Delta Lake
Mar 29, 2025 [Talks] Guest lecture to Undergraduate students and faculty of an Engineering College’s Department of Artificial Intelligence and Data Science. Topic: Building a career in Data
Apr 29, 2024 [Update] Joined Atlassian India as Principal Data Engineer & Data Architect.
Apr 30, 2023 [Open Source] Created the Databricks Partition Sensor (for the Databricks Provider) for Apache Airflow.
Apr 2, 2023 [Open Source] First major contribution to Apache Airflow – Databricks SQL Sensor for Airflow. :sparkles:
May 2, 2022 [Update] Joined Databricks as Staff Software Engineer and Data Engineering Team Lead for Security.

latest posts