Databricks & AWS Data Pipeline Engineering

This role involves architecting and scaling end-to-end data products using the Medallion Architecture on Amazon S3 and Delta Lake, leveraging PySpark, SQL, and Delta Live Tables for batch and streaming data. The position requires implementing data governance, security, and cost optimization within the AWS ecosystem while managing infrastructure as code and CI/CD pipelines. The ideal candidate will mentor engineers, establish coding standards, and ensure robust data testing and pipeline observability.