Data Engineer

This role involves designing and building production data pipelines on Databricks using Spark Declarative Pipelines and PySpark, ensuring data quality, monitoring, and lineage. The position requires defining pipelines as code with automated CI/CD, optimizing performance and cost, and partnering with stakeholders to translate requirements into technical designs. The ideal candidate will mentor engineers and establish reusable frameworks to improve team delivery speed.