Data Architect
Data Architect
Bangalore | Hyderabad | Chennai | Pune | Delhi NCR | Mumbai
Employment Type: FTE / Permanent
Data Architect | 15 + Years Exp | Notice Period: 0 - 60days| WFO
We are looking for a Data Architect with 15 + years of experience to lead and mentor data engineers along with hands on experience well in Lakehouse Architecture, ELT/ETL pipelines using Databricks, Pyspark, SQL and Notebooks
Key Responsibilities
* Design and implement Medallion Architecture (Bronze/Silver/Gold) using Delta Lake
* Design end-to-end Lakehouse architecture across ingestion, transformation, modelling and consumption
* Build and optimize ETL/ELT pipelines using Databricks, PySpark, SQL and Notebooks
* Define ingestion standards including CDC, incremental loads and streaming
* Design batch and streaming pipelines using Kafka and related technologies
* Perform advanced Spark optimization and cluster sizing
* Implement CI/CD, version control and DevOps practices within Databricks
* Establish logging, monitoring and error-handling frameworks
* Strong experience with AWS – S3, Glue, IAM, KMS and CloudWatch
* Implement Data Governance & Data Lineage using Glue Catalog, Unity Catalog, etc.
* Conduct technical testing before UAT and provide Bronze-layer sign-off
* Review architectures and guide implementation teams
* Mentor Data Engineers and Analytics Developers
Good to Have Skills
-
* Clinical Research Data domain experience
* FinOps / licensing optimization experience
