Lead Data Engineer
Role Overview
We are looking for a skilled Data Engineer with strong expertise in cloud-based data platforms, data engineering frameworks, and modern programming languages. The ideal candidate will have hands-on experience with Azure, Databricks, and large-scale data processing using Python and PySpark. This role requires strong collaboration with stakeholders and the ability to manage programs and deliver scalable data solutions.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Python, PySpark, and SQL.
- Build and optimize data workflows on Azure Cloud using Databricks.
- Develop and implement efficient data models to support analytics and reporting requirements.
- Write optimized SQL queries for data transformation, integration, and analysis.
- Collaborate with cross-functional teams to gather data requirements and translate them into technical solutions.
- Work closely with stakeholders to ensure data solutions align with business objectives.
- Develop and maintain components using TypeScript where required for data platform integrations.
- Ensure data quality, reliability, and performance across the data ecosystem.
- Lead or support program management activities, including planning, execution, and delivery of data initiatives.
Required Skills
- Strong programming skills in Python, PySpark, and SQL.
- Hands-on experience with Azure Cloud Platform.
- Experience working with Azure Databricks for large-scale data processing.
- Solid understanding of data modeling concepts and data architecture.
- Proficiency in SQL programming and query optimization.
- Experience with TypeScript development.
- Strong stakeholder management and communication skills.
- Experience in program management or managing complex data initiatives.
Preferred Qualifications
- Experience working with large-scale data platforms and modern data architectures.
- Familiarity with data warehousing and analytics solutions.
- Ability to work in a fast-paced, collaborative environment.