Azure Data Engineering

• Experience in setting up data pipelines in Azure.
• Experience with Azure Data Factory
• Experience with setting up Azure Data Lake with structured/unstructured data.
• Candidate needs to be a self-starter and should be able to design, develop and deliver solution without much assistance or supervision.
• Strong knowledge of Azure services - Storage (AFS, Blob, Data Lake), Azure Functions.
• Strong knowledge of database - Should be able to write complex queries, schema design.
• Ability to set up CI/CD pipelines in Azure through GitHub.

Qualifications

• Bachelor’s or master’s degree in computer science, Information Technology
• Experience with batch job scheduling and identifying data/job dependencies.

• Preferred Skills:

• Proficiency in data warehousing, ETL, and big data processing.
• Familiarity with the Pharma domain is a plus.