Senior Data Engineer (Databricks / PySpark / Azure / Java)

Job Summary: Looking for a developer who has hands on experience with Databricks/Pyspark , Java/ python, Webservices and SQL. Position is long term and will likely be renewed annually.

Minimum Qualifications and Job Requirements:

• Must be a team player.
• Must have at least 5 years of IT development experience.
• Must have strong analytical and problem-solving skills.
• Must have experience in designing solutions, performing code reviews, mentoring junior engineers.
• Must have strong SQL and backend experience, and working on data driven projects

Must have following experience:

• Python/PySpark
• SQL/ PL/SQL
• Databricks
• Java/C#

Preferred to have following experience:

• Azure
• Kafka
• Node JS
• Azure Data Factory

Other Responsibilities:

• Document and maintain project artifacts.
• Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.
• Promptly report any known or suspected loss, theft or unauthorized disclosure or use of PI to the General Counsel/Chief Compliance Officer or Chief Information Officer.
• Safeguard the company’s assets.
• Adhere to the company’s compliance program.
• Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.
• Maintain focus on customer-service, efficiency, quality, and growth.
• Collaborating with additional team members
• Other duties as assigned.
  

Required Skills: Python, PySpark, Databricks, Spark, Advanced SQL/PLSQL, Java or C#, REST APIs, data pipeline development, backend systems, and strong analytical skills.