MongoDB DataBricks

Join our innovative team at Talent Worx as a Data Engineer, where you will play a crucial role in transforming our data architecture. Your expertise in Dremio, SQL, and MongoDB will be instrumental in building robust data pipelines and ensuring the smooth flow of information across the organization.

• Experience: 5 to 10 years
• Location: Pan India

Requirements

Key Responsibilities:

1. Design and implement data models, pipelines, and workflows using Dremio, SQL, and MongoDB.

2. Collaborate with data scientists and analysts to understand data requirements and deliver scalable solutions.

3. Optimize queries and data processes to improve data retrieval performance and reduce latency.

4. Ensure data quality and integrity by establishing best practices for data management.

5. Monitor and troubleshoot data pipelines, resolving issues as they arise.

6. Automate ETL processes for data extraction, transformation, and loading from various sources.

7. Maintain documentation for data architecture and procedures.

8. Keep up to date with industry trends and new technologies in data engineering.

9. Work closely with the IT team to ensure database security and compliance with regulations.

Technical Skills:

- Proficiency in Dremio and experience with SQL and MongoDB.

- Familiarity with data warehousing concepts and tools.

- Strong understanding of ETL processes and data integration techniques.

- Experience with cloud platforms and database services is a plus.

- Familiarity with programming languages such as Python or Java is advantageous.

- Strong analytical skills and the ability to solve complex data problems.

Required Qualifications:

1. Bachelor’s degree in Computer Science, Engineering, or a related field.

2. 5 to 8 years of experience in data engineering roles focusing on Dremio, SQL, and MongoDB.

3. Demonstrated ability to work collaboratively in a fast-paced environment.

4. Excellent communication and documentation skills.

Benefits

Work with one of the Big 4's in India