Big Data Engineer

This role is for one of the Weekday's clients

Salary range: Rs 600000 - Rs 1900000 (ie INR 6-19 LPA)

Min Experience: 4 years

JobType: full-time

We are looking for an experienced Big Data Engineer with strong expertise in real-time streaming systems and large-scale data processing. This role focuses on building high-performance, low-latency streaming pipelines using Java and modern big data technologies. You will work on complex, scalable systems in a high-velocity engineering environment.

Requirements

Key Responsibilities

• Design, build, and optimize large-scale real-time streaming data pipelines.
• Develop robust data ingestion and processing frameworks using Apache Spark Streaming or Hadoop streaming tools.
• Use Java to implement performant, production-ready distributed systems.
• Ensure low latency, high throughput, scalability, and fault tolerance across streaming workflows.
• Collaborate with product, data, and engineering teams to integrate streaming pipelines into core platforms.
• Diagnose, troubleshoot, and improve streaming system performance and reliability.

Required Skills & Qualifications

• 4+ years of experience as a Big Data Engineer.
• Strong command of real-time streaming technologies (Kafka, Spark Streaming, Flink, or similar).
• Advanced proficiency in Java for core development.
• Hands-on experience with Hadoop or Apache Spark (streaming use cases only).
• Solid understanding of distributed systems and scalable architecture patterns.
• Experience in monitoring, tuning, and debugging streaming pipelines.
• Background working in high-scale or big-tech engineering environments.

Nice to Have

• Experience with cloud ecosystems (AWS, GCP, or Azure).
• Knowledge of microservices, Docker, Kubernetes, or container orchestration.
• Familiarity with CI/CD pipelines and DevOps workflows.