Staff software Engineer

This role is for one of the Weekday's clients

Min Experience: 9 years

Location: India

JobType: full-time

We are looking for an experienced Staff Software Engineer to play a critical role in designing, building, and scaling next-generation data lake and query processing platforms. This role is ideal for a hands-on technical leader who thrives in complex, distributed systems and enjoys solving large-scale data challenges. You will work closely with platform, infrastructure, and product teams to deliver high-performance, reliable, and scalable data systems that power analytics, real-time processing, and business intelligence across the organization.

As a Staff Engineer, you will influence architectural decisions, drive technical excellence, and mentor senior engineers while remaining deeply involved in coding and system design.

Requirements

Key Responsibilities

• Design, develop, and evolve large-scale data lake architectures supporting batch and real-time workloads.
• Build and optimize query engines for high-throughput, low-latency analytics over massive datasets.
• Lead the implementation and optimization of Apache Iceberg for table management, schema evolution, partitioning, and transactional consistency.
• Design and maintain streaming and event-driven systems using Kafka, ensuring fault tolerance, scalability, and data reliability.
• Develop high-performance backend services and data processing components using Java, Scala, and C++.
• Drive architectural reviews and make data-driven decisions around storage formats, indexing strategies, and query execution plans.
• Collaborate closely with data engineers, infrastructure teams, and product stakeholders to translate business needs into scalable technical solutions.
• Ensure system reliability through robust testing, monitoring, and performance tuning.
• Mentor and guide engineers across teams, setting best practices for coding, system design, and operational excellence.
• Take ownership of complex technical problems and lead them from design through production deployment.

Required Skills & Qualifications

• 9–13 years of experience in software engineering with a strong focus on distributed systems and data platforms.
• Deep expertise in Data Lake technologies and large-scale data processing architectures.
• Strong hands-on experience with Apache Iceberg, including table formats, metadata management, and performance optimization.
• Solid understanding of query engines (distributed SQL engines, query planners, execution frameworks).
• Extensive experience with Kafka and streaming data pipelines.
• Excellent programming skills in Java and Scala; strong proficiency in C++ for performance-critical systems.
• Strong knowledge of concurrency, memory management, and performance tuning in distributed environments.
• Experience working with cloud-based or on-premise big data ecosystems.

Nice to Have

• Experience with open-source contributions in data or query systems.
• Exposure to other table formats or query engines (e.g., Hive, Presto, Trino, Spark).
• Strong system design and technical leadership background.