This role is for one of the Weekday's clients
Min Experience: 9 years
Location: India
JobType: full-time
We are seeking a highly skilled Staff Software Engineer with deep expertise in building and optimizing query engines and working with data lakes at scale. The ideal candidate is passionate about designing high-performance, scalable, and reliable systems, with a strong background in Java or Scala. This role is critical for shaping the architecture of our data platform and enabling analytics and data-driven decision-making across the organization.
Requirements
Key Responsibilities:
- Design, develop, and maintain query engines capable of processing large-scale datasets efficiently.
- Build and optimize data pipelines and integrations with data lakes to ensure high throughput and low latency.
- Collaborate with cross-functional teams including Data Engineering, Data Science, and Product Engineering to deliver scalable and performant solutions.
- Evaluate and implement new technologies, frameworks, and architectures to improve query performance, reliability, and maintainability.
- Lead system design discussions, ensuring technical decisions align with long-term business goals.
- Mentor and guide junior engineers, providing technical direction and best practices for software development and system design.
- Troubleshoot, analyze, and resolve complex issues in distributed systems, ensuring high availability and fault tolerance.
- Contribute to coding standards, architecture guidelines, and code reviews, promoting a culture of quality and innovation.
Required Skills & Qualifications:
- Experience: 9–13 years of professional software engineering experience, preferably in data-intensive environments.
- Programming: Proficient in Java or Scala, with a strong understanding of concurrent programming, memory management, and performance optimization.
- Query Engine Expertise: Hands-on experience in building, tuning, or maintaining query engines (e.g., Presto, Spark SQL, Hive, or similar).
- Data Lakes & Big Data: Solid experience working with data lakes and distributed storage systems (e.g., Hadoop, AWS S3, Azure Data Lake, GCP).
- Strong understanding of distributed systems, data modeling, and data processing frameworks.
- Proven ability to design scalable, fault-tolerant systems capable of handling petabyte-scale datasets.
- Excellent problem-solving, debugging, and analytical skills, with a focus on performance optimization.
- Experience mentoring and leading engineering teams, with a collaborative and proactive mindset.
Preferred Qualifications:
- Familiarity with modern ETL frameworks, stream processing, or batch processing architectures.
- Knowledge of cloud-based data services and infrastructure (AWS, Azure, GCP).
- Open-source contribution or active participation in data engineering communities is a plus.
Sponsored
Explore Engineering
Skills in this job
People also search for
Similar Jobs
More jobs at Weekday AI
Apply for this position
Sign In to ApplyAbout Weekday AI
At Weekday (backed by YC; also Product Hunt #1 product of the day), we are building the next frontier in hiring. We have built the largest database of white collar talent in India and have built outreach tools on top of it to generate highest response ...