Senior Data Engineer
About Us
Abacus Insights is changing the way healthcare works for you. We’re on a mission to unlock the power of data so health plans can enable the right care at the right time—making life better for millions of people. No more data silos, no more inefficiencies. Just smarter care, lower costs, and better experiences.
Backed by $100M from top VCs, we’re tackling big challenges in an industry that’s ready for change. And while GenAI is still new for many, we’ve already mastered turning complex healthcare data into clear, actionable insights. That’s our superpower—and it’s why we’re leading the way.
Abacus, innovation starts with people. We’re bold, curious, and collaborative—because the best ideas come from working together. Ready to make an impact? Join us and let's build the future, together.
- Design and implement secure, high-performance cloud data solutions on AWS, Azure, and Databricks that comply with US healthcare standards (HIPAA/HITECH).
- Build and optimize scalable ELT/ETL pipelines using Airbyte, Databricks (PySpark), dbt, and SQL; ensure cost efficiency and performance tuning.
- Develop and deploy production-grade PySpark, Python, and SQL code through CI/CD frameworks; enforce best practices via code reviews and design critiques.
- Troubleshoot and resolve data pipeline issues, perform root-cause analysis, implement preventive measures, and maintain detailed documentation.
- Drive technical excellence by mentoring team members, setting engineering standards, and influencing roadmap priorities for strategic technical investments.
- Ensure data integrity and governance by managing data lake ingestion from diverse sources, implementing security controls, and validating data quality.
- Collaborate cross-functionally with product managers, architects, and end users to deliver reliable, compliant, and business-aligned data solutions.
- Bachelor's degree, preferably in Computer Science, Computer Engineering, or related IT discipline.
- 4+ years of commercial software development experience; 3+ years of building or using cloud services in a production environment (AWS, Azure, GCP, etc.), building ETL data pipelines at scale with Spark/PySpark and Databricks
- Strong programming skills (Python, Java, or other OOP Languages).
- Go-getter with self-starter mindset.
- Someone who stays current with emerging technologies and development techniques
- Excellent oral and written communication skills; strong analytical, problem solving, organization and prioritization skills
- Standard hours: 9 hours/day; 5 days/week
- Location: On-Site
- Work time: 10 AM -7 PM
Our Commitment as an Equal Opportunity Employer
As a mission-led technology company helping to drive better healthcare outcomes, Abacus Insights believes that the best innovation and value we can bring to our customers comes from diverse ideas, thoughts, experiences, and perspectives. Therefore, we dedicate resources to building diverse teams and providing equal employment opportunities to all applicants. Abacus prohibits discrimination and harassment regarding race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.
At the heart of who we are is a commitment to continuously and intentionally building an inclusive culture—one that empowers every team member across the globe to do their best work and bring their authentic selves. We carry that same commitment into our hiring process, aiming to create an interview experience where you feel comfortable and confident showcasing your strengths. If there’s anything we can do to support that—big or small—please let us know.
Sponsored
