Senior / Staff AI Software Engineer

About Caregentic

Caregentic is transforming how healthcare organizations deliver patient care in the real world by developing a modern platform with AI-powered patient engagement. We’re solving complex challenges in patient care with sophisticated technology: Care journey orchestration, health data integration, and clinical workflows. We relieve healthcare providers of daily frustrations, so they can focus on what matters most: caring for patients.

Founded by a team that understands both the technical challenges and clinical realities of modern healthcare, we're co-developing a platform with leading health systems like Northwell Health, giving us access to real-world feedback and validation from day one. This unique partnership means our work is refined and improved in real clinical environments.

We're at an exciting inflection point — our early customers are seeing measurable improvements in care delivery and operational efficiency, and we’re ready to grow our team with an experienced, senior engineer who can help scale our impact in the industry.

About the Job

As a Senior or Staff AI Software Engineer at Caregentic, you will have end-to-end ownership of key parts of our backend services architecture and our AI-drive applications. You will work on our modern micro-service architecture, built with Python 3.12, FastAPI, Strawberry GraphQL, and event-driven design principles.

You will be responsible for building scalable, resilient systems that drive real impact in patient care while also helping shape the technical direction of the platform and mentoring other engineers. Our team operates with the urgency that healthcare demands, and we never lose sight that our work directly impacts patient lives.

We’ve been a fully remote team from the start, distributed across the U.S. We believe that great engineering happens wherever people do their best work.

Our Tech Stack:

• Python 3.12, FastAPI, Strawberry GraphQL
• PostgreSQL with asyncpg and SQLAlchemy
• Procrastinate (background jobs) and Apache Kafka
• Docker, Kubernetes, AWS (S3, Cognito, SES, etc.)
• Apollo Federation (GraphQL gateway)
• React and TypeScript web frontend
• Rasa (fork) with spaCy 3, Rasa SDK (custom action server)
• LangChain, LangChain, AWS Bedrock, LangSmith (tracing/evals)
• Vector search: Databricks Vector Search

What You'll Do:

• Design and develop robust, scalable, event-driven services using Python, FastAPI, Apache Kafka and GraphQL.
• Build fundamental LLM agents and integrate them into our product.
• Work with DevOps on deployments, monitoring, and reliability improvements.
• Maintain and optimize PostgreSQL databases and data models.
• Collaborate across product and engineering teams to define requirements and architect features.
• Drive engineering best practices through code reviews and mentorship.
• Engage with current and prospective clients to drive understanding of the Caregentic AI architecture and capabilities.
• Design, build, and operate LLM services, including RAG systems (LangChain), agentic workflows, and evaluation pipelines (LangSmith, deepeval, A/B testing).
• Own vector search & embeddings pipelines from schema and metadata design to model benchmarking, cost/latency optimization, and Databricks Vector Search integration.
• Lead conversational AI development enhancing NLU policies, safety guardrails, and custom action servers, plus integrating assistants with microservices.

What You'll Need:

• 7+ years of backend development experience in production environments, specifically strong Python skills, including async programming and type hints.
• Experience building and monitoring production-quality ML and AI systems.
• Hands-on expertise with RAG frameworks and agentic workflows. 
• Solid understanding of PostgreSQL database design and optimization.
• Familiarity with Docker and containerization.
• Strong testing practices using pytest.
• Experience with microservice architectures is preferred.
• Experience with GraphQL APIs.
• Experience with event-driven systems and message queues.
• Experience with major cloud providers (e.g., AWS).
• Shipped production LLM systems: ideally RAG architectures, agent/tool use, and prompt/system design, with LangChain (tracing/evals via LangSmith), embeddings, and vector databases (Databricks Vector Search preferred). Deep expertise in retrieval quality, including chunking, metadata, hybrid search, reranking, and grounding.

Bonus Points For:

• Experience with Strawberry GraphQL.
• Experience with Kafka, Procrastinate, or similar background job systems.
• Experience Apollo Federation or multi-service GraphQL experience.
• Healthcare or regulated industry experience (HIPAA, HL7, FHIR).
• Experience with Terraform or infrastructure-as-code.
• Experience with Kubernetes.
• Experience mentoring engineers or leading technical projects.
• Experience working with LangSmith tracing, AWS Bedrock, LangChain runnables.
• Experience maintaining forked open source repositories.
• Experience with managing conversation states in conversational agents - experience with LangGraph or similar.

What You'll Bring to the Table:

• Technical leadership: Ability to guide design decisions, and bring others along.
• End-to-end ownership: From technical design, through shipping code, and supporting it in production, you’ll take responsibility for the health of the platform.
• Product-minded approach: Combining technical excellence with pragmatic delivery.
• Strong communication skills, especially in cross-functional collaboration.
• Passion for improving healthcare through technology.

Benefits & Perks:

• Comprehensive healthcare coverage (medical, dental, vision).
• Time off: Flexible PTO policy with 20 vacation days and 5 sick days per year.
• Remote work environment.
• Top-tier development equipment.
• Opportunity to make a meaningful impact on healthcare delivery.

Salary Range:

• We offer a competitive compensation package, including:

  • $185,000 - $280,000 base salary, depending on previous experience and alignment with role expectations
  • Performance-based bonus
  • Equity participation in the company

Why Caregentic? Join us in building the next generation of healthcare technology that improves patient outcomes and transforms the industry!

Healthcare teams shouldn't have to wrestle with fragmented systems, duplicate data entry, or workflows that break down when they need them most. Our unified platform leverages AI to connect the dots between patient data, clinical protocols, and care coordination, automatically surfacing insights and streamlining processes to create seamless experiences that improve outcomes while reducing administrative burden.

At Caregentic, we believe the future of healthcare technology isn't about replacing human judgment, but amplifying it with intelligent automation. Our AI-driven platform learns from clinical patterns and workflows to make smart recommendations, automate routine tasks, and surface critical insights at exactly the right moment. Every line of code we write, every AI model we deploy, and every platform integration we create is designed with one goal: helping healthcare professionals provide better care more efficiently.

This is a rare opportunity to work on cutting-edge technology that directly impacts patient care, alongside a team that moves fast, learns from real clinical feedback, and builds with purpose. We're backed by top-tier health systems like Northwell Health, and we’re at a pivotal growth moment. We're building solutions hand-in-hand with clinicians and shipping into live care settings from day one.