Software Engineer - Back End
$130k - $250k USD
About Distyl AI
Distyl AI develops production-grade AI systems to power core operational workflows for Fortune 500 companies. Powered by a strategic partnership with OpenAI, in-house software accelerators, and deep enterprise AI expertise, we deliver working AI systems with rapid time to value – within a quarter.
Our products have helped Fortune 500 customers across diverse industries, from insurance and CPG to non-profits. As part of our team, you will help companies identify, build, and realize value from their GenAI investments, often for the first time. We are customer-centric, working backward from the customer’s problem and holding ourselves accountable for creating both financial impact and improving the lives of end-users.
Distyl is led by proven leaders from top companies like Palantir and Apple and is backed by Lightspeed, Khosla, Coatue, Dell Technologies Capital, Nat Friedman (Former CEO of GitHub), Brad Gerstner (Founder and CEO of Altimeter), and board members of over a dozen Fortune 500 companies.
What We Are Looking For
As a Software Engineer Back Endyou will help design, build, and optimize Distillery—our AI-native platform that powers real-world enterprise AI systems for diverse F500 workflows.
Your role will involve developing scalable AI infrastructure, ensuring system reliability, and collaborating with engineers and business leaders to solve some of the most complex AI deployment challenges.
Key Responsibilities
Build & Scale AI-Native Infrastructure: Develop and refine a platform where AI builds, optimizes, and operates AI-powered workflows. Define how AI automation integrates into traditional enterprise infrastructure.
Develop Cloud-Native Microservices & Scalable AI Systems: Design and build secure, high-performance backend services deployed across AWS/GCP/Azure or on-prem Kubernetes environments. Build using Python, FastAPI, SQLAlchemy, Alembic, and modern DevOps tools to develop scalable, reliable AI infrastructure.
Optimize System Performance & Reliability: Ensure high-availability, security, and observability of AI-native workflows. Implement best practices for ML/AI Ops, distributed computing, and scalable service orchestration.
Collaborate with Cross-Functional Teams: Partner with Forward-Deployed Engineers (FDEs), AI Researchers, and business SMEs to translate real-world operational needs into platform capabilities. Advocate for strong software engineering and DevOps practices, driving high coding standards and scalable architectures.
Who You Are
We are hiring multiple roles across different levels of seniority (3-10+ years of software engineering experience)
Proficiency in Backend & Systems Engineering. Expertise in Python, Java, Golang, or C++ for building scalable, high-performance systems
Hands-on experience with Kubernetes, CI/CD, cloud platforms (AWS, GCP, or Azure), and infrastructure as code
Strong interest in AI-native development, leveraging tools like ChatGPT, Claude, Perplexity, and Cursor in engineering workflows
Experience with security, distributed systems, storage, ML/AI Ops, and large-scale observability is a plus
Travel: Ability to travel 10-20%
What We Offer
The base salary range for this role is $130K – $250K, depending on experience, location, and level. In addition to base compensation, this role is eligible for meaningful equity, along with a comprehensive benefits package
100% covered medical, dental, and vision for employees and dependents
401(k) with additional perks (e.g., commuter benefits, in‑office lunch)
Access to state‑of‑the‑art models, generous usage of modern AI tools, and real‑world business problems
Ownership of high‑impact projects across top enterprises
A mission‑driven, fast‑moving culture that prizes curiosity, pragmatism, and excellence
Distyl has offices in San Francisco and New York. This role follows a hybrid collaboration model with 3+ days per week (Tuesday–Thursday) in‑office.
We’re grateful for the strong interest in this role. The best way to get your profile in front of our team is to apply directly through our careers page, where all applications are reviewed. Due to the high volume of interest, we’re not able to review or respond to all direct emails or LinkedIn messages. We will be in touch with every applicant once we’ve completed our review, regardless of the decision.