Senior Data Center Operations System Engineer - Los Angeles, CA
Lambda, The Superintelligence Cloud, is a leader in AI cloud infrastructure serving tens of thousands of customers. Our customers range from AI researchers to enterprises and hyperscalers. Lambda's mission is to make compute as ubiquitous as electricity and give everyone the power of superintelligence. One person, one GPU.
If you'd like to build the world's best AI cloud, join us.
*Note: This position requires presence in our Vernon Data Center 5 days per week, and 30% out-of-state travel to other data center sites.
What You'll Do
Ensure new server, storage and network infrastructure is properly racked, labeled, cabled, and configured.
Troubleshoot hardware and software issues in some of the world’s most advanced GPU and Networking systems.
Document and update data center layout and network topology in DCIM software.
Work with supply chain & manufacturing teams to ensure timely deployment of systems and project plans for large-scale deployments.
Manage a parts depot inventory and track equipment through the delivery-store-stage-deploy-handoff process in each of our data centers.
Partner with HW Support teams to ensure data center hardware incidents with higher level troubleshooting challenges are resolved, reported on and solutions are disseminated to the large operations organization.
Work with the RMA team to ensure faulty parts are returned and replacements are ordered.
Follow installation standards and documentation for placement, labeling, and cabling to drive consistency and discoverability across all data centers.
Improve installation standards, MOPs, and runbooks.
Act as a technical escalation point for DC infrastructure issues.
Participate in an on-call rotation, serving as an escalation point for data center incidents.
You
Have strong experience with critical infrastructure systems supporting data centers, such as power distribution, air flow management, environmental monitoring, capacity planning, DCIM software, structured cabling, and cable management.
Are familiar with carrier DIA circuit test and turn ups, understanding LOA’s, and fiber testing and troubleshooting.
Have a solid understanding of cable, fiber, and optics and their different use cases.
Solid understanding of single and three phase power theories including PDU balancing and why it is important.
Base level network fundamentals (CCNA preferred but not required)
Knowledge of cold aisle and hot aisle containment.
Solid understanding of server hardware and boot process (PXE, DHCP, & TFTP)
Work with product management, support, and other teams to align operational capabilities with company goals.
Translating business priorities into technical and operational requirements.
Supporting cross-functional projects where infrastructure plays a critical role.
Are action-oriented and willing to train junior staff on best practices.
Are willing to travel to bring up new data center locations as needed.
Nice to Have
Have 3+ years experience with critical infrastructure systems supporting data centers, such as power distribution, air flow management, environmental monitoring, capacity planning, DCIM software, structured cabling, and cable management
Experience with/or knowledge of network topology and configurations and 400gb Infiniband architectures.
Experience with project management.
Have 3+ years working with and reporting from a ticketing systems like Service Now, JIRA, and Zendesk
Experience with Linux administration.
Experience with High Performance Compute GPU systems (air or water cooled) - especially Nvidia NVL72.
Experience with troubleshooting the following network layers, technologies, and system protocols: TCP/IP, DP/IP, BGP, OSPF, SNMP, SSL, HTTP, FTP, SSH, Syslog, DHCP, DNS, RDP, NETBIOS, IP routing, Ethernet, switched Ethernet, 802.11x, NFS, and VLANs.
Salary Range Information
The annual salary range for this position has been set based on market data and other factors. However, a salary higher or lower than this range may be appropriate for a candidate whose qualifications differ meaningfully from those listed in the job description.
About Lambda
Founded in 2012, with 500+ employees, and growing fast
Our investors notably include TWG Global, US Innovative Technology Fund (USIT), Andra Capital, SGW, Andrej Karpathy, ARK Invest, Fincadia Advisors, G Squared, In-Q-Tel (IQT), KHK & Partners, NVIDIA, Pegatron, Supermicro, Wistron, Wiwynn, Gradient Ventures, Mercato Partners, SVB, 1517, and Crescent Cove
We have research papers accepted at top machine learning and graphics conferences, including NeurIPS, ICCV, SIGGRAPH, and TOG
Our values are publicly available: https://lambda.ai/careers
We offer generous cash & equity compensation
Health, dental, and vision coverage for you and your dependents
Wellness and commuter stipends for select roles
401k Plan with 2% company match (USA employees)
Flexible paid time off plan that we all actually use
A Final Note:
You do not need to match all of the listed expectations to apply for this position. We are committed to building a team with a variety of backgrounds, experiences, and skills.
Equal Opportunity Employer
Lambda is an Equal Opportunity employer. Applicants are considered without regard to race, color, religion, creed, national origin, age, sex, gender, marital status, sexual orientation and identity, genetic information, veteran status, citizenship, or any other factors prohibited by local, state, or federal law.