Perception Engineer
At TerraFirma, we’re redefining how the world moves earth for construction. Founded by former SpaceX engineers and backed by Bain Capital Ventures, TerraFirma is automating construction to make it faster, cheaper, and safer.
Our Story & Mission
At SpaceX, we were part of the teams that built the largest rocket in human history, launched the largest constellation of satellites ever made, and delivered connectivity to millions of people worldwide. What we learned was simple: infrastructure is everything.
At Starbase, the biggest barrier to launching missions to Mars was not building the rocket. It was how slow, expensive, and complex it was to build the infrastructure around it. We lacked buildings, roads, water, power, communications, and waste management, and constructing them took far more time and resources than it should have.
From a first-principles perspective, that doesn't make sense. It shouldn't be this hard or costly to create the foundations for progress. That’s when we realized something important: the same engineering mindset that enabled us to tackle space exploration and mass manufacturing could be applied to infrastructure. By bringing the principles of simplification, iteration, acceleration, and automation to construction, we can unlock a new era in how the world builds.
Accelerating infrastructure unlocks progress across every domain, creating a self-sustaining engine for tackling humanity’s toughest challenges. The innovations we develop on Earth will lay the groundwork for the technologies that one day make settlement on Mars possible.
Job Overview
You will design and implement the perception systems that give our automated heavy machinery the awareness needed to operate effectively in complex, unstructured environments. This role combines high-level architecture decisions with hands-on algorithm development, hardware integration, and field testing. You will work across the perception stack, from integrating and calibrating advanced sensors to building real-time processing pipelines for images, point clouds, and other high-bandwidth data streams. Your work will power critical functions such as collision avoidance, motion planning, localization, and operator visualization.
Responsibilities
Integrate multi-spectral and TOF sensors into robotic systems with real-time processing constraints
Work with motion and trajectory planning teams to design and synthesize sensor systems to extract required signals and inputs
Implement algorithms to efficiently detect objects of interest from incoming data streams for the purposes of collision avoidance, motion planning, and trajectory planning
Stitch together and manipulate camera feeds and data from other sensors to effectively visualize the state of physical systems to human operators
Develop real-time pipelines for processing, sharing, and fusing data from multiple sensor sources
Train Machine Learning (ML) models on existing and custom datasets and support collection and labeling of data for additional training and validation
Develop simulation and visualization tools to aid in rapid prototyping of robotic software and control algorithms
Own the integration, calibration, and testing of sensors, both for proof-of-concept prototypes and production systems
Lead interdisciplinary teams, mentor new employees, and actively participate in the hiring process
Basic Qualifications
B.S. in Robotics, Mechanical Engineering, Physics, Computer Science, Electrical Engineering, or a closely related field
2+ years of professional or project experience with robotic software development, involving implementation of real-time algorithms for perception and data processing pipelines
Demonstrated experience owning large-scale deliverables, leading teams, and driving product roadmaps
Preferred Skills & Experience
Experience working with safety-critical or real-time systems
Experience working with embedded applications for robotics, autonomous vehicles, aerospace, automotive, or construction
Proficiency in C++ and Python, including development for Linux-based systems and bare-metal MCUs
Experience training, testing, optimizing, and deploying online and offline machine learning models with existing and custom datasets
Experience implementing algorithms or pipelines for robotic systems or feedback control from scratch in C++ or Python
Experience performing object detection on multiple data sources including multi-spectral images and point clouds
Experience programming FPGAs for high-throughput networking, compression, or DSP
Additional Requirements
Must be willing to work extended hours or weekends when needed to support critical deadlines or triage urgent deployment issues
Comfortable with working in a fast-paced startup environment
Must be willing to relocate to Austin, TX if not within commuting distance
Compensation & Benefits
Base compensation will vary based on factors such as relevant experience and education. Salaries and leveling will be determined on a case-by-case basis if an offer is extended. Our total compensation package also includes equity in TerraFirma. Relocation packages are available to help cover moving costs, if applicable.