DataBricks Consultant- Onshore (B)
Job Title: Principal Databricks Consultant (Enterprise Solution Architect)
Location: Remote
Employment Type: Contract
Experience Level: 10+ Years
The Opportunity
We are seeking a Principal Databricks Consultant with a deep background in Solution Architecture to lead large-scale digital transformations for our enterprise clients. In this role, you won't just build pipelines; you will architect the future of Data Lakehouse ecosystems, bridging the gap between high-level business strategy and technical execution.
What You’ll Do
- Architect at Scale: Design and deploy global-scale Lakehouse architectures using the Databricks Data Intelligence Platform.
- Strategic Advisory: Act as the primary technical liaison for C-suite stakeholders, translating business goals into architectural blueprints.
- Govern & Secure: Implement enterprise-grade security and governance frameworks via Unity Catalog.
- Optimize Performance: Audit and tune complex Spark clusters and SQL warehouses to maximize ROI and minimize cloud spend.
- Lead Innovation: Support the adoption of Generative AI and MLOps workflows using MLflow and Mosaic AI.
Your Technical Toolkit
- The Core: Expert-level mastery of Apache Spark, Delta Lake, and PySpark/Scala.
- Cloud Proficiency: Deep experience architecting on AWS, Azure (ADLS/Synapse), or GCP.
- DevOps/IaC: Proven experience automating environments with Terraform, Jenkins, or GitHub Actions.
- Data Modeling: Expert knowledge of Medallion architecture (Bronze/Silver/Gold) and Data Vault or Star Schema modeling.
Requirements
- Experience: 10+ years in Data Engineering/Architecture, with 4+ years specifically focused on Databricks-led solutions at the enterprise level.
- Education: BS/MS in Computer Science, Data Science, or equivalent.
- Certifications: Databricks Solutions Architect Professional or Databricks Champion status is a significant plus.
- Soft Skills: Exceptional presentation skills; ability to explain "the why" behind technical decisions to non-technical audiences.