Resum del rol
Publicat via Mainder
We are looking for a Data Architect to lead the design and evolution of a modern cloud data platform built on Azure and Databricks.
This is a senior, hands-on architecture role responsible for defining platform standards, designing scalable lakehouse architectures, and ensuring the reliability and performance of data pipelines and streaming workloads. The ideal candidate combines strong architectural thinking with deep hands-on expertise and is comfortable both designing complex solutions and implementing them directly within the platform.
You will work closely with data engineering teams and technical stakeholders to establish best practices across the data platform, guide architectural decisions, and ensure the environment supports scalable analytics, real-time processing, and reliable data delivery across the organization.
Lead the design and documentation of Databricks platform architecture, including lakehouse patterns, data zones, and compute strategies.
Define architectural standards for Delta Live Tables (DLT) and declarative pipeline development, including pipeline topology, table materialization strategies, and environment promotion patterns.
Design serverless and classic cluster strategies, including compute configuration, autoscaling policies, and cost optimization approaches.
Architect streaming data pipelines using Databricks Structured Streaming and Delta Live Tables, ensuring reliability, scalability, and low-latency processing.
Establish best practices for Azure integration within the Databricks ecosystem, including ADLS Gen2, Unity Catalog governance, Key Vault secrets management, and network security configurations.
Define and maintain data modeling standards aligned with medallion architecture (Bronze, Silver, Gold).
Implement and optimize Delta Lake performance strategies, including file compaction, Z-ordering, clustering, and schema evolution management.
Conduct architectural reviews of data pipelines and platform components, providing technical guidance and enforcing standards across the engineering team.
Partner with technical stakeholders to ensure platform architecture aligns with enterprise data and technology strategy.
Identify and address architectural risks, performance bottlenecks, and technical debt proactively.
Produce architecture documentation, including solution design documents, data flow diagrams, and platform runbooks.
Serve as the technical escalation point for complex data platform and performance issues.
7+ years of experience in data engineering, data platforms, or analytics infrastructure, including at least 3 years in a data architecture role.
Deep hands-on expertise with Databricks, including platform architecture and pipeline implementation.
Strong experience building and managing Delta Live Tables (DLT) pipelines, including expectations frameworks, CDC processing, and table materialization strategies.
Advanced knowledge of Databricks compute strategies, including serverless compute and cluster configuration for different workload types.
Strong experience designing streaming architectures using Databricks Structured Streaming.
Expertise in Delta Lake architecture and optimization, including transaction logs, schema evolution, time travel, and performance tuning.
Strong knowledge of Azure cloud services used within modern data platforms, including ADLS Gen2, Azure Databricks, Key Vault, and monitoring tools.
Experience translating business and technical requirements into scalable data platform architectures.
Strong communication skills with the ability to present architectural decisions to both technical and business stakeholders.
Databricks certifications such as Databricks Certified Data Engineer Professional or Associate Developer for Apache Spark.
Microsoft certifications such as Azure Data Engineer Associate or Azure Solutions Architect Expert.
Experience implementing Unity Catalog governance and data access management.
Familiarity with dbt for transformation management on Databricks.
Experience designing Power BI semantic layers integrated with lakehouse architectures.
Background working in large-scale enterprise data environments.
People First culture.
Free access to streaming platforms.
Free access to Spotify premium.
GYM discount.
Legal and accountant advise.
Travel discount.
E-Learning discount.
We are a young and fast-growing recruiting company with five years of experience working across Latin America and the United States. We partner closely with teams and founders to help them build strong, high-impact teams through recruitment, outsourcing, and team-building services.
Our culture is built on effective communication, trust, and transparency. We believe great work happens when people feel heard, supported, and empowered to grow. Today, our team is made up of more than 50 professionals working across different projects throughout the region, collaborating remotely and learning from each other every day.