Senior Data Engineer – Build Governed Data Foundations

About the role

Arionkoder is seeking a Senior Data Engineer to design and maintain a governed data foundation on Databricks that powers AI agents, applications, and business teams across LATAM. You will own the creation of certified tables, entity reconciliation, access control, and the APIs that expose data with proper permissions.

Key responsibilities

• Design, build, and operate ingestion and ETL pipelines from ERP, CRM, product databases and document repositories into Databricks.
• Implement entity models, resolve identifiers across systems, and certify business facts with source, validity period and provenance.
• Enforce data governance policies, including row‑level security, column masking and role‑based access, and create isolation tests for external consumers.
• Develop APIs, webhooks and MCP tools that deliver deterministic, permission‑aware data to downstream applications.
• Collaborate with solution architects, AI engineers, full‑stack engineers and client data platform teams, handing over built assets for production use.

Required profile

• 6+ years of professional data engineering experience building production‑grade pipelines and data models.
• 3+ years hands‑on with Databricks in production, including Unity Catalog.
• Strong data modeling expertise (SCD Type 2, temporal validity, provenance) and data‑quality discipline (dbt tests, Great Expectations or similar).
• Proven ability to implement access control in production and to distinguish platform‑level from application‑level enforcement.
• Comfort working fully remote, autonomously challenging unclear definitions and delivering outcomes without micromanagement.

Required skills

• Databricks (Unity Catalog)
• SQL
• Python
• Spark / PySpark
• Data modeling (history‑aware, SCD Type 2)
• Data quality tools (dbt, Great Expectations)
• CI/CD for data pipelines
• Change data capture / streaming frameworks
• Row‑level security, column masking, role‑based access
• API design and implementation
• AI coding assistants (Claude, Cursor or similar)

What we offer

• Monthly USD service fee
• 20 business days paid time off plus local holidays
• Caregiver time off
• Fully remote work culture – work from anywhere
• Entrepreneurial, fast‑moving environment