Senior Data Engineer

About the role

Coderio is seeking a Senior Data Engineer to design, build, and optimise high‑performance data platforms that handle large volumes of financial and transactional data. You will work with a global client base, collaborating closely with data scientists, software engineers, and product managers to deliver reliable, scalable solutions.

Key responsibilities

• Design, develop, and maintain batch and streaming pipelines for ingesting and processing financial transactions from diverse sources.
• Scale and optimise cloud data‑warehouse and lakehouse architectures (e.g., Delta Lake, Snowflake, Redshift, BigQuery).
• Implement data‑quality frameworks, automated testing, monitoring, and alerting to meet SLA and compliance requirements.
• Drive DataOps practices, including CI/CD, workflow automation, and Infrastructure as Code for data systems.
• Champion data governance, privacy, and security standards, ensuring GDPR/LGPD compliance.
• Mentor junior and mid‑level engineers, promoting best practices and modern architectural patterns.

Required profile

• 5+ years of experience in data engineering, big data, or related software engineering roles.
• Proven track record managing production‑grade, high‑volume data systems in fast‑paced environments.
• Strong problem‑solving skills and ability to translate business needs into technical solutions.

Required skills

• Python, SQL (and optionally Scala or Java).
• Apache Spark / PySpark, Delta Lake, Data Mesh concepts.
• AWS services: S3, Glue, Athena, EventBridge, Firehose, Lambda.
• Data orchestration tools: Apache Airflow or similar.
• Data‑warehouse platforms: Snowflake, AWS Redshift, Google BigQuery.
• Streaming technologies: Apache Kafka, AWS Kinesis.
• Data transformation tools: dbt.
• DevOps/DataOps: Git, Docker, CI/CD pipelines (GitHub Actions, GitLab CI), Infrastructure as Code.