Submit

Senior Python Data Platform Engineer

Alfragide

Job description

About the Role

We are seeking a Senior Python Data Platform Engineer to join our integration engineering team powering our core Data Platform Service. Built on a tightly integrated modern stack consisting of AWS, Confluent Cloud, Kubernetes, and Snowflake, this platform serves as an operational data mesh. It delivers source- and consumer-aligned data products exposed via event streams, serverless REST APIs, and high-performance data stores to drive mission-critical, real-time transactional and operational workloads.

In addition to hands-on software development, you will serve as a technical pillar within the team—guiding technical standards, conducting rigorous code reviews, and acting as the primary backup to the lead developer.

​

What You Will Do

  • Microservices Development (Python & Kafka): Build, optimize, and maintain Python-based containerized event-processing services deployed as headless AWS ECS Fargate tasks consuming from Kafka.

  • Serverless API Engineering: Design, implement, and maintain scalable AWS Lambda functions exposing clean REST APIs for data product consumption, implementing robust API versioning and alias routing strategies.

  • Real-Time Data Integration: Connect high-throughput event pipelines using Confluent Cloud (Kafka) to feed operational data stores and analytical engines like Snowflake.

  • Architecture Backup & Code Quality: Partner closely with the lead developer as their primary backup, contributing to architectural decisions and enforcing high standards through active code reviews.

  • CI/CD & DevOps Standards: Maintain reliable deployment pipelines using advanced Git workflows, automated testing, and continuous integration practices.


Mandatory Requirements

  • Senior-Level Python Engineering:

    • Mastery of advanced object-oriented Python, classes, and metaprogramming.

    • Deep experience with data classes, type validation, and algorithmic design patterns.

    • Proven track record building REST APIs, AWS Lambda handlers, transformation services, and automation scripts.

  • Advanced Version Control & Delivery:

    • Strong expertise with Git workflows, merge requests, conventional commits, and CI/CD pipelines.

  • Data Platform & Database Foundations:

    • Solid practical experience with database operations (both relational and non-relational), database design, and advanced SQL.

    • Extensive experience handling semi-structured data structures (JSON, XML).


Preferred & Complementary Skills

  • Cloud Infrastructure (AWS): Working experience with core AWS services, including EC2, S3, RDS, VPC, IAM, and CloudWatch.

  • Streaming & Event-Driven Systems: Familiarity with Confluent Cloud / Apache Kafka concepts (topics, partition handling, producer/consumer design).

  • Containers & Serverless Orchestration: Hands-on exposure to AWS ECS / Fargate container orchestration, AWS Lambda runtime configuration, or Kubernetes.

  • Modern Data Stack: Familiarity with Snowflake or distributed data mesh principles is a plus.



Want to apply?
Position
Name*
Email*
Phone number*
Country*
City*
Linkedin
Faça upload do seu CV* (max. 4MB)
Upload your photo or video (max. 4MB)
Submit