Data Engineer - Airflow, Azure, AWS
We are seeking a skilled Data Engineer specializing in Airflow orchestration and cloud data platforms to join our dynamic Data Engineering team. This role is essential in developing and maintaining enterprise-scale data platforms, building robust data pipelines, and ensuring successful implementation of modern data architectures for our clients across Europe and the Middle East.
As Microsoft Partner of the Year 2023, Elitmind has delivered over 500 Data & AI solutions across Europe and the Middle East. You'll work with cutting-edge data technologies, participate in the entire engineering lifecycle, and act as a trusted advisor for Airflow technology while collaborating with cross-functional teams to deliver scalable data solutions that drive business value.
Join us and become another ElitManiac!
Here's the deal
You are an experienced data engineer with deep expertise in Apache Airflow orchestration and cloud data platforms, combining strong technical skills with excellent problem-solving abilities. You have hands-on experience building and maintaining enterprise-scale data pipelines, working with modern data architectures, and collaborating effectively with cross-functional teams to deliver robust data solutions.
You thrive in environments where you can tackle complex data engineering challenges, work with cutting-edge technologies like Databricks and Azure Data Services, and contribute to the entire data platform lifecycle while staying current with the latest automation practices and data engineering innovations.
How you fit in
Key technologies: Airflow | Data Platforms | SQL | Python | CI/CD | Azure | Data Services | Databricks
- 3+ years of experience in configuration/release management, deployment, maintenance and familiarity with various Data Platforms and practices in data area
- Strong experience in Airflow pipeline orchestration and optimization
- Very good coding skills with knowledge of best practices in SQL, Python
- Conceptual and technical knowledge on CI/CD Pipelines, Automation Practices, Technical Operations Monitoring
- Experience in Azure Data services, Databricks is a must
Nice to have
- Experience with Vertica, AWS EMS
- Experience with Lakehouse automation tools and frameworks
Soft skills
- Analytical Thinking
Ability to interpret data, identify trends, and provide actionable insights to drive business decisions. - Problem-Solving Skills
Proactively identify and resolve issues related to BI systems, ensuring smooth operations and data accuracy. - Effective Communication
Ability to explain technical concepts to non-technical stakeholders clearly and concisely, fostering understanding and collaboration. - Attention to Detail
Meticulous in data validation, report generation, and ensuring data quality across BI platforms. - Team Collaboration
Strong interpersonal skills to work effectively in cross-functional teams, coordinating with IT, business analysts, and other stakeholders. - Adaptability and Continuous Learning
Open to learning new tools and technologies in the rapidly evolving BI landscape and adjusting to changing business needs.
What will you do?
- Design and build cloud-based data pipelines and architectures.
- Integrate data from various structured and unstructured sources and formats.
- Implement automation for data workflows and support CI/CD processes.
- Optimize performance and resource usage of cloud data solutions.
- Maintain up-to-date knowledge of new technologies in data and cloud engineering.
- Monitoring, troubleshooting, and optimizing data systems for performance and cost.
- Supporting deployment of analytics and machine learning solutions on cloud platforms.
- Documenting processes, infrastructure, and best practices for future scalability
Compensation
B2B Contract | 14,000 - 24,000 PLN net monthly
Compensation within this range reflects your data engineering expertise, Airflow specialization, and contribution to successful enterprise data platform implementations.
Perks & Benefits
Flexible Work Arrangements
- Remote or hybrid - your choice: Work from anywhere or combine remote with office time
- Always welcome in Warsaw: Modern office space available when you want collaborative environment
- Flexible working hours: Arrange your schedule to optimize productivity
Professional Development
- Unlimited access to Microsoft, Databricks, and Snowflake training platforms
- Support for professional certifications and conference attendance
- Direct access to cutting-edge technologies through our technology partnerships
Health & Wellness
- Private medical care or Multisport membership (your choice)
- Regular team events and company activities
Additional Benefits
- Comfortable and spacious office environment
- Direct mentorship from Microsoft MVPs and industry experts
- Opportunity to work on high-impact projects across multiple industries
