Job: Data Engineer with Airflow Experience

Company Overview:

Our client is a dynamic and innovative team dedicated to providing top-tier data integration services for our clients. Their focus is on leveraging cutting-edge technologies to deliver efficient and reliable solutions.

Job Description:

Our client is seeking a skilled Data Engineer with substantial experience in Apache Airflow to join their team for a project-based engagement. The candidate will be responsible for building, maintaining, and optimizing data integrations for various services including Listrak, Happy Returns, and others.

Key Responsibilities:

• Develop and maintain Airflow Directed Acyclic Graphs (DAGs) for data integration tasks.
• Extract and ingest data from various sources, ensuring its reliability and accuracy.
• Clean, transform, and organize data to meet client requirements.
• Implement monitoring systems to ensure data quality and integrity.
• Write comprehensive test coverage to maintain high standards of data reliability.
• Collaborate with other team members to integrate systems and data efficiently.
• Provide technical guidance and support for data-related issues.

Qualifications:

• 5-6 years of experience
• Proven experience in building and managing DAGs in Apache Airflow.
• Strong understanding of data extraction, transformation, and loading (ETL) processes.
• Proficient in data cleaning and preprocessing techniques.
• Experience with data monitoring and quality assurance.
• Strong programming skills, preferably in Python.
• Excellent problem-solving abilities and attention to detail.
• Ability to work independently and as part of a team.
• Good communication skills, with the capacity to articulate complex technical concepts clearly.

Preferred Skills:

• Experience with cloud platforms and their data services.
• Familiarity with additional data integration tools and technologies.