Data Engineer – Spark & Cloud Data Pipelines
- Published on
About ALTEN
In just three decades, ALTEN has emerged as a global leader in Research and Development, Engineering, Information Technology Services, Life Sciences, and Network Services. Our footprint spans across 30 countries, with over 60,000 consultants driving innovation and technical excellence. Trusted by industry giants, we have become synonymous with pioneering solutions and unwavering expertise. ALTEN CANADA, a proud subsidiary of ALTEN headquartered in France, is committed to serving the Canadian market. With local offices in Montreal and Toronto, we bring our global expertise to the forefront of Canadian innovation.
About the Role
Job Title: Data Engineer – Spark & Cloud Data Pipelines
Model: Remote, or Hybrid
We are seeking a skilled Data Engineer with strong Spark and cloud data processing experience to design, build, and optimize high-performance data pipelines. This role involves close collaboration with data scientists, architects, and business stakeholders to implement robust and scalable data solutions.
Key Responsibilities:
- Data Pipeline Development: Design, develop, and maintain scalable ETL/ELT pipelines using Apache Spark and Databricks.
- Workflow Orchestration: Build and deploy data workflows that automate ingestion and transformation of large datasets.
- Data Quality & Observability: Implement validation checks and observability features to ensure data integrity.
- Cross-functional Collaboration: Partner with data scientists and analysts to define technical data solutions.
- Cloud Data Engineering: Work within cloud-based platforms (AWS) focusing on security and scalability.
- Clean Code & DevOps Practices: Write modular, testable code in Python with adherence to CI/CD pipelines.
- Performance Tuning: Optimize job execution and query performance for large data volumes.
- Monitoring & Reliability: Monitor pipeline health and troubleshoot failures for continuous improvement.
About the Candidate
Must-Have Qualifications:
- 5 years of experience in data engineering roles.
- Proficiency in Python programming.
- Strong experience with Apache Spark and Databricks.
- Proven ability to build production-grade data pipelines.
- Solid understanding of AWS infrastructure.
Nice-to-Have Skills:
- 3 years experience with Snowflake and/or Databricks management.
- Experience with Kafka or Spark Streaming.
- Familiarity with Terraform or other IaC tools.
Tools & Technologies
- Languages & Frameworks: Python, Spark.
- Platforms: Databricks, Snowflake, AWS.
- DevOps & IaC: Git, CI/CD, Terraform (optional).
- Orchestration & Monitoring: Airflow and custom observability tools.
Company Culture and Benefits
Why Join Us? ALTEN Canada fosters a dynamic and collaborative work environment where team members are empowered to unleash their full potential. We offer a comprehensive benefits package including Collective Insurance & RRSP Corporate Discounts, 4 weeks of vacation, corporate activities, and personalized professional development plans.
Join ALTEN Canada to embark on a journey of endless possibilities where your talents are celebrated, and your ambitions nurtured. We are committed to diversity, equity, and inclusion, providing a work environment where every individual is valued and respected. Should you require any accommodation during our recruitment process, please reach out to us.