Sr. Data Engineer (Spark, AWS, Python) (Remote, Eastern and Central Canada)

VTRAC Consulting CorporationToronto, CA
Published on

About the Role

An exciting opportunity for a skilled Data Engineer to join VTRAC Consulting Corporation's team and help build and maintain large-scale data infrastructure. As a Sr. Data Engineer, you will be responsible for:

  • Designing, building, and maintaining large-scale data systems, including data pipelines, data warehouses, and data lakes.
  • Working closely with data architects and data scientists to ensure that our data systems meet the business needs.

Key Responsibilities

  • Collaborate with data architects to design and implement data models and architectures.
  • Develop and maintain data pipelines using Apache Beam, Apache Spark, and AWS Glue.
  • Design and implement data warehouses utilizing Amazon Redshift, Google BigQuery, and Snowflake.
  • Ensure data quality and integrity by developing data validation and cleansing processes.
  • Stay up-to-date with new technologies and trends in data engineering.

About the Candidate

Qualifications:

  • 8 years of experience in data engineering.
  • Proficiency in programming languages such as Python, Java, and Scala.
  • Experience with data modeling, architecture, and engineering tools like Apache Beam and AWS Glue.
  • Strong collaboration and communication skills.
  • Bachelor's degree in Computer Science, Engineering, or a related field.

Nice to Have:

  • Experience with machine learning and data science.
  • Familiarity with cloud-based platforms (AWS, GCP, Azure).
  • Knowledge of containerization using Docker and Kubernetes.

About the Company

VTRAC Consulting Corporation is dedicated to providing intelligent solutions with a commitment to innovation and excellence. They focus on creating opportunities for growth and improvement in data systems.

Company Culture and Benefits

  • Equal-opportunity employer with a commitment to diversity and inclusion.
  • Work remotely from Eastern and Central Canada, allowing flexibility for work-life balance.
  • Opportunities for continuous learning and professional development.A