Senior Data Engineer

TeralyticsBerlin, DE
Published on

About the Role

Teralytics is seeking a Senior Data Engineer to optimize and scale our data processing pipelines. You will work with big data technologies and collaborate with data scientists and engineers to deliver effective solutions from extensive mobility datasets. This role involves:

  • Developing and optimizing scalable data pipelines using Scala and Apache Spark.
  • Deploying and managing workflows in Kubernetes.
  • Orchestrating ETL pipelines with Apache Airflow.
  • Enhancing data integration with data science methodologies and utilizing machine learning and AI where applicable.
  • Monitoring, troubleshooting, and optimizing data pipelines.

About the Candidate

The ideal candidate will possess:

  • Expertise in Scala and Apache Spark.
  • Experience with Kubernetes and Hadoop.
  • Familiarity with Apache Airflow and workflow orchestration.
  • Strong knowledge of big data technologies and cloud platforms (AWS, GCP, or Azure is preferred).
  • An understanding of data science principles, with machine learning and AI knowledge being a plus.
  • Excellent problem-solving skills and the ability to thrive in a fast-paced environment.

About the Company

Teralytics provides an AI-powered co-pilot for public transport agencies, helping them design better transportation networks that make our cities more sustainable, livable, and equitable. We serve Germany's most relevant public transport and rail agencies, including Deutsche Bahn, RMV, and BVG, by delivering innovative solutions that enhance transport planning and management.

Company Culture and Benefits

We offer a collaborative and innovative work environment. You will have opportunities to engage with impactful, large-scale data projects. Our benefits include:

  • Competitive compensation and flexible work arrangements.
  • Learning and development opportunities to advance your skill set.

How to Apply

If you are interested, submit your resume and a short cover letter detailing your experience and interest to michel.kaden@teralytics.net. We look forward to hearing from you!