Lead Data Software Engineer (Databricks)

EPAM Systems — Madrid, ES
Published on

About the Role

EPAM Systems is looking for a Lead Data Software Engineer with a strong background in Databricks and an open-minded personality. This role requires someone ready to join a friendly environment and become a core contributor to our team of experts.

Responsibilities:

  • Lead a small team of engineers in designing, developing, and maintaining scalable data pipelines and architectures.
  • Develop and optimize data models and ETL processes using Databricks and other technologies.
  • Implement data quality checks and monitoring to ensure high data integrity.
  • Stay updated with emerging trends in data engineering and recommend new tools when beneficial.
  • Troubleshoot and resolve data-related issues promptly.
  • Participate in code reviews to maintain high standards of code quality.

About the Candidate

Do you have background and wide experience in Data engineering and strong knowledge of Databricks? If so, your qualifications should include:

  • Hands-on experience with Databricks, Delta Lake, workflows, Delta Live Tables, deployment, and versioning.
  • Ability to lead a development team of 2-5 engineers.
  • Solid understanding of data architectures and data modelling; experienced in designing and building ETL pipelines with Databricks.
  • Expertise in Spark using Scala or PySpark.
  • Knowledge of SDLC and Agile frameworks.
  • Proficiency in cloud-native technologies and software engineering best practices, including containers and unit tests.
  • Engineering experience with AWS, Azure, or GCP.
  • Experience with big data and performance optimization of data-intensive applications.
  • Fluent in English communication skills at a B2+ level.

About the Company

EPAM is a leading digital transformation services and product engineering company with over 52,650 EPAMers in more than 55 countries and regions. Since 1993, our multidisciplinary teams have been helping to make the future real for our clients and communities.

Company Culture and Benefits

EPAM believes in work-life balance and offers flexible work options. Employees enjoy 24 working days of annual leave, paid sick leave, and other public holiday benefits. The company has a continuous learning culture, providing opportunities for personal development, mentorship, and training courses. EPAM also has clear career paths for engineers and managers, promoting progression towards roles like People Manager or Project Manager.

The company fosters a strong professional community, encouraging team collaboration across global teams, allowing experts to exchange ideas and share expertise.

Why Join EPAM?

  • Professional development and learning opportunities.
  • Flexible work arrangements to ensure a balanced life.
  • A community of highly skilled experts for support and collaboration.
← All jobsApply