Lead Data Software Engineer

EPAM Systems — Entroncamento, PT
Published on

About the Role

We are looking for a Lead Data Software Engineer to join our energetic team. You will create and enhance powerful data solutions to cater to our broad customer base, utilizing your skills in Python, PySpark, and Azure technologies to drive our products towards enhanced performance and scalability.

Responsibilities

  • Develop and enhance scalable data products targeting a wide consumer audience.
  • Enhance and fine-tune data pipelines using Python and PySpark.
  • Manage and streamline Azure Databricks environments.
  • Employ Azure DevOps pipelines and/or GitHub Actions for efficient data solutions deployment.
  • Work closely with interdisciplinary teams to convert business requirements into technical specifications.
  • Follow software engineering best practices throughout the project cycle.
  • Participate in the expansion and upkeep of the Databricks Unity Catalog.
  • Advance data processing and storage solutions in the Azure data ecosystem.

About the Candidate (Expectations and Nice to Have Skills)

Candidates should have a minimum of 5 years' experience in data software engineering and over 1 year of proven leadership experience. Proficiency in Python and PySpark, along with experience in deploying and maintaining Azure Databricks solutions is crucial. The ideal candidate will also have qualifications in managing pipelines via Azure DevOps and/or GitHub Actions, understanding of the Azure data environment, and fluent communication skills in English at B2+ level. It's a plus if you have the capability to develop APIs using Python and experience with Google Cloud Platform (GCP).

About the Company

EPAM Systems is a leading company known for offering a variety of projects within one company, focusing on engineering excellence standards.

Company Culture and Benefits

We offer competitive compensation based on experience and skills, individual career paths and professional growth opportunities, participation in internal events and communities, and flexible work hours to ensure a balance between personal and professional life.

← All jobsApply