Ingeniero Senior de Software de Datos (AWS/Databricks/PySpark)

EPAM Systems — Málaga, ES
Published on

About the Role

Are you a professional and open-minded individual with practical experience in Databricks or similar ETL tools? If this resonates with you, this could be the perfect opportunity to join EPAM as a Senior Data Engineer. We are looking for a team player with excellent communication and organizational skills, engineering proficiency, and a B2+/C1 level of English to communicate fluently with English-speaking stakeholders, share ideas, and provide reasoning. As part of this project, our Data teams are working on migrating Product Data pipelines from Oracle workloads to Databricks. At EPAM, you will enter a dynamic and agile work environment, helping Fortune 1000 clients while adhering to best engineering practices. Join us remotely throughout Spain, or in Madrid or Málaga, to be at the forefront of innovation with EPAM.

Responsibilities

  • Design, develop, monitor, and operate data pipelines.
  • Integrate high-quality datasets for analytical use cases.
  • Enable other data teams to adhere to client standards.
  • Conduct testing (preparation and execution).
  • Maintain existing data pipelines including alerts, fixing issues, etc.

About the Candidate

We seek candidates with:

  • Over 3 years of practical experience in Databricks or similar ETL tools.
  • Strong understanding of Apache Spark, PySpark, and Python.
  • Proven experience with AWS Glue and Amazon S3 for efficient data storage and processing.
  • Experience using GitHub and CI/CD pipelines for version control and continuous integration.
  • Proficiency in MicroStrategy or similar analytic tools for data visualization and reporting.

Nice to Have Skills

  • Advanced skills in Databricks such as delta, cluster configuration, or mlflow.
  • Experience integrating sources like websites, Exasol, REST APIs, SAP, BigQuery, GSheets, Salesforce, Jedox, and more.
  • Data Quality knowledge.
  • Familiarity with Apache NiFi.
  • Java.

Company Culture and Benefits

EPAM offers:

  • Private medical insurance.
  • Employee stock purchase plan.
  • 100% paid sick leave.
  • Referral program.
  • Professional certification assistance.
  • Language courses.
← All jobsApply