Ingeniero lÃder en software de datos (Spark/Scala/Databricks)

About the Role

Are you a professional with an open mind and fluency in the Scala programming language? If this describes you, this could be the perfect opportunity to join EPAM as a Lead Data Engineer. We are looking for someone who works well in a team, has excellent communication and organization skills, and expertise in engineering.

Responsibilities

Develop, monitor, and operate the most utilized and critical data flow for the client - Sales Order Data (including post-order information, e.g., shipping, returns, payment).
Collaborate with analysts, data scientists, and product managers to continuously build and improve the KPI of "Single Source of Truth" for business direction, as the central measure of Contribution Margin (PC II).
Redevelop legacy workflows into new versions that are easier to maintain and scalable for future demands.
Leverage and improve a cloud-based technology stack that includes AWS, Databricks, Kubernetes, Spark, Airflow, Python, and Scala.

About the Candidate

Expectations:

Experience with Apache Spark along with Spark Streaming.
Solid hands-on experience with Databricks and delta-lake.
Fluency in the Scala programming language.
Experience in SQL.
Good understanding and practical experience with CI/CD.
Extensive experience working with GitHub.
Fluency working with the AWS environment.
Ability to build workflows with Apache Airflow.

Nice to have skills:

Presto
Superset
Starburst
Oracle & Exasol

About the Company

EPAM is renowned for its dynamic and agile work environment where teams are helping clients from the Fortune 1000 while adhering to best engineering practices. You can join us in Madrid, Malaga, or remotely throughout Spain to be at the forefront of innovation.

Company Culture and Benefits

At EPAM, we offer a private medical insurance, an Employee Stock Purchase Plan, 100% paid sick leave, a referral program, professional certification, and language courses that promote a healthy work-life balance.