Data Engineer

About the Role

We are seeking a highly motivated and experienced Data Engineer to support the development and optimization of Outage Management Data Products for a leading enterprise telecommunications company. This individual will play a crucial role in designing, building, and maintaining scalable data pipelines and analytics solutions that provide real-time and historical insights into network outages and service disruptions.

Key Responsibilities

• Design, develop, and maintain scalable, reliable ETL/ELT pipelines for outage detection, tracking, and resolution data products.
• Leverage AWS EMR, Spark, and PySpark to process large-scale datasets related to network performance and outage events.
• Collaborate with cross-functional teams including network operations, analytics, and product to define and implement data models and analytical solutions.
• Implement and manage Airflow DAGs to orchestrate workflows and ensure data availability across environments.
• Develop and optimize SQL queries and data transformations for analytics dashboards and reporting tools.
• Monitor and troubleshoot pipeline issues, ensuring high data quality, availability, and observability.
• Partner with stakeholders to translate business requirements into technical designs and data strategies.
• Assist in building a data lake/data warehouse architecture that supports both real-time and batch workloads.
• Ensure security and compliance for sensitive data, implementing data governance best practices.

About the Candidate (Expectations and Nice to Have Skills)

Required Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field (or equivalent industry experience).
• 4+ years of experience in data engineering, analytics, or big data development roles.
• Strong hands-on experience with AWS EMR, Spark, and PySpark for large-scale data processing.
• Proficiency in Python for scripting, automation, and data transformation tasks.
• Advanced knowledge of SQL and data modeling for both OLTP and OLAP environments.
• Experience with Apache Airflow for data pipeline orchestration and monitoring.
• Familiarity with modern data lake and data warehouse architectures (e.g., S3, Redshift, Athena, Hive, Presto).
• Proven ability to write clean, scalable, and production-grade code.
• Experienced in Agile/Scrum environment with tools like Jira, Git, and CI/CD systems.

Preferred Qualifications:

• Experience with telecommunications data, network outages, or performance monitoring systems.
• Familiarity with real-time data processing frameworks (e.g., Kafka, Flink, Kinesis).
• Experience building or supporting data products or analytics dashboards for business stakeholders.
• Understanding of DevOps and data infrastructure as code using tools like Terraform or CloudFormation.
• Exposure to data governance frameworks (e.g., data lineage, quality checks, cataloging).

About the Company

Brooksource, based in Maryland Heights, MO, has been a trusted partner for IT hiring, recruiting, and staffing needs for over 16 years. They specialize in meeting your IT staffing needs whether it’s contract, contract-to-hire, or permanent placement work. Their national team of recruiters works to find the best-suited candidates for your business's unique initiatives, culture, and technologies.

Company Culture and Benefits

Brooksource fosters a partnership-driven culture where relationships are at the core of their operations. They provide equal employment opportunities to all employees and applicants without discrimination. Benefits include dental, health, and vision insurance, along with competitive hourly pay ranging from $60.00 to $65.00. Expected hours are 40 per week, with shifts scheduled from Monday to Friday.