Comcast

media and technology

DataEngineer4

Chennai, India FULL TIME
Market Sentiment
HIGH DEMAND

Neural analysis suggests this role is
optimal for Senior candidates.

The Brief

“Data Engineer 4 at Comcast. Skills: Spark, Scala, Data Pipelines, Cloud Platforms. Design and implement scalable streaming jobs. Optimize Spark jobs for performance”

What You'll Achieve.

enable advanced analytics; enable machine learning; deliver reliable datasets

Industry & Context.

media and technology
Problems you'll solve

problem-solving skills

What They're Looking For.

Must Have

5+ years in engineering roles, 2 years focused on Spark/Scala, Bachelor’s or Master’s degree in Computer Science, Engineering, or related field, Spark/Scala proficiency, Development Experience, Scala or Java proficiency, Hands-on experience with cloud platforms (AWS EMR, Azure Databricks, GCP Dataproc), Familiarity with CI/CD pipelines, Familiarity with Infrastructure as Code (Terraform, CloudFormation)

Nice to Have

Experience with real-time streaming (Kafka, Spark Streaming), Dockers / Kubernetes Experience, Databricks Experience, Knowledge of performance tuning and troubleshooting Spark jobs, Certifications in cloud platforms or big data technologies, problem-solving and communication skills

What You'll Do.

Design and implement scalable streaming jobs

Optimize Spark jobs for performance

Develop and maintain automated tooling

Implement best practices for distributed data processing

Implement data validation

Implement lineage tracking

Ensure compliance with security

Ensure compliance with privacy standards

Research and adopt new technologies

How You'll Work.

Team & Collaboration

Collaborate with cross-functional teams; Work closely with data scientists; Work closely with analysts; Work closely with business stakeholders

Communication Scope

communication skills

Full Job Description

Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative and fascinating businesses and create career opportunities across a wide range of locations and disciplines. We are at the forefront of change and move at an amazing pace, thanks to our remarkable people, who bring cutting-edge products and services to life for millions of customers every day. If you share in our passion for teamwork, our vision to revolutionize industries and our goal to lead the future in media and technology, we want you to fast-forward your career at Comcast. **Job Summary** We are seeking an experienced Senior Spark Engineer to design, develop, and optimize large-scale streaming systems using Apache Spark. This role involves building high-performance data pipelines, and collaborating with cross-functional teams to enable advanced analytics and machine learning. **Job Description** **Key Responsibilities** * **Data Pipeline Development:** * Design and implement scalable streaming jobs in Cloud and on-prem * Optimize Spark jobs for performance and cost efficiency. * **Dev Ops :** * Develop and maintain automated tooling for operational montoring and maintenance of complex pipelines * Implement best practices for distributed data processing and storage. * **Collaboration:** * Work closely with data scientists, analysts, and business stakeholders to deliver reliable datasets. * **Data Quality & Governance:** * Implement data validation, monitoring, and lineage tracking. * Ensure compliance with security and privacy standards. * **Continuous Improvement:** * Research and adopt new technologies to improve Spark-based data engineering processes. **Required Skills & Qualifications** * **Technical Expertise:** * Strong proficiency in **Spark/Scala** * Development Experience, familiarity with code repos, CI/CD * **Programming & Tools:** * Proficien

Free ATS check

Applying for this Data Engineer 4 role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

How to Apply on Workday

  • Workday has a multi-step form — save your progress after every section.
  • "Apply With LinkedIn" can fail or lose data; manual entry is more reliable.
  • Watch for the "Submit for Review" final step — hitting "Save" alone does not submit.
  • Job requisition numbers are useful when following up with HR by email.

ANONYMOUS · UNFILTERED

What do employees actually say about Comcast?

Real rants from real employees. Read before you apply.

Read Company Rants →