NielsenIQ
Market Research
SeniorDataEngineer
Neural analysis suggests this role is
optimal for mid candidates.
“Senior Data Engineer at NielsenIQ. Skills: Spark, Python, Scala, Databricks, Airflow, Azure. maintianing & assembling data pipelines that consume large datasets. runs the complex data transformations that are needed to generate the facts for the clients”
Industry & Context.
What They're Looking For.
Must Have
Minimum 10 years of experience as Data engineer, Experience modeling or manipulating large amounts of data is a must, Proven experience working as a data engineer, Highly proficient in using the spark framework (python and/or Scala), Extensive knowledge of Data Warehousing concepts, strategies, methodologies, Programming experience in Python, SQL, Scala, Hands-on experience of building data pipelines using Apache Spark (preferably in Databricks), Airflow, Hands-on experience designing and delivering solutions using Azure including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake
Nice to Have
Experience with CI/CD & DevSecOps is a plus, Experience with Demographic, Retail business is a huge plus, Databricks & Azure Big Data Architecture Certification would be plus
What You'll Do.
maintianing & assembling data pipelines that consume large datasets
runs the complex data transformations that are needed to generate the facts for the clients
integrating finished models into the pipelines that also helps in building the insights for the customer
Use your spark skills to optimize spark code (including data science models)
Building required infrastructure for optimal extraction
transformation and loading of data from various data sources
Write and maintain documentation for features you work on & transition them to L2 support
How You'll Work.
Team & Collaboration
Must be team oriented persion with collaboration; Understands the dynamics & dependencies between various teams & acts responsibly
Full Job Description
R26_0010641 As a Senior Data Engineer , you’ll be part of a team which works with big data & cloud technologies such as Spark, (Scala & Pyspark), python, Databricks, Airflow, Hive etc. * Responsible for maintianing & assembling data pipelines that consume large datasets, runs the complex data transformations that are needed to generate the facts for the clients. * Responsible for integrating finished models into the pipelines that also helps in building the insights for the customer. * Use your spark skills to optimize spark code (including data science models). * Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using Azure, Databricks and RDMBS technologies * Write and maintain documentation for features you work on & transition them to L2 support. * Ability to write highly efficient code in terms of performance / memory utilization ## Qualifications * Minimum 10 years of experience as Data engineer * Experience modeling or manipulating large amounts of data is a must. * Proven experience working as a data engineer * Highly proficient in using the spark framework (python and/or Scala) * Extensive knowledge of Data Warehousing concepts, strategies, methodologies. * Programming experience in Python, SQL, Scala * Hands-on experience of building data pipelines using Apache Spark (preferably in Databricks), Airflow. * Hands-on experience designing and delivering solutions using Azure including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake Nive to Have: * Experience with CI/CD & DevSecOps is a plus. * Experience with Demographic, Retail business is a huge plus * Databricks & Azure Big Data Architecture Certification would be plus Soft Skills: * Must be team oriented persion with strong collaboration, prioritization, and adaptability skills. * Ability to learn the application from documents & KT videos with some support from the team. * Understands the dynamics & dependencies between various t
Applying for this Senior Data Engineer role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on SmartRecruiters
- SmartRecruiters often includes a video screening step — check camera and mic permissions.
- Link your GitHub or portfolio directly in the profile section for technical roles.
- Applications may be reviewed by AI scoring before reaching a recruiter — use keywords from the job description.
ANONYMOUS · UNFILTERED
What do employees actually say about NielsenIQ?
Real rants from real employees. Read before you apply.