Experian
Data and technology
BigDataDevOpsEngineer
Neural analysis suggests this role is
optimal for not-applicable candidates.
“BigData DevOps Engineer at Experian. Skills: Big Data, DevOps, AWS, Hadoop. Implement, support, and administer Hadoop and AWS EMR environments. Maintain Terraform and IaC for provisioning and managing AWS resources”
What You'll Achieve.
Maintain working solutions for our big data tech stack; Support product development following the product roadmap; Maintain quality of software deliverables; Maintain excellent customer relationships; Increase the customer base; Ensure platform reliability; Optimize EMR for performance and cost
Industry & Context.
Troubleshoot system issues; Analyze performance
What They're Looking For.
Must Have
3+ years of Hadoop infrastructure administration – AWS EMR or Cloudera environments, 2+ years of Linux (Redhat) system administration, Cloud Platforms IaaS/PaaS – Cloud solutions: AWS, Azure, VMWare, Automation skills – Ansible and Terraform, Kerberos administration skills, Experience coding languages SQL, Python, Good experience in CI/CD tools such as Jenkins, Puppet and Shell scripting, Must have knowledge on DevOps tools, Working Knowledge of YARN, HBase, Hive, Spark, and Kafka, Experience working with geographically distributed teams, Bachelors or master's degree in Computer Science or equivalent experience
Nice to Have
Gen AI / Agentic AI knowledge is plus, Knowledge of our strategy and use of back-office applications, To multi-lingual and multicultural environment, additional language skills are a bonus, Receptive to change
What You'll Do.
and administer Hadoop and AWS EMR environments
Maintain Terraform and IaC for provisioning and managing AWS resources
Provide CI/CD solutions
Automate deployment and operations of Big Data technologies
Onboard Hadoop users and manage access
Implement security best practices
Optimize EMR for performance and cost
Perform proactive capacity management
Support upgrades and patching
Troubleshoot system issues
Deploy and manage Hadoop clusters
Support integrations across cloud/on-prem networks
Configure and maintain tools
Integrate AD/LDAP with Cloudera
Manage Sentry policies
How You'll Work.
Team & Collaboration
Collaborate with infrastructure teams; Collaborate with network teams; Collaborate with DB teams; Collaborate with application teams; Collaborate with BI teams; Work with teammates to maintain working solutions; Work with product development teams; Work with geographically distributed teams
Full Job Description
Experian is a global data and technology company, powering opportunities for people and businesses around the world. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more. Experian invests in people and new advanced technologies to unlock the power of data. We have an amazing team of 25,200 people in 32 countries As an important aide to both the IT Infrastructure and Development teams, you will help support existing systems 24x7 and responsible for administering current Big Data environments. You will manage BigData Group environments and will work with teammates to maintain working solutions for our big data tech stack. To support product development following the product roadmap for product maintenance and enhancement such that the quality of software deliverables maintains excellent customer relationships and increases the customer base. You will report to the Engineering Manager, Data Platforms. If you have the skills and we would love to talk to you! What you'll do: * Implement, support, and administer Hadoop and AWS EMR environments. * Maintain Terraform and IaC for provisioning and managing AWS resources. * Provide CI/CD solutions. * Automate deployment and operations of Big Data technologies using DevOps tools. * Onboard Hadoop users and manage Kerberos, HDFS, Hive, HBase, and Yarn access. * Implement security best practices across HBase, HDFS, Kafka, Hive, and related components. * Tune Hadoop clusters, MapReduce, Spark workloads, and optimize EMR for performance and cost. * Monitor group health, logs, storage, and perform proactive capacity management. * Collaborate with infrastructure, network, DB, application, and BI teams to ensure platform reliability. * Support upgrades and patching for EMR, HBase, Spark, and other data platforms. * Troubleshoot system issues and analyze CPU, memory, OS, storage, and network performance. * Deploy and manage Hadoop clusters, configure HA, manage
Applying for this BigData DevOps Engineer role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on SmartRecruiters
- SmartRecruiters often includes a video screening step — check camera and mic permissions.
- Link your GitHub or portfolio directly in the profile section for technical roles.
- Applications may be reviewed by AI scoring before reaching a recruiter — use keywords from the job description.
ANONYMOUS · UNFILTERED
What do employees actually say about Experian?
Real rants from real employees. Read before you apply.