Mastercard
Financial Services
SeniorSoftwareEngineer-BigData/StreamingPlatforms(Spark/Kafka/NiFi)
Neural analysis suggests this role is
optimal for Senior candidates.
“Senior Software Engineer - Big Data / Streaming Platforms (Spark / Kafka / NiFi) at Mastercard. Skills: Big Data platforms, Streaming architectures, Test automation, Data validation. Analyze business requirements. Analyze regulatory requirements”
Industry & Context.
Problem solving skills; Root cause analysis
What They're Looking For.
Must Have
Bachelor’s degree in Computer Science, 6+ years in testing big data platforms, Solid understanding of Apache Spark, Working knowledge of Apache NiFi, Working knowledge of JSON, Working knowledge of cloud data validation, Analytical skills, Problem solving skills, Communication skills, SQL skills for data validation, Proficiency with Linux, Proficiency with shell scripting, Proficiency with Git, Basic CI/CD concepts
Nice to Have
Experience with Apache Ozone, Experience with Ceph
What You'll Do.
Analyze business requirements
Analyze regulatory requirements
Analyze technical requirements
Design risk based test scenarios
Design audit compliant test scenarios
Perform functional testing
Perform regression testing
Perform system integration testing
Track defects in JIRA
Manage defects in JIRA
Validate JSON payloads
Validate cloud storage data
Validate Apache NiFi data flows
Collaborate with development teams
Support defect resolution
Participate in design reviews
Participate in test plan reviews
Participate in technical documentation
Participate in Agile ceremonies
Provide test execution status
Provide risk assessments
Provide quality metrics
Test Kafka based streaming pipelines
Verify event replay flows
Verify reprocessing flows
Test Apache NiFi flows
Execute performance testing
Collaborate with engineering teams
Validate partitioning strategies
Validate resource tuning
Validate scalability assumptions
Build test automation frameworks
Maintain test automation frameworks
Automate validation using SQL
Automate validation using PySpark
Automate validation using Python
Integrate automated tests into CI/CD
Participate in production validation
Participate in go live readiness
Participate in post deployment verification
Support incident analysis
Validate observability metrics
How You'll Work.
Team & Collaboration
Cross functional teams; Development teams; Engineering teams
Communication Scope
Communication skills
Process & Methodology
Agile ceremonies
Full Job Description
**Our Purpose** _Mastercard powers economies and empowers people in 200 + countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential._ **Title and Summary** ### Senior Software Engineer - Big Data / Streaming Platforms (Spark / Kafka / NiFi) ### Job Posting Title: Senior Software Engineer - Big Data / Streaming Platforms (Spark / Kafka / NiFi) ________________________________________ Who is Mastercard? Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential. Our culture is guided by the Mastercard Way—own it, simplify it, sense of urgency, thoughtful risk taking, unlock potential, and be inclusive. ________________________________________ Job Summary: We are looking for a highly skilled Senior QA Engineer / SDET with deep expertise in testing large scale batch and real time data platforms built on Apache Spark, Kafka, and Apache NiFi. This role focuses on validating streaming heavy architectures, ensuring data correctness, latency, fault tolerance, and reliability across complex distributed systems leveraging object storage platforms such as Apache Ozone and Ceph. The ideal candidate is passionate about data quality, test automation, observability, and production readiness for mission critical big data systems. # Key Responsibilities \-
Applying for this Senior Software Engineer - Big Data / Streaming Platforms (Spark / Kafka / NiFi) role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Workday
- Workday has a multi-step form — save your progress after every section.
- "Apply With LinkedIn" can fail or lose data; manual entry is more reliable.
- Watch for the "Submit for Review" final step — hitting "Save" alone does not submit.
- Job requisition numbers are useful when following up with HR by email.
ANONYMOUS · UNFILTERED
What do employees actually say about Mastercard?
Real rants from real employees. Read before you apply.