SeniorDataEngineer

We are looking for an experienced Senior Data Engineer with strong expertise in PySpark, Python, and Big Data technologies to support enterprise-scale Data Engineering initiatives within the AACOE – Data Engineering chapter. The ideal candidate should possess strong experience in building scalable data pipelines, feature engineering, machine learning data preparation, and modern distributed data processing architectures. The role requires strong hands-on engineering capability, stakeholder collaboration, Agile delivery experience, and expertise in high-performance big data environments supporting analytics and machine learning use cases. **Requirements** Key Responsibilities: • Gather and analyze business and technical requirements for enterprise data engineering and analytics initiatives. • Perform Exploratory Data Analysis (EDA) to identify data patterns, quality issues, and transformation requirements. • Design, develop, and optimize scalable data pipelines using PySpark, Python, and Big Data technologies. • Ingest, cleanse, transform, and process structured and unstructured datasets from multiple enterprise data sources. • Build feature engineering workflows and data transformation pipelines supporting machine learning model development. • Develop secure, reliable, and high-performance distributed data processing solutions. • Collaborate closely with Analytics Delivery Leads, Data Scientists, ML Engineers, and cross-functional teams to deliver data-driven solutions. • Optimize Spark workloads and implement performance tuning strategies for large-scale distributed environments. • Ensure data quality, governance, scalability, and operational efficiency across data platforms. • Participate in Agile ceremonies including sprint planning, backlog grooming, stand-ups, and retrospectives. • Contribute to data architecture discussions, technical documentation, and engineering best practices. • Troubleshoot data pipeline failures, performance bottlenecks, and production i