Amazon Development Center U.S., Inc.
Cloud Computing
SoftwareDevelopmentEngineer,OpenDataAnalytics
Neural analysis suggests this role is
optimal for Mid+ candidates.
“Software Development Engineer, Open Data Analytics at Amazon Development Center U.S., Inc.. Skills: Query engines, Open table formats, Big Data processing, Performance optimization. Develop query engines. Optimize query engines”
Industry & Context.
Root cause analysis
What They're Looking For.
Must Have
3+ years software development experience, 2+ years system design or architecture experience, 3+ years programming experience (Java, C++, C#), Object-oriented design experience
Nice to Have
3+ years full SDLC experience, Bachelor's degree in computer science, Experience developing distributed systems, Experience with open table formats, Experience with query engines, Experience contributing to open source
What You'll Do.
Develop query engines
Optimize query engines
Develop open table formats
Optimize open table formats
Design innovative solutions
Implement innovative algorithms
Improve feature capabilities
Integrate table formats
Collaborate with open-source community
Contribute to discussions
Integrate upstream changes
Ensure data consistency
Ensure data durability
Achieve breakthrough performance
Achieve breakthrough scalability
Improve automation capabilities
Improve testing capabilities
Manage complex deliverables
Manage research projects
Handle customer issues
How You'll Work.
Team & Collaboration
Open-source communities; Internal teams; Cross-functional teams
Process & Methodology
Project management, Research projects
Full Job Description
Amazon Web Services Open Data Analytics (ODA) organization is looking for exceptional engineers to help in our mission to provide the world’s best cloud Big Data processing platform and services such as EMR and Athena. The ODA engines team is looking for an experienced engineer to join the core engines and datalake team. Athena and EMR are services that our customer use to run large scale analytics, leveraging open source engines like Apache Spark and Trino, with datalake open table formats like Apache Iceberg, Hudi and Delta. The analytics engines organization makes significant modifications to these engines to run in serverless environments and with superior performance and scalability than what is available in Open Source. In the last 3 years we have improved our engines by a factor of 5x by making changes to the optimizer, query runtime and storage connectors. We have also made significant changes to the compiler to enable enterprise features like fine grain access control with these engines and table formats. Additionally, we strive to regularly contribute features, bug fixes and optimizations back to open-source, as well be current with the latest open-source versions of these frameworks. This is a “must-win” strategic area in a growing and very technical space. We are seeking a passionate and hands-on engineer to collaborate closely with open-source communities like Apache Iceberg and Apache Spark, driving innovations in query engines and table format integrations. In this role, you will focus on performance optimizations, feature enhancements, stability improvements, and security hardening, making deep contributions across the query engine and table format codebases. As a key member of the Engines team, you will shape the technical direction, influence design decisions, implement critical features, and foster collaboration with both internal teams and the open-source community. AWS Utility Computing (UC) provides product innovations — from foundational servi
Applying for this Software Development Engineer, Open Data Analytics role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
ANONYMOUS · UNFILTERED
What do employees actually say about Amazon Development Center U.S., Inc.?
Real rants from real employees. Read before you apply.