SoftwareDevelopmentEngineerII

If you thrive in a fast-paced, innovative environment and are interested in pushing the boundaries of what's possible with big data, cloud computing, and security analytics, Amazon Security Platform Engineering is the place for you. We support a suite of services and products to ingest, optimize and query petabyte scale datasets efficiently, and enable critical security use cases such as incident response, security analytics, threat-hunting, and low-latency detection. Successful candidates for this position will possess: Strong software engineering fundamentals, including expertise in object-oriented design, algorithms, and data structures Experience building and operating scalable, fault-tolerant, distributed systems Proficiency in Java, Scala or Python with a solid understanding of multi-threading and memory management Knowledge of big data compute engines such as open table formats like Apache Iceberg, and Apache Spark, Trino, Flink. Excellent verbal and written communication skills Self-motivation and the ability to deliver high-quality results in a fast-paced environment. Key job responsibilities Build and support Amazon Security's Data Lake, consisting of services for data cataloging, optimization, compaction, re-organization, and indexing at petabyte scale. Drive technical vision and contribute to the roadmap for systems that manage petabyte-scale data catalogs supporting Apache Iceberg, AWS Glue, Parquet, and other formats. Design and implement distributed systems for data optimization that balance multiple latency scenarios from minute-level batch detections to month-spanning threat hunting queries. Modernize security intelligence platform's data catalog and governance services to provide customers with rule-based access controls and fine-grained data access. Build and support query platform services for query scheduling, routing, auditing, and engine built on Apache Spark. Optimize data ingestion and cataloging systems that handle petabytes of data. Partne