SeniorDataEngineer

Jellyfish is the backbone for elite engineering organizations, and our data pipelines need to be as high-performing and reliable as the teams we serve. We are looking for a Senior Data Engineer to help us build, automate, and execute the next generation of our Jellyfish data platform. Working closely with our Lead Data Architect, you’ll be responsible for implementing core data models, building production-grade CI/CD for data pipelines, and transforming raw engineering signals into highly optimized analytical layers. If you view broken pipelines and manual data patches as a technical debt to be solved and want to write code that directly impacts how the world’s best engineering leaders measure their output, you’re the perfect fit. WHAT YOU’LL ACTUALLY BE DOING: - Pipeline Execution & Modeling – You’ll maintain our end-to-end data pipelines, writing clean, modular Python and SQL. You will help translate the architectural blueprint into reality, structuring data across our Medallion layers (Bronze > Silver > Gold) for maximum performance and reliability. - Orchestration Modernization – You’ll take the lead on migrating, optimizing, and maintaining our workflow orchestration engines. You’ll eliminate pipeline bottlenecks, leverage modern fast-paths (like Pydantic v2 and async database clients), and ensure distributed tasks scale seamlessly without hitting API limits. - Data CI/CD & Infrastructure Automation – You’ll build the "paved road" for data deployments. You’ll use Terraform to provision data resources and write automated tests to validate schemas and data quality before code ever hits our isolated staging or production catalogs. - API & Caching Integration – You’ll collaborate with product developers to expose data safely. You’ll help design and optimize the application backend tiers, backend-for-frontend (BFF) layers, and Redis caching structures that protect our core data warehouse from frontend concurrency spikes. - On-Call & Observability Triage – You’ll par