3Pillar Global

Product Development

LeadDataEngineer

India FULL TIME Remote Friendly
Market Sentiment
HIGH DEMAND

Neural analysis suggests this role is
optimal for Lead candidates.

The Brief

“Lead Data Engineer at 3Pillar Global. Skills: Data pipelines, ETL/ELT, Snowflake, Python. Understand business requirements. Write code”

What You'll Achieve.

Ensure data accuracy; Ensure data integrity; Ensure data privacy; Ensure data security; Ensure data compliance; High performance; Strict data integrity

Industry & Context.

Product Development
Problems you'll solve

Manage complexity; Database Optimization; High performance; Strict data integrity

Eligibility Requirements

Train and mentor junior engineers

What They're Looking For.

Must Have

Understanding business requirements, Writing code, Implementing solutions, Creating data pipelines, Versioning, Change management, Manage complexity, Develop ETL/ELT processes, Extract data, Manipulate data, Design data pipelines, Build data pipelines, Maintain data pipelines, Automate data workflows, Data ingestion, Data aggregation, ETL processing, Logging, Instrumentation, Ensure data accuracy, Ensure data integrity, Ensure data privacy, Ensure data security, Ensure data compliance, Quality control procedures, NoSQL-to-RDBMS Mapping, Flatten JSON data, Normalize JSON data, MongoDB, Relational tables, Pipeline Development, Build ETL pipelines, Manage ETL pipelines, Process data, Snowflake, Load data, MySQL, Database Optimization, Design MySQL databases, Index MySQL databases, Tune MySQL databases, High performance, Strict data integrity, Snowflake Utilization, Leverage Snowflake, Stage semi-structured data, Parse semi-structured data, Transform semi-structured data, Python, ETL frameworks

Nice to Have

rivery, informatica

What You'll Do.

Understand business requirements

Create data pipelines

Manage versioned data pipelines

Develop ETL/ELT processes

Extract and manipulate data

Design batch or real-time data pipelines

Build data pipelines in production

Maintain data pipelines in production

Automate data workflows

Log pipelines and services

Instrument pipelines and services

Ensure data integrity

Ensure data compliance

Flatten and normalize JSON data

Build reliable ETL pipelines

Process data via Snowflake

Design target MySQL databases

Index target MySQL databases

Tune target MySQL databases

Leverage Snowflake capabilities

Stage semi-structured data

Parse semi-structured data

Transform semi-structured data

How You'll Work.

Team & Collaboration

Work with product team; Part of a global team; Learning from top talent; Leverage global resources; Work in efficient teams; Work in effective teams; Reinforce commitment to diversity

Communication Scope

Speaking English everyday

Process & Methodology

Change management

Full Job Description

## Key Responsibilities Understanding the business requirements Writing code and implementing the proposed solutions Creating data pipelines, versioning and change management Manage the complexity inherent in versioned data pipelines Develop ETL/ELT processes to help extract and manipulate data from multiple sources. Design, build and maintain batch or real-time data pipelines in production. Automate data workflows such as data ingestion, aggregation, and ETL processing. Logging and instrumentation of pipelines and services. Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures. Train and mentor junior engineers. ## Job Description Data Engineer NoSQL-to-RDBMS Mapping: Flatten and normalize complex, nested JSON data from MongoDB into structured relational tables. Pipeline Development: Build and manage reliable ETL pipelines to ingest data from MongoDB, process it via Snowflake, and load it into MySQL. Database Optimization: Design, index, and tune target MySQL databases to ensure high performance and strict data integrity. Snowflake Utilization: Leverage Snowflake's variant handling capabilities to efficiently stage, parse, and transform semi-structured data. Technical Stack: Proficiency in MongoDB, MySQL, Snowflake SQL, good to have Python (including ETL frameworks like rivery or informatica). ## What is it like working for 3Pillar Global? At 3Pillar, we offer a world of opportunity: Imagine a flexible work environment – whether it's the office, your home, or a blend of both. From interviews to onboarding, we embody a remote-first approach. You will be part of a global team, learning from top talent around the world and across cultures, speaking English everyday. Our global workforce enables our team to leverage global resources to accomplish our work in efficient and effective teams. We’re big on your well-being – as a company, we spend a whole trimester in our annual cycle focused on wellbeing. Whether it is taking

Free ATS check

Applying for this Lead Data Engineer role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

How to Apply on Lever

  • Lever uses a streamlined one-page form — apply in under 5 minutes.
  • LinkedIn import works well; review parsed data before submitting.
  • The cover letter field is optional but visible to reviewers — use it to differentiate.
  • Referral codes from employees can significantly boost visibility of your application.

ANONYMOUS · UNFILTERED

What do employees actually say about 3Pillar Global?

Real rants from real employees. Read before you apply.

Read Company Rants →