Weekday AI
AzureDatabricksEngineer
Neural analysis suggests this role is
optimal for Senior candidates.
“Azure Databricks Engineer at Weekday AI. Skills: Databricks, PySpark, SQL, Data pipelines. Design data pipelines. Develop data pipelines”
What You'll Achieve.
Deliver high-quality data solutions
Industry & Context.
Problem-solving abilities
What They're Looking For.
Must Have
4+ years experience, Bachelor's degree in Computer Science, Demonstrated experience in constructing and managing data pipelines within cloud environments, Analytical and problem-solving abilities, Databricks proficiency, PySpark proficiency, SQL proficiency
Nice to Have
Master's degree, Experience with Azure cloud services, Experience with AWS services, Familiarity with workflow orchestration tools, Experience using data transformation and integration tools, Understanding of streaming and messaging platforms, BI and data visualization skills, Experience with data governance tools, Knowledge of Google Cloud Platform’s BigQuery, Experience operating in multi-cloud environments, Familiarity with modern data stack technologies, Familiarity with data governance frameworks
What You'll Do.
Design data pipelines
Develop data pipelines
Develop ETL workflows
Work with data architects
Work with business stakeholders
Deliver data solutions
Maintain data quality
Maintain data governance
Integrate data from diverse sources
Handle large-scale datasets
Improve performance of data workflows
Improve performance of queries
How You'll Work.
Team & Collaboration
Work with stakeholders
Communication Scope
Communication skills
Full Job Description
**This role is for one of the Weekday's clients** Min Experience: 4+ years Location: Bengaluru, Pune JobType: full-time We are looking for a highly skilled Databricks Engineer to design, develop, and optimize data pipelines and analytics solutions. The ideal candidate will have strong expertise in Databricks, PySpark, and SQL, along with experience in creating scalable data solutions across cloud platforms. **Requirements** **Key Responsibilities** * Design and develop data pipelines and ETL workflows using Databricks and PySpark. * Create and enhance SQL queries for data transformation and analytical purposes. * Work closely with data architects, analysts, and business stakeholders to deliver high-quality data solutions. * Maintain data quality, governance, and compliance throughout all processes. * Integrate data from diverse sources and effectively handle large-scale datasets. * Diagnose issues and improve the performance of data workflows and queries. **Primary Skills (Must-Have)** * Strong proficiency in Databricks, including Delta Lake and machine learning capabilities. * Advanced expertise in PySpark for distributed data processing. * Excellent SQL skills for data manipulation and analytics. **Good-to-Have Skills** * Experience with cloud services on Azure (ADF, Synapse, Purview, Fabric). * Knowledge of AWS services such as Glue, Lambda, and Step Functions. * Familiarity with workflow orchestration tools like Airflow. * Experience using data transformation and integration tools including DBT, Fivetran, and Informatica. * Understanding of streaming and messaging platforms like Kafka. * BI and data visualization skills with Power BI. * Experience with data governance tools such as Collibra and Alation. * Knowledge of Google Cloud Platform’s BigQuery. **Qualifications** * Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related discipline. * Demonstrated experience in constructing and managing data pipelines within cloud environments. *
Applying for this Azure Databricks Engineer role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
ANONYMOUS · UNFILTERED
What do employees actually say about Weekday AI?
Real rants from real employees. Read before you apply.