Weekday AI
AzureDatabricksDeveloper
Neural analysis suggests this role is
optimal for Senior candidates.
“Azure Databricks Developer at Weekday AI. Skills: Databricks, PySpark, SQL, Data pipelines. Design data pipelines. Develop data pipelines”
Industry & Context.
Analytical; Problem-solving
What They're Looking For.
Must Have
4+ years Databricks, 4+ years PySpark, 4+ years SQL, Bachelor's degree
Nice to Have
Azure cloud services experience, AWS services experience, Airflow experience, DBT experience, Fivetran experience, Informatica experience, Kafka experience, Power BI experience, Collibra experience, Alation experience, BigQuery knowledge, Multi-cloud environments experience, Modern data stack knowledge, Data governance frameworks knowledge
What You'll Do.
Design data pipelines
Develop data pipelines
Develop ETL workflows
Work with data architects
Work with business stakeholders
Deliver data solutions
Maintain data quality
Maintain data governance
Integrate data from sources
Handle large-scale datasets
Improve performance of data workflows
Improve performance of queries
How You'll Work.
Team & Collaboration
Work with data architects; Work with analysts; Work with business stakeholders
Full Job Description
**This role is for one of the Weekday's clients** Min Experience: 4+ years Location: Bengaluru, Pune JobType: full-time We are looking for a highly skilled Databricks Engineer to design, develop, and optimize data pipelines and analytics solutions. The ideal candidate will have strong expertise in Databricks, PySpark, and SQL, along with experience in creating scalable data solutions across cloud platforms. **Requirements** **Key Responsibilities** * Design and develop data pipelines and ETL workflows using Databricks and PySpark. * Create and enhance SQL queries for data transformation and analytical purposes. * Work closely with data architects, analysts, and business stakeholders to deliver high-quality data solutions. * Maintain data quality, governance, and compliance throughout all processes. * Integrate data from diverse sources and effectively handle large-scale datasets. * Diagnose issues and improve the performance of data workflows and queries. **Primary Skills (Must-Have)** * Strong proficiency in Databricks, including Delta Lake and machine learning capabilities. * Advanced expertise in PySpark for distributed data processing. * Excellent SQL skills for data manipulation and analytics. **Good-to-Have Skills** * Experience with cloud services on Azure (ADF, Synapse, Purview, Fabric). * Knowledge of AWS services such as Glue, Lambda, and Step Functions. * Familiarity with workflow orchestration tools like Airflow. * Experience using data transformation and integration tools including DBT, Fivetran, and Informatica. * Understanding of streaming and messaging platforms like Kafka. * BI and data visualization skills with Power BI. * Experience with data governance tools such as Collibra and Alation. * Knowledge of Google Cloud Platform’s BigQuery. **Qualifications** * Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related discipline. * Demonstrated experience in constructing and managing data pipelines within cloud environments. *
Applying for this Azure Databricks Developer role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
ANONYMOUS · UNFILTERED
What do employees actually say about Weekday AI?
Real rants from real employees. Read before you apply.