West Monroe
Technology and Experience Practice
SeniorArchitect,Databricks
Neural analysis suggests this role is
optimal for Senior candidates.
“Senior Architect, Databricks at West Monroe. Skills: Databricks, Generative AI, Data Architecture, Cloud Data Engineering. Design data flow pipelines. Design data processing pipelines”
What You'll Achieve.
Creating measurable value for clients; Delivering real-world solutions; Generate value for years to come; Turn vision into clear action
Industry & Context.
Solving new challenges; Addressing data integrity issues
Travel requirements up to 30 to 50%, 1 to 2 days a week in office
What They're Looking For.
Must Have
10+ years of professional experience, 3+ years of experience with Databricks, 8+ years of prior consulting experience, Very technical expertise in Databricks, Experience architecting and deploying AI/ML or Generative AI solutions within enterprise environments, Hands-on experience with LLM ecosystems and frameworks, Knowledge of standard methodologies, concepts, best practices, and procedures within a Big Data environment
Nice to Have
Databricks architecture, Databricks performance optimization, Databricks Delta Lake, Databricks Unity Catalog, Databricks workflow orchestration, Databricks security, Databricks governance, Databricks cloud-native data engineering best practices, Knowledge of Retrieval-Augmented Generation (RAG), vector databases, embeddings, prompt engineering, AI orchestration patterns, AI governance, model lifecycle management, responsible AI principles, enterprise security considerations, Experience integrating AI capabilities into data platforms, analytics solutions, customer-facing applications
What You'll Do.
Design data flow pipelines
Design data processing pipelines
Design data structures
Provide data management expertise
Develop data architecture
Perform platform selection
Perform platform design
Define semantics/syntax
Define coding structures
Define mapping schemes
Productionize machine learning workloads
Productionize Generative AI workloads
Establish AI data readiness best practices
Establish feature engineering best practices
Establish model monitoring best practices
Establish observability best practices
Establish governance best practices
Lead technical discussions
Evaluate emerging AI technologies
Recommend fit-for-purpose tooling
Coordinate activities
Address data integrity issues
Liaise and attend meetings
How You'll Work.
Team & Collaboration
Collaborate with data science teams; Collaborate with engineering teams; Coordinate activities with data source application owners; Work with clients
Full Job Description
Are you ready to make an impact? West Monroe is seeking a Senior Architect to join our thriving Technology and Experience Practice. This is an excellent opportunity to work with clients developing Big Data strategy and roadmaps with emphasis on Databricks, while gaining exposure to a variety of industries including Healthcare, Financial Services, Insurance, and Utilities. Responsibilities: Design data flow and processing pipelines for analysis using modern toolsets such as Spark on Scala, Storm, Flume, Sqoop Design data structures for ingestion and reporting, specific to use case and technology Provide data management expertise to our clients in evaluating requirements and developing data architecture and performing platform selection and design. Data management includes appropriate structuring, stewardship of data, semantics/syntax of data attributes, coding structures, and mapping schemes Collaborate with data science and engineering teams to productionize machine learning and Generative AI workloads within modern cloud ecosystems Establish best practices for AI data readiness, feature engineering, model monitoring, observability, and governance Lead technical discussions around AI-enabled modernization strategies including semantic layers, vector databases, AI agents, and knowledge retrieval systems Evaluate emerging AI technologies and recommend fit-for-purpose tooling aligned to client objectives, scalability, security, and compliance requirements Guide and coach consultants, share best practices, perform code reviews Coordinate activities with data source application owners to ensure integration with analytics platform and source systems Ensure that data integrity issues are addressed Liaise and attend meetings necessary to perform duties and aid business and technical development Qualifications: 10+ years of professional experience and 3+ years of expeirence with Databricks 8+ years of prior consulting experience Very strong technical expertise in Databricks,
Applying for this Senior Architect, Databricks role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
ANONYMOUS · UNFILTERED
What do employees actually say about West Monroe?
Real rants from real employees. Read before you apply.