Senior Databricks Consultant Job at MAU Workforce Solutions, Atlanta, GA

TFJ3dStvWFBtZHZuRzJldEZrdWFPU254YXc9PQ==
  • MAU Workforce Solutions
  • Atlanta, GA

Job Description

We are seeking an experienced Senior Databricks Consultant to design, build, and maintain a scalable Data Lakehouse solutions. The ideal candidate will collaborate with cross-functional teams—including data scientists, analysts, and software engineers—to deliver high-quality, secure, and efficient data solutions that support our business objectives.

Key Responsibilities:

  • Design, develop, and maintain robust data pipelines, data products and ETL/ELT processes using Databricks and Apache Spark.
  • Integrate Databricks with various data sources (cloud storage, databases, APIs) and platforms.
  • Optimize data pipelines for performance, reliability, and cost-efficiency.
  • Implement and monitor data quality checks, validation, and data governance best practices.
  • Collaborate with data scientists and analysts to understand requirements and deliver actionable data solutions.
  • Document technical designs, workflows, and data models to ensure knowledge sharing and maintainability.
  • Configure and manage Databricks environments, including clusters, notebooks, and security settings.
  • Troubleshoot and resolve issues related to Databricks performance, data quality, and infrastructure.
  • Stay current with the latest Databricks features, big data technologies, and best practices.
  • Provide mentorship and technical guidance to junior team members as needed.

Required Qualifications:

  • Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field.
  • 3+ years of experience in data engineering, with hands-on experience in Databricks and Apache Spark.
  • Strong proficiency in programming languages such as Python and SQL; Scala is a plus.
  • Experience with big data technologies (e.g., Hadoop, Kafka).
  • Solid understanding of data warehousing concepts, data modeling, and ETL/ELT processes.
  • Familiarity with cloud platforms (Azure, AWS, or GCP) and integrating Databricks with cloud services.
  • Experience with data governance, security, and compliance, including RBAC and audit logging.
  • Strong problem-solving, analytical, and communication skills.

Preferred Qualifications:

  • Databricks certification (e.g., Databricks Certified Data Engineer Associate).
  • Knowledge of Delta Lake, MLflow, or similar Databricks ecosystem tools.
  • Experience with data streaming and real-time analytics.
  • Familiarity with Agile/Scrum methodologies.

Key Skills:

  • Databricks
  • Apache Spark
  • Python & SQL
  • Data Modeling & Warehousing
  • ETL/ELT Process Design
  • Cloud Platforms (Azure, AWS, GCP)
  • Data Governance & Security
  • Performance Optimization
  • Technical Documentation

Job Tags

Similar Jobs

Oso

Developer Experience Engineer Job at Oso

Old problem, new $25B+ market Companies like AWS, Stripe, and Twilio have shown that if a technology isn't core to your value proposition, you should offload it. Still, every engineering team builds and rebuilds one piece: authorization , how you control who has access...

Delta-T Group Inc.

Residential Monitors -$17/hr. - 2nd shifts Job at Delta-T Group Inc.

 ...Education: b Celebrating 35 years in business, DELTA-T Group, Western PA Office has a client in need of RESIDENT MONITORS to supervise higher functioning consumers in the Wilkinsburg area. Shifts available ASAP. SUPPLEMENT YOUR INCOME! CLIENT'S HOURLY COMPENSATION... 

Northeast Healthcare Recruitment, Inc.

Nurse Practitioner NP Community Care 10k Sign On Bonus Job at Northeast Healthcare Recruitment, Inc.

 ...patients and families.Delivers quality care while maintaining all company metrics pertaining to appropriate documentation.coding, HEDIS measure, engagement of patients and managing medical expense.Qualifications:Experience in family practice, geriatrics, hospice... 

Baxter International Inc

Inspector, Sr. Quality Job at Baxter International Inc

 ...This is where you save and sustain lives At Baxter, we are deeply connected by our mission. No matter your role at Baxter, your work makes a positive impact on people around the world. Youll feel a sense of purpose throughout the organization, as we know our work... 

Epic Games

Art Director Job at Epic Games

 ...the bar of engine and game development. ART What We Do Push your artistic talent to the limit on a team of world-class environment, character and concept artists who...  ...across all art disciplines - concept, modeling, environment, tech art, lighting, VFX, etc....