ABOUT THE ROLE
In this role, you will build and optimize scalable data solutions on the Databricks platform, working with large-scale datasets and modern cloud-based data architectures. You will develop reliable data pipelines, support analytics and data transformation initiatives, and collaborate with cross-functional teams to deliver production-ready data solutions throughout the project lifecycle.
RESPONSIBILITIES
- Design, develop, and maintain scalable data pipelines using Databricks, Python, SQL, and dbt
- Build and optimize data transformation workflows for large datasets, ensuring performance, reliability, and maintainability
- Develop and optimize SQL queries to support complex transformations, analytics, and reporting workloads
- Create and maintain data models using dbt, including testing, documentation, and data quality validation
- Implement orchestration, monitoring, and CI/CD practices for data engineering workflows
- Collaborate with technical and business stakeholders to understand requirements and deliver effective data solutions
- Participate in data platform optimization, troubleshooting, and continuous improvement initiatives
- Contribute throughout the full project lifecycle, from solution design to production deployment
REQUIREMENTS
- 5+ years of experience in Data Engineering or related fields
- Hands-on production experience with Databricks for developing and maintaining data engineering solutions
- Strong SQL skills, including writing, optimizing, and debugging complex queries across large datasets
- Production experience with Python for data engineering, automation, or analytics workflows
- Experience designing and maintaining scalable data pipelines and cloud-based data platforms
- Familiarity with orchestration frameworks, data quality validation, and CI/CD practices for data workflows
- Strong communication and collaboration skills with technical and business stakeholders
- Practical experience with dbt, including data transformation, modeling, testing, and documentation (as a plus)
- Intermediate strong or higher level of English
BENEFITS
- Work from home, from the office, or in a hybrid format that supports focus and collaboration.
- Competitive, market-based pay, benchmarked by role and location - plus health coverage, paid time off, wellness support, and learning opportunities.
- Approachable leaders who communicate openly, keep teams close to the strategy, and support long-term planning.
SoftServe is an equal opportunity employer. Qualified applicants will receive consideration regardless of race, color, ancestry, ethnicity, national origin, religion, sex, sexual orientation, gender identity or expression, age, citizenship, disability, health condition, marital or family status, veteran status, or any other characteristic protected by applicable law.
Senior/Lead Big Data Engineer (Databricks) Arbeitgeber: SoftServe
SoftServe ist ein hervorragender Arbeitgeber, der seinen Mitarbeitern die Möglichkeit bietet, an innovativen Projekten im Bereich Daten und maschinelles Lernen zu arbeiten. Mit einem flexiblen Arbeitsmodell, das Homeoffice, Büroarbeit oder hybride Formate umfasst, fördert das Unternehmen eine offene und unterstützende Unternehmenskultur, in der persönliche und berufliche Entwicklung großgeschrieben werden. Die Mitarbeiter profitieren von wettbewerbsfähigen Gehältern, umfassenden Gesundheitsleistungen und einer Vielzahl von Lernmöglichkeiten, die ihre Karriere vorantreiben.
