Senior Data Engineer

Techwave, we are always in an exercise to foster a culture of growth, and inclusivity. We ensure whoever is associated with the brand is being challenged at every step and is provided with all the necessary opportunities to excel in life. People are at the core of everything we do.

Who are we?

Techwave is a leading global IT and engineering services and solutions company revolutionizing digital transformations. We believe in enabling clients to maximize the potential and achieve a greater market with a wide array of technology services, including, but not limited to, Enterprise Resource Planning, Application Development, Analytics, Digital, and the Internet of things (IoT).

Founded in 2004, headquartered in Houston, TX, USA, Techwave leverages its expertise in Digital Transformation, Enterprise Applications, and Engineering Services to enable businesses accelerate their growth.

Plus, we're a team of dreamers and doers who are pushing the boundaries of what's possible.

And we want YOU to be a part of it.

Job Description

About the Role

We are looking for a highly skilled Senior Databricks Data Engineer / developer to support our multinational client SAP BW/HANA / BW4HANA to a modern Databricks Lakehouse + Power BI analytics platform.

This is a key technical role that requires deep expertise in Databricks engineering and architecture, hands-on development, data modelling, and strong collaboration skills with business and IT stakeholders.

Key Responsibilities

• Participate in the implementation and enhancement of Databricks Lakehouse architectures, including ingestion, transformation, modelling, orchestration, and optimization.
• Develop scalable data pipelines using Python, SQL, Databricks Notebooks, Delta Lake, and related Azure/AWS services (depending on environment).
• Drive best practices for data quality, CI/CD, version control, lineage, and documentation.
• Contribute to the migration from SAP BW to Databricks: conceptual mapping, data modelling, performance considerations, testing, and validation.
• Support Power BI teams with clean, consumption-ready datasets and semantic models.
• Collaborate closely with the data and Analytics Team / business users to understand requirements, manage expectations, and participate in the architectural recommendations.
• Mentor junior team members and contribute to internal knowledge development.

Required Skills & Experience (Must-Have)

• Expert-level Databricks experience (min. 4–6 years, min. 2-3 full projects):
• Databricks Notebooks
• Python (PySpark)
• SQL (advanced)
• Delta Lake
• Databricks Workflows / Jobs
• Lakehouse architecture principles

• Strong experience with data engineering, ETL/ELT design, and data modelling.
• Proven track record building high-performing pipelines and optimizing large datasets in distributed environments.
• Experience working in enterprise-scale projects with structured processes, agile methods, and dev standards.
• Excellent communication skills, ability to explain complex concepts to business users, and strong client-facing confidence.

Very Useful Skills

• Experience with SAP ERP / S4HANA systems / data
• Work hands-on with SAP S/4HANA, CDS Views, and/or SAP extractors / tables to define and implement efficient data extraction (ABAP or ODP) processes.
• Experience with SAP BW (models, flows, transformations, InfoProviders).
• Ability to translate SAP/BW logic into Databricks pipelines.

Nice-to-Have Skills

• Hands-on Power BI experience: Dataflows, DAX, Star schema modelling
• Knowledge of DevOps / Git integration for Databricks.
• BW query design, reading query definitions
• Experience with other tools like: Azure Data Factory / Synapse / AWS services.

Soft Skills

• Strong analytical and problem-solving mindset.
• Confident communicator, able to build trust with business and technical stakeholders.
• Proactive, structured, and able to work independently.
• Ability to lead workshops, gather requirements, and present architecture options.

Why Join This Project?

• Work on a high-impact greenfield transformation from SAP BW to Databricks Lakehouse.
• Opportunity to shape the target architecture and influence technical decisions.
• Collaborative environment with supportive colleagues and a strategic long-term client.
• Space to innovate, learn, and apply best practices.
• Very long-term opportunity