Bestkaam Logo
Bestkaam Logo
Join as Employer Sign In Sign Up
Back to Jobs
UST Logo

Lead II - Data Engineering

Actively Reviewing the Applications

UST

India, Kerala, Trivandrum Full-Time On-site
Posted 4 weeks ago • Apply by June 7, 2026

Job Description

Role Description

  • Design and develop scalable ETL/ELT pipelines using Databricks.
  • Build and optimize data workflows using Apache Spark (PySpark/Scala).
  • Implement data transformation and ingestion frameworks for batch and streaming data.
  • Develop and manage Delta Lake tables using Delta Lake architecture.
  • Optimize performance of Spark jobs and SQL queries.
  • Collaborate with Data Scientists, Analysts, and BI teams for data modeling and analytics requirements.
  • Implement data quality, governance, and security best practices.
  • Work with orchestration tools like Airflow / ADF / Databricks Workflows.
  • Monitor, troubleshoot, and optimize production pipelines.
  • Participate in CI/CD processes for data engineering workflows

Skills

data engineering,databricks,data analysis,data modeling,

Required Skills

Engineering Apache Spark SQL Data Modeling Scala Spark Airflow Databricks ETL Data Engineering CI/CD Apache Analytics Data quality ADF Governance Orchestration Modeling SQL Queries Ingestion Data transformation Delta PySpark Batch ELT
Check Qualification

Quick Tip

Customize your resume and cover letter to highlight relevant skills for this position to increase your chances of getting hired.

Related Similar Jobs

View All
Cuscal Limited

Solution Architect (Acquiring Services)

Cuscal Limited

India Full-Time
TALENTMATE

Engineer 2 Software Development And Engineering

TALENTMATE

India Full-Time
Engineering Debugging
Reboot Monkey

Data Center Technician - India - Pondicherry - On-site

Reboot Monkey

India Other
Engineering
EXL

1985212-Lead Assistant Manager

EXL

India Full-Time ₹3–4 LPA
Data Mining Analytics
Enverus

Product Marketing Manager - 2613

Enverus

India Full-Time ₹1–2 LPA
Analytics