Bestkaam Logo
Bestkaam Logo
Join as Employer Sign In Sign Up
Back to Jobs
Altraize Logo

Senior PySpark Developer

Actively Reviewing the Applications

Altraize

India, Kerala Full-Time On-site
Posted 2 weeks ago • Apply by June 6, 2026

Job Description

We are looking for a Senior PySpark Developer with strong hands-on experience

working on the Cloudera stack. The role involves building and maintaining large-scale

data processing and ETL pipelines using PySpark. Experience in finance or

banking environments is a plus.

Experience: 5+ years

Key Responsibilities

  • Develop and maintain PySpark-based ETL pipelines on the Cloudera platform
  • Write efficient PySpark and Spark SQL transformations
  • Process large volumes of structured and semi-structured data
  • Optimize Spark jobs for performance and scalability
  • Create and manage Hive tables and partitions
  • Handle data validation, reconciliation, and error handling
  • Support production deployments and troubleshoot issues
  • Work closely with data engineers and business teams

Primary Skill (Mandatory)

  • Strong PySpark experience (5+ years)
  • DataFrame API
  • Spark SQL
  • Performance tuning (joins, partitions, shuffles)
  • Batch data processing

Required Skills

  • Strong Python programming skills
  • Good SQL knowledge
  • Experience with large-scale data processing
  • Git or similar version control tools

Skills: git,pyspark,python

Required Skills

Git Performance Tuning Python SQL Reconciliation Spark Hive ETL Validation Version control Data processing Data validation PySpark SQL knowledge Partitions Error handling ETL Pipelines Batch Spark SQL DataFrame API
Check Qualification

Quick Tip

Customize your resume and cover letter to highlight relevant skills for this position to increase your chances of getting hired.

Related Similar Jobs

View All
Golden Opportunities

Java Full stack - MSB - GO/JC/2250/2026

Golden Opportunities

India Full-Time ₹1–4 LPA
Git DynamoDB Jenkins +6
Cisco

Software Engineer

Cisco

India Full-Time ₹1–4 LPA
Python Terraform Ansible
DISH Network Technologies

Lead Engineer - Full Stack Development

DISH Network Technologies

India Full-Time
Communication Engineering AWS +15
ISS | Institutional Shareholder Services

Senior Full Stack Developer - Java & React

ISS | Institutional Shareholder Services

India Full-Time
API Integration Python SQL Server +6
IBM

Application Developer-Java & Web Technologies

IBM

Bengaluru Full-Time
Testing Java Server Page Git