Bestkaam Logo
Altraize Logo

Senior PySpark Developer

Actively Reviewing the Applications

Altraize

India, Kerala Full-Time On-site
Posted 2 weeks ago Apply by June 6, 2026

Job Description

We are looking for a Senior PySpark Developer with strong hands-on experience

working on the Cloudera stack. The role involves building and maintaining large-scale

data processing and ETL pipelines using PySpark. Experience in finance or

banking environments is a plus.

Experience: 5+ years

Key Responsibilities

  • Develop and maintain PySpark-based ETL pipelines on the Cloudera platform
  • Write efficient PySpark and Spark SQL transformations
  • Process large volumes of structured and semi-structured data
  • Optimize Spark jobs for performance and scalability
  • Create and manage Hive tables and partitions
  • Handle data validation, reconciliation, and error handling
  • Support production deployments and troubleshoot issues
  • Work closely with data engineers and business teams

Primary Skill (Mandatory)

  • Strong PySpark experience (5+ years)
  • DataFrame API
  • Spark SQL
  • Performance tuning (joins, partitions, shuffles)
  • Batch data processing

Required Skills

  • Strong Python programming skills
  • Good SQL knowledge
  • Experience with large-scale data processing
  • Git or similar version control tools

Skills: git,pyspark,python
Check Qualification

Quick Tip

Customize your resume and cover letter to highlight relevant skills for this position to increase your chances of getting hired.