Azure Data Engineer

Hiring for Azure Data Engineer? - Experience: 8+ years - Location: Chennai, Hyderabad, Bangalore? - Notice Period: Immediate to 30 days Key Responsibilities - Data Pipelines: Build pipelines for raw data ingestion and orchestration using Azure Data Factory (ADF) and Databricks - Data Transformation: Develop and maintain innovative Azure solutions, perform transformation using Databricks notebooks with PySpark - Data Optimization: Ensure data is cleansed, mapped, transformed, and optimized for storage and use according to business and technical requirements - Troubleshooting: Quickly trace out issues with Databricks Workflows and optimize data load for faster processing Required Skills - ADF: Experience with Azure Data Factory - Databricks: Experience with Databricks and PySpark - PySpark: Strong knowledge of PySpark - CI/CD: Good knowledge of CI/CD process using GitHub and hands-on experience with Airflow How to Apply If you're interested in this opportunity, please send your CV to Shabnam.h@data-engine.co