Eucloid - Principal Data Engineer - Python/Scala
Actively Reviewing the ApplicationsEucloid Data Solutions
India, Tamil Nadu, Chennai
Full-Time
On-site
Posted 2 weeks ago
•
Apply by June 4, 2026
Job Description
Job Description
We are seeking a highly experienced Principal Data Engineer / Senior Data Architect to lead the design, architecture, and scalability of modern data platforms. This role requires deep expertise in building enterprise-grade data ecosystems across cloud, real-time, batch, governance, and AI-ready infrastructure. You will own the end-to-end data architecture vision from ingestion and transformation to analytics, ML enablement, governance, and cost optimization.
Key Responsibilities Architecture & Platform Design
We are seeking a highly experienced Principal Data Engineer / Senior Data Architect to lead the design, architecture, and scalability of modern data platforms. This role requires deep expertise in building enterprise-grade data ecosystems across cloud, real-time, batch, governance, and AI-ready infrastructure. You will own the end-to-end data architecture vision from ingestion and transformation to analytics, ML enablement, governance, and cost optimization.
Key Responsibilities Architecture & Platform Design
- Architect scalable data lakehouse and warehouse platforms
- Define canonical data models and domain-driven data architecture
- Design medallion (Bronze/Silver/Gold) architectures
- Establish data standards, governance, and security frameworks
- Evaluate and select cloud-native data tools
- Build high-performance ETL/ELT pipelines (batch + streaming)
- Architect real-time data pipelines using event-driven systems
- Optimize large-scale distributed data processing systems
- Implement CI/CD for data engineering workflows
- Ensure reliability, scalability, and observability
- Hands-on experience with Amazon Web Services, Microsoft Azure, or Google Cloud
- Strong expertise in Databricks, Snowflake, Apache Kafka, Airflow.
- Design data platforms optimized for BI and AI workloads
- Enable feature stores and ML-ready datasets
- Support GenAI and advanced analytics use cases
- Ensure high data quality and lineage tracking
- Implement RBAC, encryption, and data masking
- Design cost-aware architectures
- Monitor usage and optimize cloud spend
- Define data SLAs and reliability frameworks.
- Lead and mentor data engineering teams
- Conduct architecture reviews
- Partner with product, AI, and business teams
- Define long-term data strategy and roadmap
- Drive technical excellence and coding standards.
- 8+ years of experience in data engineering / data architecture
- Proven experience designing large-scale data platforms
- Deep expertise in distributed systems
- Strong SQL and Python/Scala skills
- Experience handling TB-PB scale datasets
- Strong understanding of data modeling (dimensional + data vault)
- Experience with real-time and streaming architecture
- Experience leading technical teams.
- Experience in FinTech, SaaS, or enterprise consulting
- Experience building data engineering practice from scratch
- Exposure to AI/ML infrastructure
- Certifications in AWS/Azure/GCP
- Experience with multi-cloud environments
Required Skills
Engineering
Leadership
Python
SQL
Data Modeling
AWS/Azure/GCP
AWS
Scala
Snowflake
Microsoft Azure
Kafka
Azure
Encryption
Apache Kafka
Airflow
Databricks
ETL
Data Engineering
CI/CD
Apache
Analytics
Data quality
Governance
Cost optimization
Data architecture
Data strategy
Web Services
Consulting
Architecture design
Data models
Data processing
Modeling
RBAC
Data platforms
Security frameworks
Data Vault
Data pipelines
Event-driven
Data Standards
Advanced Analytics
Distributed Systems
Cloud environments
Data Masking
Data Architecture Design
GenAI
Observability
Batch
Lakehouse
Dimensional
ELT
Vault
AI/ML
Modern Data Stack
Quick Tip
Customize your resume and cover letter to highlight relevant skills for this position to increase your chances of getting hired.
Related Similar Jobs
View All
Category Development Manager, Amazon Now, Amazon Now
Amazon
India
Full-Time
Sales
Salesforce
Leadership
+22
Remote Project Manager Role
Jobgether
India
Full-Time
₹1–1 LPA
Engineering
Technical Account Manager
DDN
Communication
Problem Solving
Sales
+43
Manager - SAP Data Analyst
John Cockerill
Mumbai
Full-Time
SAP
Configuration management
Engineering
+1
Senior Manager - Campaign Management
Medanta
India
Full-Time
Sales
Pharmacy
Analytics
Share
Quick Apply
Upload your resume to apply for this position