Data Engineer
Actively Reviewing the ApplicationsGeekSoft Consulting
Job Description
- Help design, build and continuously improve the clients online platform.
- Research, suggest and implement new technology solutions following best practices/standards.
- Take responsibility for the resiliency and availability of different products.
- Be a productive member of the team.
Design and implement scalable data solutions within the Microsoft Fabric ecosystem, leveraging Lakehouses, Data Factory Pipelines, Dataflows (Gen2), and Spark Notebooks.
Develop high-performance data pipelines using PySpark and SQL to handle large-scale data processing and complex transformations.
Apply Medallion Architecture principles (Bronze, Silver, and Gold layers) to ensure data quality, lineage, and reliability across the enterprise.
Build robust analytical models using Star and Snowflake schemas, ensuring efficient use of Fact/Dimension tables, surrogate keys, and comprehensive source-to-target mapping.
Architect SAP data extraction workflows and implement Change Data Capture (CDC) mechanisms to maintain real-time or near-real-time data synchronization.
Provision and manage Azure Virtual Machines, including full setup and configuration to support data workloads.
Maintain a solid grasp of Azure Networking fundamentals, including VNets, Private Endpoints, and Synapse integration to ensure secure data transit.
Lead the validation of ETL/ELT lifecycles, focusing on ingestion accuracy, transformation logic, and final data reconciliation.
Execute rigorous SQL-based data validation during SIT (System Integration Testing) and UAT (User Acceptance Testing) phases.
Operate within Git-based CI/CD workflows to automate deployments and maintain version control across all data artifacts.
Azure fundamentals – VNet, Private Endpoints, Synaps
- A challenging, innovating environment.
- Opportunities for learning where needed.
Required Skills
Quick Tip
Customize your resume and cover letter to highlight relevant skills for this position to increase your chances of getting hired.
Related Similar Jobs
View All
Python Backend Developer IRC287226
GlobalLogic
Web Developer
Accenture in India
Network Specialist
Garrett - Advancing Motion
Full Stack Developer, .NET Core, SQL Server, Angular
Capgemini
Remote Software Developer (Go)
Turing
Share
Quick Apply
Upload your resume to apply for this position