Job Category: Tech Jobs
Hiring For: Tech Mahindra
Job Location: Bangalore Hyderabad
Experience: 8 Years to 12 Years
Job Summary:
We are hiring an experienced Azure Data Engineer with strong hands-on expertise in Azure Databricks. The ideal candidate will design and build scalable data pipelines and solutions using core Azure data services to support analytics and business intelligence needs.
Key Responsibilities:
- Develop and maintain scalable ETL/ELT pipelines using Azure Databricks, Azure Data Factory, and PySpark.
- Design and implement data lake solutions using Azure Data Lake Storage (ADLS) and Delta Lake.
- Optimize Spark-based data processing and ensure high performance of data pipelines.
- Integrate data from various sources into the Azure ecosystem.
- Implement data quality, security, and monitoring best practices.
- Collaborate with analysts, data scientists, and business stakeholders.
- Maintain documentation and ensure delivery of clean, production-ready data solutions.
Required Skills:
- Strong experience with Azure Databricks and PySpark.
- Proficiency in Azure Data Factory, SQL, Spark, and Delta Lake.
- Hands-on experience with Azure Data Lake, Synapse Analytics, and CI/CD using Azure DevOps.
- Solid understanding of data architecture, ETL workflows, and data governance.
- Excellent problem-solving and communication skills.
Preferred Qualifications:
- Azure Data Engineer Associate Certification.
- Experience with streaming data (Event Hubs, Kafka) and machine learning integrations.
