Job Category: Tech Jobs
Hiring For: Tech Mahindra
Job Location: Bangalore Chennai Hyderabad Pune
Experience: 5 to 9 Yrs
Must have skills :
- Experience on Ingestion framework
- Hadoop Cloudera , HDFS, HIVE
- Language – Python , Pyspark
Good to have
· Cloud services – Azure , ADF , Event Hub
- Tools & Service – CI/CD (GitLab/GitHub, Ansible, ETL , Pipeline , workflow
- Domain – Telecom
- Real time Service – Kafka, Spark Steaming , Flink
Job Description:
We are seeking an experienced Transformation Speed Layer Engineer to join our data engineering team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures that enable fast and reliable data transformation and processing.
- Design, develop, and maintain data pipelines and architectures that enable fast data transformation and processing.
- Work with cross-functional teams to identify and prioritize data transformation requirements.
- Develop and maintain data processing workflows using technologies such as Apache Beam, Apache Spark, or similar.
- Ensure data quality, integrity, and security throughout the data transformation process.
- Collaborate with data scientists and analysts to develop and optimize data models and algorithms.
- Optimize data pipeline performance, scalability, and reliability.
- Develop and maintain technical documentation for data pipelines and architectures.
