Job Category: Tech Jobs
Hiring For: Tech Mahindra
Job Location: Chennai Hyderabad Pune
Referral Bonus: up to 25000
Experience: 8 - 12 years
Salary Upto: 2500000
Position Overview: We are seeking a Senior GCP Data Engineer with extensive experience in designing, implementing, and maintaining data pipelines and solutions on Google Cloud Platform (GCP). The ideal candidate should have a solid understanding of GCP services, particularly API Gateway, Pub/Sub, BigQuery, and proficiency in Python scripting. Additionally, familiarity with PowerBI for visualization and strong data modeling skills will be advantageous.
Responsibilities:
- Design, build, and maintain scalable data pipelines and infrastructure on Google Cloud Platform.
- Develop ETL processes to transform raw data into valuable insights using GCP services such as Pub/Sub and BigQuery.
- Collaborate with data scientists and analysts to understand data requirements and implement solutions.
- Optimize and tune existing data pipelines for performance and reliability.
- Ensure data quality and consistency throughout the data lifecycle.
- Implement security and data protection measures in compliance with company policies and regulations.
- Troubleshoot data infrastructure and performance issues across various GCP services.
- Document design decisions, processes, and infrastructure for reference purposes.
Required Skills and Qualifications:
- Bachelor’s degree in Computer Science, Engineering, or a related field. (Master’s degree preferred)
- 8+ years of experience as a Data Engineer, with a proven track record of designing and implementing data solutions on Google Cloud Platform.
- Proficiency in GCP services such as API Gateway, Pub/Sub, and BigQuery.
- Strong programming skills in Python for data processing and automation.
- Experience with data modeling techniques and designing efficient schemas.
- Familiarity with data visualization tools, especially PowerBI.
- Excellent analytical and problem-solving skills.
- Strong communication and collaboration skills to work effectively in a team environment.
- Ability to prioritize and manage multiple tasks in a dynamic work environment.
Preferred Qualifications:
- Google Cloud certifications (e.g., Professional Data Engineer, Associate Cloud Engineer).
- Experience with other cloud platforms (AWS, Azure) is a plus.
- Knowledge of machine learning concepts and frameworks.