Job Search
We can help you build an exceptional career
Senior Data Engineer IRC235947
| Job | IRC235947 |
| Location | India - Noida |
| Designation | Senior Software Engineer |
| Experience | 3-5 years |
| Function | Engineering |
| Skills | AWS Athena, Azure Datawarehouse, BigQuery, Databases, Databricks, Snowflake |
| Work Model: | Hybrid |
Description
Seeking a highly motivated and experienced Data Engineer responsible for designing, developing, and implementing solutions that enable seamless data integration across multiple cloud platforms. This includes leveraging expertise in data lake architecture, Iceberg tables, and cloud compute engines like Snowflake, BigQuery, and Athena to ensure efficient and reliable data access for various downstream applications.
Responsibilities:
• Data Lake Design & Implementation:
○ Collaborate with stakeholders to understand data needs and define schemas.
○ Design and implement data pipelines for ingesting, transforming, and storing data
• Multi-Cloud Data Integration:
○ Develop data transformation logic to make Iceberg tables compatible with the data access requirements of Snowflake, BigQuery, and Athena.
○ Design and implement solutions for seamless data transfer and synchronization across different cloud platforms.
○ Ensure data consistency and quality across the data lake and target cloud environments.
• Data Optimization & Performance Tuning:
○ Analyze data patterns and identify performance bottlenecks in data pipelines.
○ Implement data optimization techniques to improve query performance and reduce data storage costs.
○ Monitor data lake health and proactively address potential issues.
• Collaboration & Communication:
○ Collaborate with architect, leads, and other stakeholders to ensure data quality meet specific requirements.
○ Communicate technical details and updates clearly and effectively.
○ Contribute to best practices and knowledge sharing within the team.
Qualifications:
• Minimum 4+ years of experience as a Data Engineer.
• Strong hands-on experience with data lake architectures and technologies, including:
○ Data lake frameworks like AWS S3, Azure Data Lake Storage, or Google Cloud Storage.
○ Iceberg tables for data management and versioning.
• Proven expertise in using and optimizing cloud compute engines:
○ Snowflake, BigQuery, and Athena.
• Deep understanding of data transformation and ETL processes.
• Proficiency in SQL and scripting languages
• Experience with data governance and security best practices.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Handson experience on different integration pattern and connectors for compute engines Bigquery,Snowflake, Athena
• Experience with cloud-native data tools and services (e.g., Spark, Databricks).
• Familiarity with DevOps principles and automation tools.
• Certifications in relevant cloud technologies.
Requirements
Seeking a highly motivated and experienced Data Engineer responsible for designing, developing, and implementing solutions that enable seamless data integration across multiple cloud platforms. This includes leveraging expertise in data lake architecture, Iceberg tables, and cloud compute engines like Snowflake, BigQuery, and Athena to ensure efficient and reliable data access for various downstream applications.
Responsibilities:
• Data Lake Design & Implementation:
○ Collaborate with stakeholders to understand data needs and define schemas.
○ Design and implement data pipelines for ingesting, transforming, and storing data
• Multi-Cloud Data Integration:
○ Develop data transformation logic to make Iceberg tables compatible with the data access requirements of Snowflake, BigQuery, and Athena.
○ Design and implement solutions for seamless data transfer and synchronization across different cloud platforms.
○ Ensure data consistency and quality across the data lake and target cloud environments.
• Data Optimization & Performance Tuning:
○ Analyze data patterns and identify performance bottlenecks in data pipelines.
○ Implement data optimization techniques to improve query performance and reduce data storage costs.
○ Monitor data lake health and proactively address potential issues.
• Collaboration & Communication:
○ Collaborate with architect, leads, and other stakeholders to ensure data quality meet specific requirements.
○ Communicate technical details and updates clearly and effectively.
○ Contribute to best practices and knowledge sharing within the team.
Qualifications:
• Minimum 4+ years of experience as a Data Engineer.
• Strong hands-on experience with data lake architectures and technologies, including:
○ Data lake frameworks like AWS S3, Azure Data Lake Storage, or Google Cloud Storage.
○ Iceberg tables for data management and versioning.
• Proven expertise in using and optimizing cloud compute engines:
○ Snowflake, BigQuery, and Athena.
• Deep understanding of data transformation and ETL processes.
• Proficiency in SQL and scripting languages
• Experience with data governance and security best practices.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Handson experience on different integration pattern and connectors for compute engines Bigquery,Snowflake, Athena
• Experience with cloud-native data tools and services (e.g., Spark, Databricks).
• Familiarity with DevOps principles and automation tools.
• Certifications in relevant cloud technologies.
Job Responsibilities
Seeking a highly motivated and experienced Data Engineer responsible for designing, developing, and implementing solutions that enable seamless data integration across multiple cloud platforms. This includes leveraging expertise in data lake architecture, Iceberg tables, and cloud compute engines like Snowflake, BigQuery, and Athena to ensure efficient and reliable data access for various downstream applications.
Responsibilities:
• Data Lake Design & Implementation:
○ Collaborate with stakeholders to understand data needs and define schemas.
○ Design and implement data pipelines for ingesting, transforming, and storing data
• Multi-Cloud Data Integration:
○ Develop data transformation logic to make Iceberg tables compatible with the data access requirements of Snowflake, BigQuery, and Athena.
○ Design and implement solutions for seamless data transfer and synchronization across different cloud platforms.
○ Ensure data consistency and quality across the data lake and target cloud environments.
• Data Optimization & Performance Tuning:
○ Analyze data patterns and identify performance bottlenecks in data pipelines.
○ Implement data optimization techniques to improve query performance and reduce data storage costs.
○ Monitor data lake health and proactively address potential issues.
• Collaboration & Communication:
○ Collaborate with architect, leads, and other stakeholders to ensure data quality meet specific requirements.
○ Communicate technical details and updates clearly and effectively.
○ Contribute to best practices and knowledge sharing within the team.
Qualifications:
• Minimum 4+ years of experience as a Data Engineer.
• Strong hands-on experience with data lake architectures and technologies, including:
○ Data lake frameworks like AWS S3, Azure Data Lake Storage, or Google Cloud Storage.
○ Iceberg tables for data management and versioning.
• Proven expertise in using and optimizing cloud compute engines:
○ Snowflake, BigQuery, and Athena.
• Deep understanding of data transformation and ETL processes.
• Proficiency in SQL and scripting languages
• Experience with data governance and security best practices.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Handson experience on different integration pattern and connectors for compute engines Bigquery,Snowflake, Athena
• Experience with cloud-native data tools and services (e.g., Spark, Databricks).
• Familiarity with DevOps principles and automation tools.
• Certifications in relevant cloud technologies.
We Offer
Exciting Projects: We focus on industries like High-Tech, communication, media, healthcare, retail and telecom. Our customer list is full of fantastic global brands and leaders who love what we build for them.
Collaborative Environment: You Can expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!
Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible work schedules, opportunities to work from home, and paid time off and holidays.
Professional Development: Our dedicated Learning & Development team regularly organizes Communication skills training(GL Vantage, Toast Master),Stress Management program, professional certifications, and technical and soft skill trainings.
Excellent Benefits: We provide our employees with competitive salaries, family medical insurance, Group Term Life Insurance, Group Personal Accident Insurance , NPS(National Pension Scheme ), Periodic health awareness program, extended maternity leave, annual performance bonuses, and referral bonuses.
Fun Perks: We want you to love where you work, which is why we host sports events, cultural activities, offer food on subsidies rates, Corporate parties. Our vibrant offices also include dedicated GL Zones, rooftop decks and GL Club where you can drink coffee or tea with your colleagues over a game of table and offer discounts for popular stores and restaurants!