Description
Data Engineering Lead
We are seeking an experienced and highly skilled Data Engineering Lead to drive the design, development, and optimization of robust, scalable, and secure data pipelines and platforms. The ideal candidate will have deep expertise in data architecture, modern data processing frameworks, cloud-native technologies, and a passion for enabling data-driven decision-making across the enterprise.
As a Data Engineering Lead, you will play a critical role in shaping the organization’s data strategy, leading high-performance engineering teams, and delivering data infrastructure that powers analytics, AI/ML, and business intelligence initiatives. This role demands strong technical acumen, leadership skills, and cross-functional collaboration.
Need to know AWS OpenSearch.
Requirements
Qualifications:
Bachelor’s or Master’s degree in Computer Science, Information Systems, Data Engineering, or a related technical field.
7+ years of experience in data engineering or software engineering with a strong data focus.
Proven expertise in designing and building distributed data platforms and processing frameworks at scale.
Strong programming skills in Python, Java, or Scala and expertise in SQL.
Hands-on experience with big data technologies such as Hadoop, Spark, Kafka, Presto, or Hive.
Deep knowledge of data modeling, data warehousing (e.g., Snowflake, Redshift, BigQuery), and cloud-native databases.
Experience working with cloud platforms (AWS, GCP, Azure) and managed data services (e.g., AWS Glue, Databricks, Dataflow).
Experience with orchestration and workflow tools like Apache Airflow, Luigi, or Prefect.
Strong understanding of data governance, lineage, cataloging, and security practices.
Ability to lead cross-functional technical teams, conduct code reviews, and define coding standards and practices.
Excellent communication, analytical, and problem-solving skills.
Job responsibilities
Responsibilities:
Lead the data engineering team, owning the development and maintenance of data pipelines, data lakes, and data warehouses across structured and unstructured data sources.
Architect and implement scalable, fault-tolerant, and secure data platforms in cloud environments (AWS, Azure, or GCP).
Design and optimize ETL/ELT processes using modern tools and technologies (e.g., Apache Spark, Apache Airflow, dbt, Kafka, Glue).
Build and maintain real-time and batch data processing systems, ensuring data quality, accuracy, and lineage.
Partner with data scientists, analysts, and business teams to enable data democratization and self-service analytics.
Implement data governance, security, compliance (GDPR, HIPAA, etc.), and metadata management frameworks.
Ensure platform performance, scalability, and cost-efficiency through infrastructure optimization and capacity planning.
Lead technical design reviews, provide architectural guidance, and mentor data engineers on best practices and emerging technologies.
Drive innovation by evaluating and adopting new data tools, cloud services, and architectural patterns.
Collaborate with DevOps, Product, and Security teams to establish CI/CD pipelines, data access controls, and incident response strategies.
Document architecture, data flows, and processes to support knowledge sharing, onboarding, and auditing.
Track key data engineering KPIs such as pipeline latency, data freshness, system availability, and throughput.
What we offer
Exciting Projects: We focus on industries like High-Tech, communication, media, healthcare, retail and telecom. Our customer list is full of fantastic global brands and leaders who love what we build for them.
Collaborative Environment: You Can expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!
Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible work schedules, opportunities to work from home, and paid time off and holidays.
Professional Development: Our dedicated Learning & Development team regularly organizes Communication skills training(GL Vantage, Toast Master),Stress Management program, professional certifications, and technical and soft skill trainings.
Excellent Benefits: We provide our employees with competitive salaries, family medical insurance, Group Term Life Insurance, Group Personal Accident Insurance , NPS(National Pension Scheme ), Periodic health awareness program, extended maternity leave, annual performance bonuses, and referral bonuses.
Fun Perks: We want you to love where you work, which is why we host sports events, cultural activities, offer food on subsidies rates, Corporate parties. Our vibrant offices also include dedicated GL Zones, rooftop decks and GL Club where you can drink coffee or tea with your colleagues over a game of table and offer discounts for popular stores and restaurants!
About GlobalLogic
GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward-thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.
