Big Data Engineer IRC286638

Description

Senior Data Engineer to design, build, and optimize scalable data platforms that support large-scale data ingestion, processing, and analytics. The ideal candidate will have strong expertise in Apache Spark, Hadoop ecosystems, Elasticsearch on OpenShift, and building reliable ETL pipelines and data lakes. Experience with ArgoCD and Scala is highly preferred.

Requirements

Job Description
Bachelor’s degree in Computer Science, Software Engineering or related field
10+ Years of experience working on any public cloud platforms, preferably AWS and an excellent grasp of the following:
Development of Complex Data Ingestion & Transformation Pipelines
Spark Programming hands-on experience (Scala, Python, PySpark, SparkSQL)
Strong Apache Spark and Elasticsearch expertise.
Good understanding of OpenShift, specifically running ElasticSearch on OpenShift
DevOps skills, preferably ArgoCD would be a big plus
Databricks/Hive/Data lake/Delta lake
Excellent grasp of data warehousing and ETL/ELT use cases and patterns at scale
The ability to apply such methods to solve business problems in combination with building data pipelines, data streams, and system integration.
Support the planning and implementation of data design services, providing sizing and configuration assistance and performing needs assessments.
Translate business requirements to technical solutions leveraging strong business acumen.
Analyze current business practices, processes, and procedures as well as identify future business opportunities for leveraging cloud services (Microsoft, Amazon, and/or Google).
Deliver architectures for transformations and modernizations of enterprise data solutions using cloud data technologies.
Develop and maintain data warehouse schematics, layouts, architectures, and relational/non-relational databases for data access and Advanced Analytics.
Implement effective metrics and monitoring processes.
Demonstrated experience of turning business use cases and requirements to technical solutions.
Experience in business process mapping of data and analytics solutions.
Experience in leading and mentoring development teams.
Ability to model business processes using industry best practices.
Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows.
Amazon AWS Experience a big plus.

Job responsibilities

Job Responsibilities
Design and develop scalable data processing systems using Apache Spark and ElasticSearch,
Deploy and manage ElasticSearch on OpenShift for indexing and data storage.
Create customer libraries for high-bandwidth data processing and ETL
Develop solution for handling large data processing and transfer distributed system and storage environments
Implement and maintain ETL processes to integrate large datasets into data lakes and data warehouses.
Lead and mentor our development teams to deliver a quality data solution.
Work closely with other app developers and engineers to ensure project success.
Exercise a high degree of autonomy and ownership
Research approaches to solve unfamiliar problems

What we offer

Culture of caring. At GlobalLogic, we prioritize a culture of caring. Across every region and department, at every level, we consistently put people first. From day one, you’ll experience an inclusive culture of acceptance and belonging, where you’ll have the chance to build meaningful connections with collaborative teammates, supportive managers, and compassionate leaders. 

Learning and development. We are committed to your continuous learning and development. You’ll learn and grow daily in an environment with many opportunities to try new things, sharpen your skills, and advance your career at GlobalLogic. With our Career Navigator tool as just one example, GlobalLogic offers a rich array of programs, training curricula, and hands-on opportunities to grow personally and professionally.

Interesting & meaningful work. GlobalLogic is known for engineering impact for and with clients around the world. As part of our team, you’ll have the chance to work on projects that matter. Each is a unique opportunity to engage your curiosity and creative problem-solving skills as you help clients reimagine what’s possible and bring new solutions to market. In the process, you’ll have the privilege of working on some of the most cutting-edge and impactful solutions shaping the world today.

Balance and flexibility. We believe in the importance of balance and flexibility. With many functional career areas, roles, and work arrangements, you can explore ways of achieving the perfect balance between your work and life. Your life extends beyond the office, and we always do our best to help you integrate and balance the best of work and life, having fun along the way!

High-trust organization. We are a high-trust organization where integrity is key. By joining GlobalLogic, you’re placing your trust in a safe, reliable, and ethical global company. Integrity and trust are a cornerstone of our value proposition to our employees and clients. You will find truthfulness, candor, and integrity in everything we do.

About GlobalLogic

GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward-thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.