職種概要
We are seeking an expert Iceberg Engineer to design, optimize, and scale our next-generation multi-cloud data lakehouse architecture across AWS and Azure. In this role, you will leverage Client’s Open Lakehouse (integrated with Client’s Talend Cloud) to establish a low-overhead, high-throughput data foundation. You will manage automated data ingestion, implement continuous table optimization, handle cross-cloud data mirroring, and ensure seamless multi-engine access without vendor lock-in.
#LI-AD7
必要条件
- Extensive software development experience, including experience working on complex backend or data infrastructure projects.
-
Strong hands-on experience with Apache Iceberg .
-
Experience with Scala.
-
Deep understanding of distributed systems, data processing, storage engines, or data infrastructure.
-
Strong knowledge of data consistency, transactions, schema evolution, partitioning, compaction, and performance optimization.
-
Proven ability to troubleshoot complex production and customer issues.
-
Strong ownership mindset and the ability to operate effectively in areas with limited documentation or historical knowledge.
-
Excellent communication and collaboration skills.
Preferred Qualifications:
- Big Data Frameworks: Hands-on experience with distributed data-processing technologies such as Apache Spark, Flink, Trino, or Presto.
- Cloud Object Storage: Experience working with cloud storage platforms, including Amazon S3, Google Cloud Storage (GCS), or Azure Data Lake Storage (ADLS).
- Legacy Modernization: Proven track record of modernizing or gradually improving a mature codebase without disrupting existing customers.
職務内容
- Architect & Build: Lead the architecture, design, and implementation of highly scalable, complex backend systems and robust data infrastructure using Iceberg.
- Data Lake Engineering: Design and manage enterprise-grade data lake solutions leveraging Apache Iceberg or equivalent table formats, ensuring optimal data consistency, transactions, schema evolution, partitioning, and compaction.
- Performance Optimization: Maximize system throughput, minimize latency, and optimize resource utilization across large-scale distributed data processing systems.
- Production Excellence: Systematically diagnose, troubleshoot, and resolve complex, high-impact production and customer-facing infrastructure issues.
- Codebase Modernization: Champion the gradual improvement and modernization of a mature, production-critical codebase without causing disruption to active customers or services.
- Technical Leadership & Collaboration: Act as a technical authority, fostering strong communication and collaboration across engineering teams to align on technical objectives.
- Navigate Ambiguity: Exercise a strong ownership mindset to operate effectively and deliver high-quality outcomes in areas with limited documentation or historical knowledge.
私たちが提供するもの
Empowering Projects: With 500+ clients spanning diverse industries and domains, we provide an exciting opportunity to contribute to groundbreaking projects that leverage cutting-edge technologies. As a team, we engineer digital products that positively impact people’s lives.
Empowering Growth: We foster a culture of continuous learning and professional development. Our dedication is to provide timely and comprehensive assistance for every consultant through our dedicated Learning & Development team, ensuring their continuous growth and success.
DE&I Matters: At GlobalLogic, we deeply value and embrace diversity. We are dedicated to providing equal opportunities for all individuals, fostering an inclusive and empowering work environment.
Career Development: Our corporate culture places a strong emphasis on career development, offering abundant opportunities for growth. Regular interactions with our teams ensure their engagement, motivation, and recognition. We empower our team members to pursue their career goals with confidence and enthusiasm.
Comprehensive Benefits: In addition to equitable compensation, we provide a comprehensive benefits package that prioritizes the overall well-being of our consultants. We genuinely care about their health and strive to create a positive work environment.
Flexible Opportunities: At GlobalLogic, we prioritize work-life balance by offering flexible opportunities tailored to your lifestyle. Explore relocation and rotation options for diverse cultural and professional experiences in different countries with our company.
GlobalLogicについて
GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward-thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.
