テクノロジー能力
テクノロジー能力Senior Software Engineer
Engineering
3-5 years
India - Gurgaon
Agentic GenAI, Deep Learning, Generative AI, Generative AI - LLMs, Neural networks, NLP, Python, Retrieval-Augmented Generation (RAG)
Remote
GlobalLogic is seeking a highly skilled Python Developer with strong expertise in large scale web crawling and data extraction. The ideal candidate will be responsible for building scalable scraping frameworks, handling dynamic web architectures, and extracting clean, structured data from complex websites.
• 2+ years of hands on experience in web scraping and web crawling projects.
• Strong proficiency in Python, including Asyncio, Multithreading, and Requests.
• Expertise in Scrapy (preferred for scalable crawling solutions).
• Experience with Playwright and Selenium for browser automation.
• Strong understanding of DOM structure, XPath, CSS Selectors, and browser developer or network tools.
• Experience working with rotating proxies, session handling, and anti-blocking techniques.
• Familiarity with headless browser optimization and automation tools such as undetected chromedriver or playwright-stealth.
• Knowledge of data parsing, transformation, and storage techniques.
• Must possess any graduation degree (Must have Provisional Certificate and Consolidated Marks Memo)
• Design, develop, and maintain high performance web crawlers and scraping solutions using Python.
• Build scalable scraping engines using Scrapy, Selenium, and Playwright.
• Handle JavaScript-heavy websites and dynamic content extraction.
• Implement techniques to improve crawler efficiency, reliability, and scalability.
• Configure and manage proxy rotation mechanisms to minimize blocking and rate limiting.
• Parse, clean, and transform raw HTML data into structured formats such as JSON, CSV, or database ready outputs.
• Monitor crawler performance and troubleshoot failures caused by website structure changes.
• Collaborate with internal teams to understand data requirements and deliver high-quality datasets.
• Maintain proper documentation and adhere to coding best practices.
Culture of caring. At GlobalLogic, we prioritize a culture of caring. Across every region and department, at every level, we consistently put people first. From day one, you’ll experience an inclusive culture of acceptance and belonging, where you’ll have the chance to build meaningful connections with collaborative teammates, supportive managers, and compassionate leaders.
Learning and development. We are committed to your continuous learning and development. You’ll learn and grow daily in an environment with many opportunities to try new things, sharpen your skills, and advance your career at GlobalLogic. With our Career Navigator tool as just one example, GlobalLogic offers a rich array of programs, training curricula, and hands-on opportunities to grow personally and professionally.
Interesting & meaningful work. GlobalLogic is known for engineering impact for and with clients around the world. As part of our team, you’ll have the chance to work on projects that matter. Each is a unique opportunity to engage your curiosity and creative problem-solving skills as you help clients reimagine what’s possible and bring new solutions to market. In the process, you’ll have the privilege of working on some of the most cutting-edge and impactful solutions shaping the world today.
Balance and flexibility. We believe in the importance of balance and flexibility. With many functional career areas, roles, and work arrangements, you can explore ways of achieving the perfect balance between your work and life. Your life extends beyond the office, and we always do our best to help you integrate and balance the best of work and life, having fun along the way!
High-trust organization. We are a high-trust organization where integrity is key. By joining GlobalLogic, you’re placing your trust in a safe, reliable, and ethical global company. Integrity and trust are a cornerstone of our value proposition to our employees and clients. You will find truthfulness, candor, and integrity in everything we do.
GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward-thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.
Hi there — how can I assist you today?
Explore our services, industries, career opportunities, and more.