Description
GlobalLogic is seeking a highly skilled Python Developer with strong expertise in large scale web crawling and data extraction. The ideal candidate will be responsible for building scalable scraping frameworks, handling dynamic web architectures, and extracting clean, structured data from complex websites.
Requirements
• 2+ years of hands on experience in web scraping and web crawling projects.
• Strong proficiency in Python, including Asyncio, Multithreading, and Requests.
• Expertise in Scrapy (preferred for scalable crawling solutions).
• Experience with Playwright and Selenium for browser automation.
• Strong understanding of DOM structure, XPath, CSS Selectors, and browser developer or network tools.
• Experience working with rotating proxies, session handling, and anti-blocking techniques.
• Familiarity with headless browser optimization and automation tools such as undetected chromedriver or playwright-stealth.
• Knowledge of data parsing, transformation, and storage techniques.
• Must possess any graduation degree (Must have Provisional Certificate and Consolidated Marks Memo)
Job responsibilities
• Design, develop, and maintain high performance web crawlers and scraping solutions using Python.
• Build scalable scraping engines using Scrapy, Selenium, and Playwright.
• Handle JavaScript-heavy websites and dynamic content extraction.
• Implement techniques to improve crawler efficiency, reliability, and scalability.
• Configure and manage proxy rotation mechanisms to minimize blocking and rate limiting.
• Parse, clean, and transform raw HTML data into structured formats such as JSON, CSV, or database ready outputs.
• Monitor crawler performance and troubleshoot failures caused by website structure changes.
• Collaborate with internal teams to understand data requirements and deliver high-quality datasets.
• Maintain proper documentation and adhere to coding best practices.
What we offer
Exciting Projects: We focus on industries like High-Tech, communication, media, healthcare, retail and telecom. Our customer list is full of fantastic global brands and leaders who love what we build for them.
Collaborative Environment: You Can expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!
Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible work schedules, opportunities to work from home, and paid time off and holidays.
Professional Development: Our dedicated Learning & Development team regularly organizes Communication skills training(GL Vantage, Toast Master),Stress Management program, professional certifications, and technical and soft skill trainings.
Excellent Benefits: We provide our employees with competitive salaries, family medical insurance, Group Term Life Insurance, Group Personal Accident Insurance , NPS(National Pension Scheme ), Periodic health awareness program, extended maternity leave, annual performance bonuses, and referral bonuses.
Fun Perks: We want you to love where you work, which is why we host sports events, cultural activities, offer food on subsidies rates, Corporate parties. Our vibrant offices also include dedicated GL Zones, rooftop decks and GL Club where you can drink coffee or tea with your colleagues over a game of table and offer discounts for popular stores and restaurants!
About GlobalLogic
GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward-thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.
