CrawlJobs Logo

Web Scraping Engineer II

yipitdata.com Logo

YipitData

Location Icon

Location:
India

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

We are seeking a Web Scraping Engineer to join our growing engineering team. In this hands-on role, you’ll take ownership of designing, building, and maintaining robust web scrapers that power critical reports and customer experiences across our organization. You will work on complex, high-impact scraping challenges and collaborate closely with cross-functional teams to ensure our data ingestion processes are resilient, efficient, and scalable, while delivering high-quality data to our products and stakeholders.

Job Responsibility:

  • Refactor and Maintain Web Scrapers: Overhaul existing scraping scripts to improve reliability, maintainability, and efficiency
  • Implement best coding practices (clean code, modular architecture, code reviews, etc.) to ensure quality and sustainability
  • Implement Advanced Scraping Techniques: Utilize sophisticated fingerprinting methods (cookies, headers, user-agent rotation, proxies) to avoid detection and blocking
  • Handle dynamic content, navigate complex DOM structures, and manage session/cookie lifecycles effectively
  • Collaborate with Cross-Functional Teams: Work closely with analysts and other stakeholders to gather requirements, align on targets, and ensure data quality
  • Provide support, documentation, and best practices to internal stakeholders to ensure effective use of our web scraped data in critical reporting workflows
  • Monitor and Troubleshoot: Develop robust monitoring solutions, alerting frameworks to quickly identify and address failures
  • Continuously evaluate scraper performance, proactively diagnosing bottlenecks and scaling issues
  • Drive Continuous Improvement: Propose new tooling, methodologies, and technologies to enhance our scraping capabilities and processes
  • Stay up to date with industry trends, evolving bot-detection tactics, and novel approaches to web data extraction

Requirements:

  • Effective communication in English with both technical and non-technical stakeholders
  • 3+ years of experience with web scraping frameworks (e.g., Selenium, Playwright, or Puppeteer)
  • Strong understanding of HTTP, RESTful APIs, HTML parsing, browser rendering, and TLS/SSL mechanics
  • Expertise in advanced fingerprinting and evasion strategies (e.g., browser fingerprint spoofing, request signature manipulation)
  • Deep experience managing cookies, headers, session states, and proxy rotations, including the deployment of both residential and data center proxies
  • Experience with logging, metrics, and alerting to ensure high availability
  • Troubleshooting skills to optimize scraper performance for efficiency, reliability, and scalability
What we offer:
  • Our compensation package includes comprehensive benefits, perks, and a competitive salary
  • We care about your personal life and we mean it. We offer vacation time, parental leave, team events, learning reimbursement, and more!
  • Your growth at YipitData is determined by the impact that you are making, not by tenure, unnecessary facetime, or office politics. Everyone at YipitData is empowered to learn, self-improve, and master their skills in an environment focused on ownership, respect, and trust

Additional Information:

Job Posted:
February 18, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Icon
YipitData - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Web Scraping Engineer II

New

Lead Technology Business Systems Consultant

Wells Fargo is seeking a Lead Technology Business Systems Consultant. Technology...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
March 19, 2026
Flip Icon
Requirements
Requirements
  • 8+ years of Business Systems Data and Business Systems Designing experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • 8+ years of experience leading organizational transformation, program and portfolio management and business process optimization, with a proven record of delivering against outcomes
  • 8+ years of hands-on JIRA, SharePoint, and Confluence administration experience, including governance, automation, and compliance outsight in transformation environments
  • Working on large and complex applications with multiple stakeholders
  • Experience working in a dynamic agile environment, supporting applications with multiple dependencies
  • Leading and conceptualizing a solution for a problem statement
  • Proven experience in process transformation, intelligent automation, and solution architecture
  • Proven experience in designing and implementing solutions using Microsoft Power Platform, RPA, AI, or Gen AI technologies
  • Strong background in business process analysis, design thinking, and agile methodologies
  • Technical Skills – Selenium and other automated testing tools
Job Responsibility
Job Responsibility
  • Lead complex initiatives to provide technological solutions with broad impact for cross functional businesses and technology teams
  • Function as a key participant in providing strategic business solutions to companywide technology initiatives
  • Evaluate complex business problems and provide subject matter knowledge proficiency for technology initiatives
  • Define and lead detailed research on business and technology requests to develop efficient and accurate functional requirements
  • Make decisions in complex and multifaceted situations requiring solid understanding of domain and technology applications, and which influence companywide technology solutions
  • Lead project or systems documentation and monitor and manage project schedules and deliverables
  • Collaborate and consult with business and technology teams to provide comprehensive technological solutions for complex business problems
  • Ensure communication and information flow between business and technology teams
  • Provide JIRA governance and execution oversight, ensuring best practices, automation, compliance, and tool optimization and embedded across the complete program
  • Generate and implement ideas for process transformation, intelligent automation, and solution architecture
  • Fulltime
Read More
Arrow Right
New

Account Executive

As an Account Executive, you will drive Stripe’s future growth engine by buildin...
Location
Location
Ireland , Dublin
Salary
Salary:
153800.00 - 230600.00 EUR / Year
parking.net Logo
Parking Network B.V.
Expiration Date
March 15, 2026
Flip Icon
Requirements
Requirements
  • 7 years of full-time experience in the solution sales field, with successfully closed and onboarded deals
  • Experience in sales with fast-growing and mid-sized businesses
  • Ability to understand the Stripe API and build strong relationships with highly technical customers
  • Ability to operate in a highly ambiguous and fast-paced environment
  • High professional fluency in French and English
  • Open to traveling and attending events
Job Responsibility
Job Responsibility
  • Acquire new business for Stripe
  • Build and manage a sales pipeline
  • Own the full sales cycle from lead generation to closing, onboarding, and activation for businesses
  • Generate your own leads through cold calling, blitzing, research, networking, and driving your territory
  • Manage leads qualified by our inbound and outbound sales development representatives
  • Ensure that every potential Stripe user has a positive experience with every interaction, regardless of deal size
  • Identify and understand users’ pain points in order to propose effective Stripe solutions
  • Coordinate with other Stripe teams to ensure that internal resources are set up for users’ success
What we offer
What we offer
  • equity
  • company bonus or sales commissions/bonuses
  • retirement plans
  • health benefits
  • wellness stipends
  • Fulltime
Read More
Arrow Right
New

Creative and Design Specialist

As a community, the University of Rochester is defined by a deep commitment to M...
Location
Location
United States of America , Rochester
Salary
Salary:
63815.00 - 95723.00 USD / Year
urmc.rochester.edu Logo
University of Rochester
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree
  • 3 years of professional experience
  • or equivalent combination of education and experience
  • Solid understanding and command of design, color theory, typography, and composition techniques
  • Competency in creative and graphic design principles
  • Ability to take abstract concepts, information, and data and turn it into appealing, easy-to-understand visual communication
  • Strong combination of technical, creative, and problem-solving skills
  • Ability to think strategically and understand client needs
  • Proficiency in creating visual concepts, presenting to partners, developing assets, and crafting engaging visual languages
  • Proficiency in the Adobe Creative Suite, including InDesign, Photoshop, Illustrator, FileMaker Pro
Job Responsibility
Job Responsibility
  • Activates the University’s brand and helps develop a visual language
  • Maintains creative, design, content, photographic imagery, illustrations, and multimedia
  • Applies storytelling and design fundamentals
  • Designs the layout of graphics, publications, special event materials, signage, packaging, presentations, illustrations, posters, data visualization, infographics, animated GIFs
  • Establishes project schedules and maintains accountability for timeline
  • Plays a key role in building the University's strategic creative and marketing infrastructure
  • Produces custom creative solutions for strategic communications initiatives
  • Devises scalable graphic design and multimedia tactical solutions
  • Transforms ideas, concepts, information, and data into concrete visual communications
  • Coordinates and art directs select photoshoots
  • Fulltime
Read More
Arrow Right
New

Furniture Installation Technician

We are seeking a skilled BS2 Level Move Technician to serve as a dedicated on-si...
Location
Location
United States , St. Louis, MO; Hazelwood Mo.
Salary
Salary:
Not provided
jll.com Logo
JLL
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years in facilities management, move coordination, furniture installation, or related field
  • Proven experience with furniture assembly and installation, basic handyman skills including use of common tools and equipment
  • Ability to lift 80+ lbs., stand for extended periods, and perform manual labor in various environments
  • Strong organizational and time management skills, excellent communication and customer service abilities
  • Ability to work independently with minimal supervision while maintaining high quality standards
  • Proficiency with smartphones, tablets, and basic computer applications
Job Responsibility
Job Responsibility
  • Execute office moves, relocations, and space reconfigurations
  • Coordinate, assemble and install furniture and workspace setup/teardown
  • Assist with department relocations and floor plan changes
  • Load and off-load truck to and from dock
  • Plan for the next days work and prepare material in advance
  • Manage move logistics including scheduling, equipment, and coordination with other trades
  • Set up meeting rooms, conference spaces, and event venues
  • Arrange seating, tables, and staging for corporate events
  • Provide after-hours support for special events as needed
  • Receive, inspect, and deliver furniture throughout the facility
What we offer
What we offer
  • 401(k) plan with matching company contributions
  • Comprehensive Medical, Dental & Vision Care
  • Paid parental leave at 100% of salary
  • Paid Time Off and Company Holidays
  • Early access to earned wages through Daily Pay
  • Fulltime
Read More
Arrow Right
New

Store Associate

Retail Store Associates play a meaningful role within the CVS Health family. At ...
Location
Location
United States , Mechanicsville
Salary
Salary:
15.00 - 22.00 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
April 25, 2026
Flip Icon
Requirements
Requirements
  • At least 16 years of age
  • Physical requirements: remaining upright on the feet for sustained periods
  • lifting and exerting up to 35 lbs occasionally, up to 10 lbs frequently
  • close visual acuity
Job Responsibility
Job Responsibility
  • Providing differentiated customer service by anticipating customer needs
  • Focusing on the customer with warm greetings and help
  • Accurately perform cashier duties
  • Maintaining the sales floor by restocking shelves and updating pricing
  • Supporting opening and closing store activities
  • Providing customer support to all departments, including photo and beauty
  • Assisting pharmacy personnel when needed
  • Embracing and advocating for new CVS services and loyalty programs
What we offer
What we offer
  • Affordable medical plan options
  • 401(k) plan with matching company contributions
  • employee stock purchase plan
  • no-cost wellness screenings, tobacco cessation and weight management programs
  • confidential counseling and financial coaching
  • paid time off
  • flexible work schedules
  • family leave
  • dependent care resources
  • colleague assistance programs
  • Parttime
Read More
Arrow Right
New

Staff Software Engineer

As a Senior Staff Software Engineer at NMI, you operate beyond the scope of a si...
Location
Location
United States
Salary
Salary:
130000.00 - 160000.00 USD / Year
parking.net Logo
Parking Network B.V.
Expiration Date
March 13, 2026
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Information Technology, or equivalent practical experience
  • 8+ years of experience developing complex software applications in a commercial environment, with demonstrated impact at the Staff or Senior Staff engineer level
  • Advanced, hands-on experience building and maintaining large-scale systems using .NET Framework / C# (preferred) and/or PHP, with a strong understanding of object-oriented design principles and software architecture
  • Strong experience working with relational databases, particularly Microsoft SQL Server, including schema design, query optimization, performance tuning, and maintaining data integrity in production systems
  • Proven experience designing, coding, deploying, and operating cloud-based solutions hosted on AWS, with an understanding of scalability, fault tolerance, security, and cost-aware design
  • Experience designing and architecting scalable, distributed systems, with consideration for performance, reliability, and long-term maintainability
  • Deep understanding of the Software Development Life Cycle (SDLC) and agile development methodologies
  • Strong knowledge of security best practices, including secure coding principles and compliance requirements (e.g., OWASP Top Ten, PCI DSS, SOC 2, HIPAA, or similar)
  • Solid understanding of networking fundamentals, including HTTPS, DNS, SSL/TLS, and service-to-service communication patterns
  • Deep knowledge of design patterns and their practical application in real-world systems
Job Responsibility
Job Responsibility
  • Provide technical leadership for the team, influencing architecture and design decisions that span multiple teams
  • Own and evolve critical platform areas including partner onboarding, developer tooling, authentication, user management, and the unified partner portal
  • Identify long-term technical risks and opportunities, and lead initiatives to address scalability, reliability, security, and maintainability
  • Set and reinforce engineering standards, patterns, and best practices across teams
  • Collaborate closely with Engineering Managers and Directors to align technical strategy with delivery plans and team goals
  • Partner with Product Managers, Directors, and Designers to translate product vision into technically sound, scalable solutions
  • Act as a trusted technical advisor across teams, helping resolve complex cross-team dependencies and tradeoffs
  • Drive alignment and consistency across partner-facing systems and experiences
  • Design, implement, and review high-impact code, particularly in complex or high-risk areas
  • Lead technical discovery and execution for ambiguous or strategically important initiatives
What we offer
What we offer
  • A remote first culture
  • Flex PTO
  • Health, Dental and Vision Insurance
  • 13 Paid Holidays
  • Company volunteer days
  • bonus
  • Fulltime
Read More
Arrow Right
New

Project Coordinator (Data Centre)

JLL empowers you to shape a brighter way. Our people at JLL are shaping the futu...
Location
Location
China , Hong Kong
Salary
Salary:
Not provided
jll.com Logo
JLL
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 5 years of project coordination experience in data centres, critical facilities, telecom, or industrial environments
  • Valid REW A0 / B0 is a must
  • Familiarity with data centre infrastructure (e.g., power distribution, cooling systems, rack deployment, cabling)
  • Experience working in environments governed by safety, access, and procedural controls (e.g., permit-to-work systems)
  • Proficiency with Microsoft Office, SharePoint, and project tracking tools
  • Strong attention to detail, reliability, and ability to follow strict operational procedures
Job Responsibility
Job Responsibility
  • Coordinate project timelines, resources, and documentation for data centre upgrades, deployments, and maintenance activities
  • Liaise between internal teams (facilities, engineering, IT) and external vendors/contractors during site works
  • Track work permits, safety clearances, and compliance documentation
  • Support change management processes in line with data centre operational protocols
  • Maintain accurate logs of project progress, risks, and stakeholder communications
  • Assist in preparing reports for operational reviews and client audits
  • Fulltime
Read More
Arrow Right
New

Personal Banker

Wells Fargo is seeking an Associate Personal Banker (SAFE) for our National Bran...
Location
Location
United States , Huntington; Hempstead; Greenvale
Salary
Salary:
23.00 - 31.00 USD / Hour
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
February 28, 2026
Flip Icon
Requirements
Requirements
  • 6+ months of interacting with customers experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • This position requires SAFE registration at the time of employment
  • Must meet the Consumer Financial Protection Bureau qualification requirements and comply with related Wells Fargo policies
  • Must meet ongoing regulatory requirements including additional screening
  • This position is not eligible for Visa sponsorship
Job Responsibility
Job Responsibility
  • Participate in delivery of exceptional customer experience by building relationships through proactive outreach as well as proposing appropriate products, services, and digital solutions to help customers succeed financially
  • Assist customers with basic requests related to opening new accounts, completing service requests, and submitting credit applications
  • Receive direction from managers and exercise judgement within defined policies and procedures
  • Develop understanding of bank products and services to connect to customers' needs
  • Interact with customers to demonstrate care and build relationships
  • Provide appropriate options for bank products and services to customer
  • Refer customers' financial needs to other bankers and partners as needed
  • This SAFE position has customer contact and job duties which may include the offering/negotiating of terms and/or taking an application for a dwelling secured transaction
What we offer
What we offer
  • Health benefits
  • 401(k) Plan
  • Paid time off
  • Disability benefits
  • Life insurance, critical illness insurance, and accident insurance
  • Parental leave
  • Critical caregiving leave
  • Discounts and savings
  • Commuter benefits
  • Tuition reimbursement
  • Fulltime
!
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy