CrawlJobs Logo

Tech Lead Manager Machine Learning Research Scientist LLM Evals

scale.com Logo

Scale

Location Icon

Location:
United States , San Francisco

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

280000.00 - 380000.00 USD / Year

Job Description:

As the Tech Lead Manager of the LLM Evals Research team, you will lead a talented team of research scientists and research engineers focused on developing and implementing novel evaluation methodologies, metrics, and benchmarks to assess the capabilities and limitations of our cutting-edge LLMs. This role is critical for designing and executing a roadmap that defines best practices in data driven AI development and will accelerate the next generation of generative AI models in partnership with top foundational model labs.

Job Responsibility:

  • Lead a team of highly effective research scientists and research engineers on LLM evals
  • Conduct research on the effectiveness and limitations of existing LLM evaluation techniques
  • Design and develop novel evaluation benchmarks for large language models, covering areas such as instruction following, factuality, robustness, and fairness
  • Communicate, collaborate, and build relationships with clients and peer teams to facilitate cross-functional projects
  • Collaborate with internal teams and external partners to refine metrics and create standardized evaluation protocols
  • Implement scalable and reproducible evaluation pipelines using modern ML frameworks
  • Publish research findings in top-tier AI conferences and contribute to open-source benchmarking initiatives
  • Remain up-to-date on ongoing research in the team, help work through technical challenges, and be involved in design decisions
  • Remain deeply involved in the research community, both understanding trends, and setting them
  • Thrive in a high-energy, fast-paced startup environment and are ready to dedicate the time and effort needed to drive impactful results

Requirements:

  • 5+ years of hands-on experience in large language model, NLP, and Transformer modeling, in the setting of both research and engineering development
  • Experience and track of recording in landing major research impacts in a fast-paced environment
  • Experience supporting and leading a team of research scientists and research engineers
  • Excellent written and verbal communication skills
  • Published research in areas of machine learning at major conferences (NeurIPS, ICML, ICLR, ACL, EMNLP, CVPR, etc.) and/or journals
  • Previous experience in a customer facing role
What we offer:
  • Comprehensive health, dental and vision coverage
  • retirement benefits
  • a learning and development stipend
  • generous PTO

Additional Information:

Job Posted:
February 20, 2026

Employment Type:
Fulltime
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Tech Lead Manager Machine Learning Research Scientist LLM Evals

New

Warehouse Operations Supervisor

Randstad Operational is looking for a dynamic and results-driven Warehouse Opera...
Location
Location
Canada , Brampton
Salary
Salary:
55000.00 - 70000.00 CAD / Year
https://www.randstad.com Logo
Randstad
Expiration Date
April 05, 2026
Flip Icon
Requirements
Requirements
  • Minimum of 3 years’ experience working in a cooler environment
  • Proven track record in team management, driving accountability, and improving performance
  • Demonstrated ability to promote a culture of safety and compliance (OHSA)
  • History of continuous improvement experience (Lean, Six Sigma, or similar)
  • Flexibility to address operational peaks and extra hours when required
  • Experience in fast-paced warehouse or logistics environments is a strong asset
  • Familiarity with mechanical handling equipment (MHE) and safety standards
Job Responsibility
Job Responsibility
  • Conduct operational analysis of receiving, order-filling, and shipping to ensure effective coordination
  • Identify improvement opportunities and submit recommendations to maximize operations
  • Collect and analyze KPIs, TPR, budget reports, and operational expenditures daily
  • Work with the Ops Manager to develop solutions for department-specific requirements
  • Research new processes regarding capital and human resources in coordination with management
  • Develop equipment layout and technology utilization specs to maximize material logistics
  • Identify and manage priorities to ensure customer expectations are consistently exceeded
  • Provide ongoing support, coaching, and development for Coordinators and floor associates
  • Lead the shift’s Occupational Health and Safety program through direct involvement and targets
  • Ensure all employees conform to legislative requirements, including MHE competence
What we offer
What we offer
  • Stable weekend shift: Saturdays to Mondays, 6 AM – 6 PM
  • Opportunity to lead in a high-growth manufacturing & logistics environment
  • Collaborative culture that values Active Leadership and visibility
  • Direct impact on continuous improvement and operational strategy
  • Fulltime
Read More
Arrow Right
New

Commercial Loan Servicing Specialist

Wells Fargo is seeking a Commercial Loan Servicing Specialist.
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
February 25, 2026
Flip Icon
Requirements
Requirements
  • 2+ years of Commercial Loan Servicing experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
Job Responsibility
Job Responsibility
  • Provide servicing activities for low to moderately complex commercial products
  • Coordinate all aspects of resolving open customer service issues and interact with internal and external customers
  • Provide customer service, loan and regulatory diligence and ensure compliance with all bank policies, procedures, and regulatory requirements
  • Evaluate and upload data into the systems of record
  • Serve as primary liaison and work collaboratively with Sales, Legal, Control and Risk, Technology, and various Operations and company teams as necessary to progress customer-focused needs
  • Review and negotiate basic loan servicing transactions, evaluate risks, and devise strategies to mitigate risks and identify procedural modifications
  • Serve as an escalation point in the resolution of client issues
  • Provide guidance and training to peers
  • Collaborate and consult with peers, colleagues, and managers to resolve issues and achieve goals
  • Present recommendations for resolving low to moderately complex situations and exercise independent judgment while developing expertise in the function, policies, procedures, and compliance requirements
  • Fulltime
Read More
Arrow Right
New

Software Engineer

Join a fast-paced, high-impact team at the forefront of developer productivity a...
Location
Location
Czech Republic , Multiple Locations
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or master’s degree in computer science or a related field, or equivalent work experience
  • Solid programming skills in one or more of the following languages: C#, Java, C++, or Python
  • Passion for developer experience and an eagerness to understand what makes great tools
  • Excellent written and verbal communication skills with the ability to collaborate across diverse, distributed teams
Job Responsibility
Job Responsibility
  • Design and develop robust, scalable, and maintainable software components that power modern developer tools
  • Leverage AI-powered technologies (e.g., GitHub Copilot, LLM-based code tools) to accelerate engineering workflows and contribute to the development of AI-assisted features
  • Dogfood internal AI tools and platforms, providing feedback and insights to improve usability, reliability, and effectiveness
  • Collaborate with engineers across product teams and the open-source community to co-design and iterate on developer experiences
  • Participate in code reviews, architectural discussions, and agile ceremonies, fostering a culture of technical excellence and continuous learning
  • Research and experiment with emerging AI techniques and integrate them into everyday engineering practices to boost productivity
  • Fulltime
Read More
Arrow Right
New

Pharmacy Intern

You’ve invested a lot of time and energy in your education. Now you want the cha...
Location
Location
United States , New Lexington
Salary
Salary:
18.00 - 19.75 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
March 01, 2026
Flip Icon
Requirements
Requirements
  • Accepted into or actively enrolled in an ACPE accredited college or school of pharmacy
  • 0-3 years relevant work experience
  • Must possess or be in process of obtaining valid intern and/or technician licensure as required
  • Strong communication and presentation skills
  • Complete all required training within state guidelines and required timeframe
  • Ability to: Have regular and predictable attendance, including nights and weekends
  • Be mobile and remain upright for extended periods of time
  • Lift, scan, and bag items
  • Finger Dexterity: Picking, pinching, typing or otherwise working primarily with fingers rather than whole hand or arm
  • Reach overhead
Job Responsibility
Job Responsibility
  • Patient Safety
  • Pharmacy Professional Practice
  • Regulatory Requirements
  • Quality Assurance
  • Customer Service
  • Inventory Management
  • Workflow Management excluding final prescription verification
  • Lead with Heart – display empathy and compassion for your patients, customers, caregivers, and colleagues on your team
  • Seek new ways to grow, collaborate with others, and deliver better outcomes
  • Align others around our purpose to bring your heart to every moment of your health and gain support and commitment
!
Read More
Arrow Right
New

Millwright

We are currently hiring a 433a Millwright for our Brampton manufacturing facilit...
Location
Location
Canada , Brampton
Salary
Salary:
40.00 - 45.00 CAD / Hour
https://www.randstad.com Logo
Randstad
Expiration Date
April 20, 2026
Flip Icon
Requirements
Requirements
  • Valid 433A Industrial Mechanic (Millwright) license
  • Minimum 5 years of experience in a manufacturing or packaging environment
  • Strong mechanical troubleshooting skills
  • Experience working with high-speed packaging or food manufacturing equipment
  • Solid knowledge of pneumatics and hydraulics
  • Ability to read and interpret mechanical and electrical drawings
  • Strong communication skills and ability to work independently or as part of a team
  • Flexibility to respond to emergency calls outside scheduled shifts when required
Job Responsibility
Job Responsibility
  • Perform preventive and corrective maintenance on high-speed packaging and production equipment
  • Troubleshoot and repair mechanical and electrical breakdowns to minimize downtime
  • Diagnose equipment failures, irregularities, and performance issues
  • Install, align, and commission mechanical and electromechanical equipment
  • Complete electrical troubleshooting on motors, controls, sensors, and automation-related components
  • Respond promptly to emergency service calls and breakdowns
  • Support continuous improvement initiatives focused on safety, efficiency, and uptime
  • Perform safety upgrades and mechanical/electrical modifications to equipment
  • Collaborate with production, engineering, and maintenance teams
  • Follow all quality, food safety, and health & safety standards
What we offer
What we offer
  • Stable, long-term opportunity with a global packaging leader
  • Modern manufacturing facility with advanced, high-speed equipment
  • Collaborative, safety-first culture
  • Career growth opportunities + opportunity to support the growth of a plant
  • Fulltime
Read More
Arrow Right
New

Patient Financial Representative Senior

The associate is responsible for the duties and services that are of a support n...
Location
Location
United States , Irving
Salary
Salary:
Not provided
christushealth.org Logo
CHRISTUS Health
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • HS Diploma or equivalent years of experience required
  • Post HS education preferred
  • 3-5 years of experience preferred
  • Experience working within a multi-facility hospital business office environment preferred
  • College education, previous Insurance Company claims experience and/or health care billing trade school education may be considered in lieu of formal hospital experience
  • Experience working with inpatient and outpatient billing requirements of UB-04 and HCFA 1500 billing forms preferred
Job Responsibility
Job Responsibility
  • Meets expectations of the applicable OneCHRISTUS Competencies: Leader of Self, Leader of Others, or Leader of Leaders
  • Performs Revenue Cycle functions in a manner that meets or exceeds CHRISTUS Health's key performance metrics
  • Ensures PFS departmental quality and productivity standards are met
  • Collects and provides patient and payor information to facilitate account resolution
  • Responds to all types of account inquiries through written, verbal, or electronic correspondence
  • Maintains payor-specific knowledge of insurance and self-pay billing and follow-up guidelines and regulations for third-party payers
  • Maintains working knowledge of all functions within the Revenue Cycle
  • Responsible for professional and effective written and verbal communication with both internal and external customers in order to resolve outstanding questions for account resolution
  • Meets or exceeds customer expectations and requirements, and gains customer trust and respect
  • Compliant with all CHRISTUS Health, payer, and government regulations
  • Fulltime
Read More
Arrow Right
New

Full Charge Bookkeeper

We are looking for an experienced Full Charge Bookkeeper to join our team in Cyp...
Location
Location
United States , Cypress
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience as a Full Charge Bookkeeper
  • Proficiency in QuickBooks Online with no need for additional training
  • Strong skills in managing accounts receivable and accounts payable
  • Expertise in performing bank reconciliations accurately and efficiently
  • Ability to handle high-volume invoicing and collections processes
  • Excellent communication skills for interacting with customers regarding overdue invoices
  • Attention to detail and organizational skills to maintain accurate financial records
  • Knowledge of accounting practices and standards relevant to bookkeeping
Job Responsibility
Job Responsibility
  • Oversee all bookkeeping tasks, including accounts receivable, accounts payable, and bank reconciliations
  • Manage high-volume invoicing and collections processes for business-to-business transactions
  • Conduct collection calls for overdue invoices, handling a monthly volume of 50-75 accounts
  • Utilize QuickBooks Online for accurate financial record-keeping without requiring additional training
  • Ensure timely and efficient reconciliation of bank accounts and financial statements
  • Communicate effectively with clients and customers to address and resolve invoice and payment issues
  • Maintain organized financial records and ensure compliance with accounting standards
  • Provide consistent updates and reporting on accounts receivable and payable activities
  • Collaborate with team members to streamline financial operations and improve processes
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • eligible to enroll in our company 401(k) plan
  • Parttime
Read More
Arrow Right
New

Automotive Parts Specialist

We are so much more than a Parts Store and we are looking for even more great ta...
Location
Location
United States , Green Valley
Salary
Salary:
Not provided
allianceautomotive.co.uk Logo
Alliance Automotive UK LV Ltd
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Valid Driver’s License
  • Previous experience in a parts store or automotive industry or at least a willingness to learn all things auto parts
  • High School Diploma or GED. Technical or Trade school courses or degree
  • Excellent verbal and written communication skills
  • Great listening skills and empathy for customer
  • Ability to work on or around an airport environment in a shop environment
Job Responsibility
Job Responsibility
  • Provide and source parts for specialized equipment for our fleet customers
  • Use your parts knowledge to assist other NAPA team members and answer questions for customers
  • Provide outstanding customer service and interact with management and technicians
  • Bring customer focus and high energy to our fast-paced environment
  • Ask appropriate questions to ensure correct parts are researched and sourced
  • Inform customers on parts availability
What we offer
What we offer
  • Medical
  • Dental
  • Vision
  • 401K w/match
  • paid holidays and vacation
  • NAPA discount
  • tuition reimbursement
  • Fulltime
Read More
Arrow Right