Senior/Lead Software Engineer - AI Evaluation & Optimization

Company: Salesforce
Location: San Francisco
Posted on: January 16, 2025

Job Description:

Senior/Lead Software Engineer - AI Evaluation & Optimization
Apply remote type Office Tech-Flexible locations California - San Francisco California - Palo Alto time type Full time posted on Posted 3 Days Ago job requisition id JR270612
To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.
About Salesforce
We're Salesforce, the Customer Company, inspiring the future of business with AI + Data + CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too - driving your performance and career growth, charting new paths, and improving the state of the world. If you believe in business as the greatest platform for change and in companies doing well and doing good - you've come to the right place!
The goal of the Evaluation & Optimization team is to empower LLM agent builders to evaluate their agent's performance and optimize them to better serve their own business needs. We do this by building tools which allow for deep introspection into the performance of an Agent which empower users to pinpoint where improvements can be made. These tools are made available to users in a variety of ways, including an easy-to-use user interface embedded within Salesforce's Agentforce platform as well as API tools for internal or highly technical teams to leverage.
Agents and LLMs are a fast evolving technology. As a team deeply embedded in LLM infrastructure we are looking for engineers who enjoy a fast-paced environment, can deliver incrementally, and think creatively.
Your impact:

• 
  
• Build, scale and maintain critical features of the Einstein platform that is at the forefront of Salesforce AI and LLM innovation.
  
• Understand the customer/business requirements and translate them to elegant/flexible/easy-to-use platform capabilities.
  
• Lead/Participate in Software Design and Architecture discussions.
  
• Drive the execution and delivery of features by collaborating with architects, product owners, engineers, user experience designers and data scientists.
  
• Develop test strategies, design automation frameworks, write unit/functional tests to drive up code coverage and automation goals.
  
• Lead and mentor junior members of the team.
  
• Adopt, embrace, and promote agile and test-driven software development practices.
  
• Make/Participate in critical decisions that attribute to the success of the platform.
  
• Be a multiplier and have a passion for team and team members' success.
  
• Be a vocal advocate for technical excellence and help the team members make sound decisions.
  
  Basic qualifications and skills:
  
  • 
    
  • Bachelors (or) Masters degree in Computer Science, Software Engineering, or related STEM field with strong competencies in algorithms, data structures and software design.
    
  • 6+ years of hands-on experience building, scaling and maintaining large scale, complex distributed systems and/or full stack software applications in the B2B (or B2C) SaaS space that scale for millions of users and operate 24x7.
    
  • In-depth working knowledge of at least one object-oriented compiled, statically-typed language (Java, C++, etc), and a scripting language (Python, Ruby, etc).
    
  • Solid experience in REST based API development, API lifecycle management and/or client SDKs development.
    
  • Experience in test-driven development with focus on unit testing, integration testing and end-to-end automation.
    
  • Solid understanding of SDLC, and best practices in design, development, testing, and deployment.
    
  • Experience with Agile development methodologies, pair programming, continuous integration (CI) and continuous deployment (CD).
    
  • Ability to support/resolve production customer escalations with excellent debugging and problem solving skills.
    
  • Strong verbal and written communication skills. Self driven with superior organizational and project management skills. Ability to work effectively in a distributed team setting.
    
    Nice to have skills:
    
    • 
      
    • Experience with Python.
      
    • Solid understanding of web technologies, such as HTTP, XML, JavaScript, AJAX, HTML, JSON, etc. Familiarity with frameworks such as React or Vue.js is nice to have.
      
    • Experience with developer tools such as Git and Jenkins.
      
    • Demonstrated experience of working with ReST and thorough understanding of its fundamentals.
      
    • Working knowledge of building B2B or B2C SaaS applications using cloud providers such as AWS, GCP, or Azure is desired.
      
    • Exposure to Artificial Intelligence (AI) technologies such as Machine Learning, Deep Learning, etc. from data engineering perspective is a plus.
      
    • Some Salesforce platform/ecosystem knowledge is nice to have.
      
      Accommodations
      If you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request Form.
      Posting Statement
      At Salesforce we believe that the business of business is to improve the state of our world. Each of us has a responsibility to drive Equality in our communities and workplaces. We are committed to creating a workforce that reflects society through inclusive programs and initiatives such as equal pay, employee resource groups, inclusive benefits, and more.
      Salesforce is an Equal Employment Opportunity and Affirmative Action Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status. Salesforce does not accept unsolicited headhunter and agency resumes. Salesforce will not pay any third-party agency or company that does not have a signed agreement with Salesforce.
      Salesforce welcomes all.
      Pursuant to the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring, Salesforce will consider for employment qualified applicants with arrest and conviction records. For California-based roles, the base salary hiring range for this position is $137,100 to $334,600. Compensation offered will be determined by factors such as location, level, job-related knowledge, skills, and experience. Certain roles may be eligible for incentive compensation, equity, benefits. More details about our company benefits can be found at the following link: .
      #J-18808-Ljbffr

Keywords: Salesforce, San Jose , Senior/Lead Software Engineer - AI Evaluation & Optimization, IT / Software / Systems , San Francisco, California