[Remote] Senior Engineer, Competitive Benchmarking & Performance

Other Jobs To Apply

Note: The job is a remote job and is open to candidates in USA. Elastic is hiring a Senior Engineer to lead competitive benchmarking initiatives for Elasticsearch. The role builds reproducible benchmark workloads and tools, investigates performance across competing systems, and works with engineering, product, and content partners to guide improvements and publish technical findings.


Responsibilities

  • Own prioritized competitive benchmarking initiatives across search, vector and hybrid retrieval, and analytical and observability workloads
  • Build and maintain automated benchmark harnesses, datasets, query sets, and load profiles that reflect real-world usage, including concurrent ingestion and querying
  • Design fair comparisons with documented system versions, configurations, tuning decisions, resource budgets, and functional differences
  • Evaluate latency distributions, throughput, resource consumption, and cost efficiency. For retrieval workloads, measure performance at comparable recall or relevance targets
  • Adapt and extend workload-appropriate tools such as Elasticsearch Rally, ClickBench, and vector search benchmark frameworks
  • Investigate performance differences using profiling, system metrics, and controlled experiments; collaborate with engineering teams to identify causes and validate improvements
  • Evaluate relevant self-managed and managed cloud deployments, including serverless offerings, accounting for scaling behavior and service constraints
  • Work with engineering and technical content partners to publish reproducible benchmark artifacts and clear technical reports that explain methodology, findings, limitations, and tradeoffs
  • Partner with engineering and product management to prioritize benchmark coverage and translate findings into actionable product improvements

Skills

  • Solid software engineering skills, with experience building maintainable automation and analysis tools in Python or another relevant programming language
  • Hands-on experience evaluating and diagnosing performance in distributed systems, databases, or search infrastructure
  • Depth in at least one relevant area (search, vector retrieval, analytical databases, or observability systems) and the ability to learn unfamiliar systems
  • Experience designing representative datasets and workloads, including query patterns, concurrency, and ingestion behavior
  • Sound experimental judgment, including repeated measurements, variability analysis, warm-up and cache effects, and the distinction between meaningful changes and measurement noise
  • Experience building reproducible test environments and documenting configurations, procedures, and results
  • Clear technical writing and communication skills, with the ability to explain complex findings and their limitations
  • Solid collaboration skills and the ability to turn performance evidence into applicable engineering recommendations
  • Experience with Elasticsearch, Lucene, Rally, ClickBench, or vector search benchmark frameworks
  • Experience measuring retrieval quality alongside latency, throughput, and resource usage
  • Familiarity with cloud performance and cost analysis, including autoscaling and serverless systems
  • Public technical writing, open-source contributions, or published benchmark studies

Benefits

  • Eligible to participate in Elastic's stock program.
  • Company-matched 401k with dollar-for-dollar matching up to 6% of eligible earnings.
  • Health coverage for you and your family in many locations.
  • Ability to craft your calendar with flexible locations and schedules for many roles.
  • Generous number of vacation days each year.
  • We match up to $2000 (or local currency equivalent) for financial donations and service.
  • Up to 40 hours each year to use toward volunteer projects you love.
  • Minimum of 16 weeks of parental leave.

Company Overview

  • Elastic builds software to make data usable in real time and at scale for search, AI, observability, security, and analytics. It was founded in 2012, and is headquartered in San Francisco, California, USA, with a workforce of 1001-5000 employees. Its website is

    • Company H1B Sponsorship

  • Elastic has a track record of offering H1B sponsorships, with 1 in 2024, 2 in 2022, 1 in 2021. Please note that this does not guarantee sponsorship for this specific role.

    • Back to blog

    Other Jobs To Apply

    Analyst, Investment Banking - Private Capital Advisory (Primaries)

    Account Executive / Inside Sales (US Remote)

    Commercial Claims Adjuster - Remote

    Global Forwarding Executive at ArcBest Corporation: 100% Remote (Atlanta, GA)

    SOAR Lead - Security Operations, Automation, and Response (Remote)

    Southwest Work From Home @ Get Dream Job

    Airline Remote Jobs, Delta Airlines Hiring Remote @ Get Dream Job

    Senior Commercial Account Executive

    Forward Deployed Engineer, Life Sciences

    Senior Machine Learning Engineer, 3D Sensor Simulation

    Remote Local Government Affairs Lead | 50% Travel

    Implementation Manager – Data Solutions

    Up to $350k/yr | Remote Outpatient Psychiatrist | TX Licensed

    Remote 1099 Contractor Telehealth Nurse Practitioner

    Overnight Member Experience Specialist

    Business Development and Partnerships Director

    Remote Client Experience Specialist

    Analyst, Spec Adherence

    Director, System Engineering, Integration and Test (SEIT)

    Remote Global Lease Administration Specialist

    Customer Service Rep (100% Work From Home)

    [Hiring] Clinical Research Coordinator to Home-Based CRA @Medpace, Inc.

    Clinical Team Manager/Sr. (CTM) - Internal Medicine

    Field Service Engineer – Field Remote

    Quality Production Associate

    Manager, Capacity Planning & Network Modelling

    Engineer III- Manufacturing Technology Scaling (Vacuum Deposition)

    Compliance Specialist

    Solar Maintenance Technician

    Sr Data & Analytics Developer

    Compliance Officer - Electronic Communications Surveillance (Remote)

    Relationship Manager II, Corporate Banking Relationship Management - Innovation

    Remote Credit Card Support Specialist

    Consumer Advocacy Response Team

    Remote Paid Social & Programmatic Growth Analyst

    Remote Customer Support Developer

    Sr. Enterprise Account Executive

    Growth Marketer, Creators & Channels (Remote)

    Software Engineer (GitHub Contributor) – Remote (Worldwide)

    Remote Booking Coordinator Organized, Client-Focused

    Sales Closer - Tech Agency (High-Ticket, Remote, US-Based)

    Remote Cybersecurity PR Strategist

    Head of Product, Growth

    Remote Salesforce Associate — Admin, Pardot & Dashboards

    Email Marketer (Klaviyo) (Remote)

    Onsite POS Installer

    [Remote] Digital and Payment Solutions Pillar Service Leader, Senior Manager

    CRM & Lifecycle Marketing Specialist - Growth Marketing at AppLovin: 100% Remote (US)

    Energy & Utilities Application Engineer (Remote)

    Remote Global Enterprise Sales Director - Travel Tech

    Common Interview Questions And Answers

    1. HOW DO YOU PLAN YOUR DAY?

    This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

    2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

    When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

    3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

    Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

    4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

    With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

    5. HOW DO YOU PROCESS INFORMATION?

    Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

    6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

    Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

    7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

    Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

    8. HOW TO PRIORITIZE WORK?

    The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

    9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

    Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

    10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

    This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...