ApplyBlast uses AI to match you with the right jobs, tailor your resume and cover letter, and apply automatically so you can land your dream job faster.

Features

Auto Apply Resume Optimizer Cover Letter Optimizer Interview Prep

Company

Social Media

Need Help?

team@applyblast.com

Senior Software Engineer, Inference at Hewlett Packard Enterprise - ApplyBlast

Senior Software Engineer, Inference

Hewlett Packard Enterprise

1 month ago

4.8 on Glassdoor

Spring, Texas, United States

Hybrid

Full Time

Senior

0 applicants

View Job Listing

Apply to 100+ jobs

About this role

Hewlett Packard Enterprise is seeking a Senior Software Engineer to design and implement key components of the LLM serving deployment, including engine integration, continuous batching, and distributed execution. The role focuses on building and evolving the model runtime within HPE AI Essentials to achieve low tail latency and high GPU utilization on customer-owned hardware. The engineer will partner with inference teams to improve performance metrics and contribute to the Kubernetes orchestration layer supporting the runtime.

Responsibilities

Design and implement LLM serving deployment components including engine integration and batching
Build and operate distributed execution capabilities across GPU memory and RDMA-attached storage
Contribute to the Kubernetes orchestration layer supporting model admission and GPU scheduling

Skills

Qualifications

Degree in Computer Science or related field

About Hewlett Packard Enterprise

hpe.com

Headquarters

The Woodlands, Texas, United States

Company Size

10001+ employees

Founded

1939

View Profile

Discover HPE edge-to-cloud, enterprise compute IT, data, and security solutions. Learn how HPE empowers digital transformation through AI and sustainability.