ApplyBlast uses AI to match you with the right jobs, tailor your resume and cover letter, and apply automatically so you can land your dream job faster.

Features

Auto Apply Resume Optimizer Cover Letter Optimizer Interview Prep

Company

Social Media

Need Help?

team@applyblast.com

Machine Learning Intern - Dynamic KV-Cache Modeling for Efficient LLM Inference at d-Matrix - ApplyBlast

Machine Learning Intern - Dynamic KV-Cache Modeling for Efficient LLM Inference

d-Matrix

8 months ago

Remote

Internship

Intern

0 applicants

View Job Listing

Apply to 100+ jobs

About this role

d-Matrix is seeking a Machine Learning Intern to develop a dynamic Key-Value cache solution for Large Language Model inference, focusing on improving memory utilization and execution efficiency on their hardware. The role involves modeling within PyTorch and researching existing inference mechanisms.

Skills

About d-Matrix

www.d-matrix.ai

Headquarters

Santa Clara, California, United States

Company Size

51-200 employees

Founded

2019

View Profile

d-Matrix is revolutionizing generative AI with its cutting-edge inference platform, Corsair™, designed for ultra-low latency and high throughput in data centers. The platform integrates memory-compute technology, enabling speeds of 60,000 tokens per second with just 1ms latency for advanced models, making it both efficient and sustainable. With a focus on scalability, d-Matrix's products cater to a wide range of enterprise needs, advancing the accessibility and performance of AI technologies. Additionally, d-Matrix is committed to sustainability, allowing organizations to achieve impressive performance while minimizing energy consumption.