Machine Learning Intern - Dynamic KV-Cache Modeling for Efficient LLM Inference
d-Matrix(16 days ago)
About this role
d-Matrix is seeking a Machine Learning Intern to develop a dynamic Key-Value cache solution for Large Language Model inference, focusing on improving memory utilization and execution efficiency on their hardware. The role involves modeling within PyTorch and researching existing inference mechanisms.
Required Skills
- PyTorch
- Deep Learning
- CUDA
- Python
- Model Optimization
- Memory Management
- Hardware Acceleration
- Tensor
- Compute Graphs
- Inference Optimization
About d-Matrix
www.d-matrix.aid-Matrix is revolutionizing generative AI with its cutting-edge inference platform, Corsair™, designed for ultra-low latency and high throughput in data centers. The platform integrates memory-compute technology, enabling speeds of 60,000 tokens per second with just 1ms latency for advanced models, making it both efficient and sustainable. With a focus on scalability, d-Matrix's products cater to a wide range of enterprise needs, advancing the accessibility and performance of AI technologies. Additionally, d-Matrix is committed to sustainability, allowing organizations to achieve impressive performance while minimizing energy consumption.
View more jobs at d-Matrix →Apply instantly with AI
Let ApplyBlast auto-apply to jobs like this for you. Save hours on applications and land your dream job faster.
More jobs at d-Matrix
Similar Jobs
LLM Inference Engineer
Hippocratic AI(3 months ago)
Research Intern, Inference (Summer 2026)
Together AI(1 month ago)
Head of Inference Kernels
Etched(3 months ago)
Lead ML Inference Engineer, Advertising
Roku(1 month ago)
ML Engineer, Large Language Models (LLM Training & Inference Optimization)
Nebius(10 months ago)
Senior Machine Learning Engineer (Modeling), Support
Block(1 month ago)