The letter

One letter a week, in your inbox.

The signal of the week, what shipped, what to try, and the editor's note. No tracking, no ads, nothing else.

We keep your address, your language and the date you joined, nothing else. Every letter has a one-click unsubscribe link that deletes the record.
← Accept All   Archive
AWS Machine LearningLabs

Reduce inference cold starts on Amazon SageMaker HyperPod with model caching

September 10
Reduce inference cold starts on Amazon SageMaker HyperPod with model caching

<p>When you deploy a large language model (LLM) for inference on <a href="https://aws.amazon.com/sagemaker/ai/hyperpod/" target="_blank" rel="noopener">Amazon SageMaker HyperPod</a>, there’s a gap between when you reques

Read at AWS Machine Learning ↗

Related

Benchmarking small LLM inference on SageMaker AI: G7 vs G5 and G6

LabsBenchmarking small LLM inference on SageMaker AI: G7 vs G5 and G6 AWS Machine Learning

Automated agent evaluation with Amazon Bedrock AgentCore and GitHub Actions

LabsAutomated agent evaluation with Amazon Bedrock AgentCore and GitHub Actions AWS Machine Learning

Govern models with MLflow and Amazon SageMaker AI Model Registry sync: Part 1

LabsGovern models with MLflow and Amazon SageMaker AI Model Registry sync: Part 1 AWS Machine Learning

Govern models with MLflow and Amazon SageMaker AI Model Registry sync: Part 2

LabsGovern models with MLflow and Amazon SageMaker AI Model Registry sync: Part 2 AWS Machine Learning

Amazon SageMaker Feature Store introduces UpdateRecord for feature-level writes

LabsAmazon SageMaker Feature Store introduces UpdateRecord for feature-level writes AWS Machine Learning

Pathway’s brain-inspired architecture development on Amazon SageMaker HyperPod

LabsPathway’s brain-inspired architecture development on Amazon SageMaker HyperPod AWS Machine Learning

More from AWS Machine Learning on Accept All.