Distillation

DeepSeek used OpenAI’s model to train its competitor using ‘distillation,’ White House AI czar says

vm_adminJanuary 29, 2025

DeepSeek used OpenAI’s model to train its competitor using ‘distillation,’ White House AI czar says Fortune Article Source https://fortune.com/2025/01/29/deepseek-openais-what-is-distillation-david-sacks/

AI News

Here’s How Big LLMs Teach Smaller AI Models Via Leveraging Knowledge Distillation

vm_adminJanuary 27, 2025

Expanding trend of using AI-driven knowledge distillation to have LLMs boost the capabilities of … [+] SLMs. getty In today’s…

Amazon Web Services

Build faster, more cost-efficient, highly accurate models with Amazon Bedrock Model Distillation (preview) | Amazon Web Services

vm_adminJanuary 24, 2025

Today, we’re announcing the availability of Amazon Bedrock Model Distillation in… Article Source https://aws.amazon.com/blogs/aws/build-faster-more-cost-efficient-highly-accurate-models-with-amazon-bedrock-model-distillation-preview/