NVIDIA Enhances TensorRT-LLM with KV Cache Optimization Features
NVIDIA introduces new KV cache optimizations in TensorRT-LLM, enhancing performance and efficiency for large language models on GPUs by managing...
Large language models
NVIDIA Introduces Nemotron-CC: A Massive Dataset for LLM Pretraining
NVIDIA debuts Nemotron-CC, a 6.3-trillion-token English dataset, enhancing pretraining for large language models with innovative data curation methods. (Read More)
Exploring the Impact of LLM Integration on Conversation Intelligence Platforms
Discover how integrating Large Language Models (LLMs) revolutionizes Conversation Intelligence platforms, enhancing user experience, customer understanding, and decision-making processes. (Read...
NVIDIA’s 2024 Innovations in AI and Data Science Capture Industry Attention
NVIDIA's 2024 advancements in AI, large language models, and data science optimization have made significant impacts, as highlighted in the...
TEAL Introduces Training-Free Activation Sparsity to Boost LLM Efficiency
TEAL offers a training-free approach to activation sparsity, significantly enhancing the efficiency of large language models (LLMs) with minimal degradation....
NVIDIA TensorRT-LLM Boosts Hebrew LLM Performance
NVIDIA's TensorRT-LLM and Triton Inference Server optimize performance for Hebrew large language models, overcoming unique linguistic challenges. (Read More)
How the US used AI to take on the Taliban amid drawdown
Many have questioned the lessons learned from the 20-year war in Afghanistan following the chaotic withdrawal and subsequent Taliban takeover,...
Mastering ‘the art of brainwashing,’ China intensifies AI censorship
China has once again extended its policy of censorship and surveillance as it looks to keep artificial intelligence (AI) models...
NATO’s $1.1B innovation fund invests in AI, robots and space tech
A consortium of NATO allies has confirmed the first tranche of companies awarded funding as part of the group’s $1.1...
Enhancing AI’s Operational Efficiency: Breakthroughs from Microsoft Research and Peking University
Researchers from Microsoft Research and Peking University have developed groundbreaking methods to enhance LLMs' ability to follow complex instructions and...
