Google researchers have proposed TurboQuant, a two-stage quantization method that, according to a recent arXiv preprint, can cut key-value cache memory by about 4x in their tests while reporting no ...

Thermometer, a new calibration technique tailored for large language models, can prevent LLMs from being overconfident or underconfident about their predictions. The technique aims to help users know ...

Large language models (LLMs) can generate credible but inaccurate responses, so researchers have developed uncertainty quantification methods to check the reliability of predictions. One popular ...

2024 is going to be a huge year for the cross-section of generative AI/large foundational models and robotics. There’s a lot of excitement swirling around the potential for various applications, ...

Tiffanwy Klippel-Cooper of OmnigeniQ explains how physics-based modelling could help researchers better understand drug ...

Researchers at Google Cloud and UCLA have proposed a new reinforcement learning framework that significantly improves the ability of language models to learn very challenging multi-step reasoning ...

Researchers at Tsinghua University and Z.ai built IndexCache to eliminate redundant computation in sparse attention models ...