Research
182 stories
SemiEngineeringSiliconScaling Data Movement For Physical AI Physical AI poses a host of new challenges for chip engineers. These systems contain a mix of compute elements, which collectively must process a stream of real-time data, analyze it, make decisions…
SemiEngineeringSiliconScaling CPO Testing Beyond A Single Die Key Takeaways: Fiber alignment is the main bottleneck to optical engine testing, which would be alleviated significantly by multi-site probe cards.
Latent SpaceVoices[AINews] DeepSeek DeepInfer: Open Source SOTA Inference running 155T toks/day/cluster making $22m/day at ~80% margin for a 81 day payback Proudly brought to you by SerpAPI: Today’s release covers a LOT of ground, but you can scrape all this into markdown for your agents ! 50% token cost of JSON.
AWS Machine LearningLabsBeyond the KV cache: Training and serving i14’s Laplace 3B linear attention model on AWS Trainium2 with native PyTorch Most large language models (LLMs) use transformer architectures with softmax attention. During inference, their key-value (KV) cache grows with the conversation or document context.
The New StackGitHubAssess the entire inference stack — not just open model benchmarks Impressive benchmark results should make it easy for engineers to select the right open model for the outcome they are tasked with developing. However, that is not the case.
Amazon ScienceResearchStrengthening AI safety evaluation through independent third-party review As frontier AI models grow in capability, so does the importance of ensuring that safety evaluations are rigorous and comprehensive.
Hugging Face BlogLabsFairStress: A deeper evaluation of fairness in LLM decision-making Today we’re introducing FairStress , a benchmark for measuring demographic fairness in LLMs beyond the choice a model ultimately makes in decisions impacting people.
Tom's HardwareSiliconMysterious AMD Zen 6 APU with 24GB of LPDDR5 memory appears in benchmarks An AMD engineering sample has made an appearance in a listing on OpenBenchmarking. According to a report by TechPowerUp , the chip could potentially be a part of AMD’s upcoming Gainsborough family…
InfoQ AIGitHubPresentation: Beyond the Prototype: Scaling Framework Agnostic AI Agent Infrastructure with Ray The speakers discuss transitioning AI agents from local FastAPI prototypes to resilient production systems on Kubernetes using Ray.
JetBrains BlogToolsCoding-Agent Benchmarks Should Match Their Users’ Task Flows Left: SWE-Bench Pro, where each task is a single user message, almost always a new feature or a bug fix.
Ai2LabsFairStress: A deeper evaluation of fairness in LLM decision-making FairStress is a new benchmark that reveals demographic differences in how LLMs defend and explain their decisions, even when their final choices appear fair.
Hamel HusainVoicesHow To Use Decision Models for Evals main.content table { display:block; width:100%; max-width:100%; overflow-x:auto; } #evaluation-prompt pre { background:var(--bs-body-bg); color:var(--bs-body-color); padding:18px; border:1px solid…
AI Snake OilVoicesNew paper: Emerging trends in AI agent evaluation By Felix Chen, Stephan Rabanser, Sayash Kapoor, and Arvind Narayanan. See the full author list and affiliations here .
Chips and CheeseSiliconNvidia Vera’s System Architecture: Pushing Bandwidth Nvidia’s Vera server chip aims for high per-core performance. Its Olympus cores have massive out-of-order structures and use high per-clock throughput to meet that goal within a high core count…
LangChainToolsHow Numan Built an Eval-First AI Health Coach with LangGraph and LangSmith How Numan built Nu, an AI health coach, on LangGraph and LangSmith with per-category evals, simulated conversations, and safety gates on a regulatory line.
IBM Research
IBM ResearchResearchNew course teaches how AI models run on modern accelerators 'Dataflow Architectures for AI' is a 6-course specialization from IBM Research that compares leading accelerator architectures through hands-on labs.
InfoQ AIGitHubArticle: From Microservices to Agents: the Next Evolution of Distributed Systems InfoQ Homepage Articles From Microservices to Agents: The Next Evolution of Distributed Systems
IEEE Spectrum AISiliconEdge AI for Smart Cities: From Insight to Cognitive Action This white paper explains how edge AI and physical AI help cities move beyond passive monitoring. It shows how urban infrastructure can sense, reason, and act on real-time conditions across public…
vLLM BlogToolsAchieving near-zero-downtime scaling in Elastic Expert Parallelism How asynchronous preparation and NIXL EP enabled near-zero-downtime Elastic EP scaling in vLLM.
AI Alignment Forum
AI Alignment ForumResearchThe Alignment Problem: Computer Science Meets Analytic Philosophy TLDR: I explain what the technical AI alignment problem is and what its core difficulties are, in my view.
Y Combinator (YouTube)
Y Combinator (YouTube)ValleyAI Safety Fact vs. Fiction | YC Paper Club
Quanta MagazineResearchHe Wants AI Benchmarking To Be a Science, Not a Dark Art Benchmarks are the rulers of AI, in both senses of the word. As measuring sticks, they work according to an extremely simple logic: If you want to know what an AI model can do, devise a standardized…
Mercari EngineeringJapanElasticsearch の Autoscaling を改善する: scale-out の高速化と HPA tolerance の調整 はじめに 検索基盤チームの mrkm4ntr です。以前、 CPU 使用率による Elasticsearch の autoscaling について書きました。ピーク時間帯に合わせて確保していたリソースを、トラフィックに合わせて増減することで、Elasticsearch のコストを約 40% 削減できました。 この autoscaling には、まだコストを削る余地が残っていました。
AI Alignment ForumResearchA Simpler and Better Debate Protocol for Scalable Oversight Linkpost to arXiv: https://arxiv.org/abs/2610.02557 Summary: One promising approach to scalable oversight is AI debate , which seeks to leverage a debate between two powerful AIs to break complex…
Nothing matches this filter yet.