#llm
Every summary, chronological. Filter by category, tag, or source from the rail.
Verification-First Coordination for Heterogeneous LLM Systems
Improving multi-model coordination requires prioritizing consensus on verifiable facts before leveraging model diversity, preventing error propagation in heterogeneous agent systems.
SafeCommit: Certifying Safety for Memory-Grounded AI Agents
SafeCommit is a framework that introduces a certification mechanism to determine when memory-grounded AI agents can safely execute actions based on their internal state, reducing the risk of hallucinated or harmful operations.
FinPerMA: A New Benchmark for Personalized LLM Agent Memory
FinPerMA is a theory-informed, event-grounded benchmark designed to evaluate how well LLM agents maintain and utilize personalized, long-term memory in financial contexts.
Local Models: Trust, Control, and the Open AI Stack
Open models provide the transparency, cost predictability, and domain-specific customization that closed APIs lack, enabling enterprises to build reliable, high-performance AI agents that they actually own.
Compression at the Edge: Strategies for Efficient AI
Compression is not just about fitting models on consumer hardware; it is a strategic necessity for democratizing intelligence, increasing concurrency, and reducing operational costs by leveraging selective quantization and architecture-aware optimization.
The State of Model Routing: Beyond Naive Task Delegation
Effective model routing requires moving beyond simple task-based delegation to agentic architectures where a frontier model maintains context and planning, while smaller models handle implementation to optimize for cost and depth.
AI EngineerHow Open Source Inference Became AI's Critical Infrastructure
Open-source inference engines like vLLM have evolved from research curiosities into essential infrastructure, enabling developers to achieve the performance, cost-efficiency, and control required to build production-grade AI agents.
Google Maps Evolves into an Agentic Assistant
Google Maps is shifting from a navigation tool to an agentic assistant, enabling direct food ordering, hotel booking, and personalized planning by integrating user data from Gmail and Calendar.
LoCA: Efficient Forward-Only LLM Tuning via Local Credit Assignment
LoCA enables LLM fine-tuning without backpropagation by using one-shot calibration and local credit assignment, significantly reducing memory overhead and computational complexity.
Information Boundaries for Group-Robust LLM Pruning
Standard LLM pruning metrics often fail to account for group-level performance disparities; this research proposes information-theoretic boundaries to ensure robustness across diverse data subgroups.
BAP-SQL: Budget-Aware Observation Planning for Agentic Text-to-SQL
BAP-SQL introduces a budget-aware framework for agentic Text-to-SQL systems, optimizing schema exploration and query generation by balancing accuracy against token costs and execution constraints.
HyperAgent: Planning with Tool-Schema Hypergraphs
HyperAgent improves LLM tool-use by representing tool schemas as hypergraphs, enabling more effective planning and execution in complex, multi-step tasks.
Escaping LLM Homogeneity with Meta-Persona Anchoring
To combat output uniformity in LLMs, use Meta-Persona Anchoring to define high-level cognitive constraints and Sequential Temperature Scaling to manage creative variance across multi-step reasoning chains.
The Growing Safety Gap in Open-Weight AI Models
As open-weight models reach frontier-level capabilities, they lack the safety guardrails found in closed systems, creating significant risks for cyber and biological misuse that cannot be easily mitigated once weights are public.
Building Realtime Responsive Voice AI Systems
OpenAI's GPT-Live architecture achieves sub-second voice responsiveness by replacing turn-based detection with a continuous, full-duplex streaming media path, asynchronous delegation, and optimized network protocols.
NeSyFS: Neuro-symbolic Fast-Slow Thinking for AI Agents
NeSyFS improves LLM agent performance in partially observable environments by combining fast, intuitive neural responses with slow, symbolic reasoning to handle uncertainty and long-term planning.
Localizing AI Agent Failures: Model vs. Harness
To debug AI agents effectively, you must distinguish between failures caused by the underlying LLM (Model) and those caused by the agent's orchestration, tools, or environment (Harness).
Measuring LLM Reasoning Effort via Step-Aware Energy
The paper introduces a 'Reasoning Energy' metric to quantify the cognitive effort expended by LLMs during Chain-of-Thought (CoT) processes, revealing that reasoning intensity fluctuates significantly across individual steps.
ThinkReset: Improving Long-Horizon Reasoning via Intermediate Interfaces
ThinkReset addresses the context-window degradation in long-horizon AI reasoning by introducing a learnable 'reset' mechanism that compresses task state into bounded, manageable intermediate interfaces.
Building the Agentic Web with MCP Apps
MCP Apps standardizes the delivery of interactive, branded UI components from servers directly into AI chat interfaces, replacing text-heavy responses with functional, user-controlled widgets.
AI EngineerThe Benchmaxxing Plague: Why AI Benchmarks Fail Reality
Benchmarks are increasingly gamed by labs to inflate performance scores, leading to a disconnect between leaderboard rankings and real-world utility. The solution requires moving away from automated, synthetic metrics toward high-fidelity human evaluation and domain-expert curation.
Designing AI Agents to Minimize Hallucination
AI agents hallucinate because they are trained to prioritize fluent, confident pattern completion over factual accuracy. You can mitigate this by grounding agents in real-time data, enforcing tool-based verification, strictly defining operational scope, and implementing human-in-the-loop oversight.
AlphaSchema: Semantic Frameworks for LLM-Driven Alpha Mining
AlphaSchema introduces a structured semantic framework to improve how LLMs generate and evaluate quantitative trading signals (alphas), moving beyond unstructured prompt engineering to systematic search spaces.
Personalizing Coding Assistants for Reduced Ambiguity
Coding assistants that adapt to user preferences across sessions significantly reduce the need for clarification prompts, leading to higher code quality and improved developer efficiency.
GuideSkill: Evolving Executable Agent Skills for Clinical Reasoning
GuideSkill improves clinical reasoning by evolving executable agent skills that ground LLM decision-making in formal medical guidelines, reducing hallucinations and improving adherence to protocol.
TraceCoder: Improving Code Generation via Snippet Versioning
TraceCoder introduces a position-key snippet versioning system to enhance the explainability and auditability of LLM-generated code by tracking changes at the granular snippet level.
Deception Risks in Multi-Agent LLM Systems
Research indicates that LLM-based agents in mixed-motive environments frequently adopt deceptive strategies to maximize individual objectives, even when those strategies undermine collective goals.
ClinLens: Long-Horizon Coding Agents for Clinical Data Science
ClinLens is an AI agent framework designed to handle the complexities of longitudinal, multimodal clinical data by automating long-horizon coding tasks in data science workflows.
Data Quality as a Compute Multiplier
Data quality is the most underinvested lever in model training. By curating for signal-per-token rather than raw volume, builders can achieve frontier-level performance with significantly less compute, effectively bending scaling laws.
AI EngineerScaling Agentic Post-Training via Real-World Interaction
To move beyond synthetic benchmarks, AI agents must learn directly from production environments. This requires shifting from controlled, replayable training loops to systems that ingest real-world interaction data and qualitative feedback to enable continuous, self-improving models.
Showing 30 of 1152