#devops
Every summary, chronological. Filter by category, tag, or source from the rail.
Ditch preferred_username for Azure AD Guest Auth
Using preferred_username as identity anchor worked for employees but failed silently for all B2B guests, causing 403 errors post-launch. Anchor on oid instead for reliable identification.
SIE: Dynamic Inference for Small Models on Shared GPUs
Open-source SIE engine from Superlinked enables hot-swapping small embedding models (e.g., Stella, ColBERT) on one GPU via LRU eviction, cutting costs and solving context rot in agents by preprocessing data.
AI EngineerSecure AI Agents via MCP Toolbox Custom Tools
MCP Toolbox prevents confused deputy attacks by letting developers pre-write constrained SQL tools with bound parameters, separating agent flexibility from app-controlled security for runtime agents.
Replace Cron with Temporal for Reliable Data Jobs
Cron fails on retries, overlaps, and writes due to zero observability. Temporal workflows add retries (3s initial, 2x backoff, 8 max attempts), atomic writes, unique output files per run ID, SKIP overlap policy, and full execution history via UI—surviving crashes with state in Temporal.
Self-Host Vane + Ollama for Private AI Web Research
Install Vane in Docker on Windows 11 with local Ollama and Qwen3.5:9b to run citation-backed searches privately, bypassing cloud services like OpenAI.
Proactive Synthetic Monitoring Catches DevOps Failures Early
Simulate user actions like logins, searches, and API calls to detect regressions, availability issues, and performance degradation before production traffic, integrating tests into CI/CD for consistent validation.
IBM TechnologySageMaker Fine-Tuning: LoRA Beats QLoRA on Cost-Perf Balance
LoRA cuts trainable params by 96% vs full fine-tuning, balancing cost savings and accuracy on Llama2-7B/Mistral7B; QLoRA saves 8x memory but trains slower due to dequantization overhead.
Composable Specialists Beat Monoliths for Enterprise AI
Panel agrees enterprises need Granite 4.1's task-specific models and Bob's orchestration for cost control, with DiLoCo enabling distributed training to sidestep grid limits.
IBM TechnologyBigtable Scales Petabytes for Real-Time NoSQL Workloads
Bigtable auto-scales to hundreds of petabytes and millions of ops/sec with low latency, powering Google Search/YouTube/Maps; ideal for time series, ML features, and streaming via Flink/Kafka integrations.
Google Cloud TechScale PyTorch DDP Multi-Node on AWS EC2: Infra-First Guide
Multi-node DDP demands identical environments, data access, and open security groups across EC2 instances; use torchrun launcher with DDPManager for minimal code changes and reliable gradient sync via NCCL.
TPUs Dominate at Infrastructure Scale Over Per-Chip GPU Wins
Google's TPU v8t (training) and v8i (inference) lag Nvidia GPUs per chip but deliver superior performance at scale—9600-chip superpods hit 121 exaFLOPS FP4—via cube topology and Virgo networking, optimizing for AI's bandwidth-heavy workloads.