[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"summary-cut-ai-token-costs-with-harness-constraints-summary":3,"summaries-facets-categories":114,"summary-related-cut-ai-token-costs-with-harness-constraints-summary":4520},{"id":4,"title":5,"ai":6,"body":13,"categories":49,"created_at":50,"date_modified":50,"description":43,"extension":51,"faq":50,"featured":52,"kicker_label":50,"meta":53,"navigation":95,"path":96,"published_at":97,"question":50,"scraped_at":98,"seo":99,"sitemap":100,"source_id":101,"source_name":102,"source_type":103,"source_url":104,"stem":105,"tags":106,"thumbnail_url":50,"tldr":111,"tweet":50,"unknown_tags":112,"__hash__":113},"summaries\u002Fsummaries\u002Fcut-ai-token-costs-with-harness-constraints-summary.md","Cut AI Token Costs with Harness Constraints",{"provider":7,"model":8,"input_tokens":9,"output_tokens":10,"processing_time_ms":11,"cost_usd":12},"openrouter","x-ai\u002Fgrok-4.1-fast",8352,1982,21544,0.00263875,{"type":14,"value":15,"toc":42},"minimark",[16,21,25,29,32,35,39],[17,18,20],"h2",{"id":19},"token-consumption-drives-unsustainable-costs","Token Consumption Drives Unsustainable Costs",[22,23,24],"p",{},"Output tokens cost 5-6x more than inputs, forming the core of inference expenses. Despite per-token prices dropping 10x, overall consumption rose over 100x, yielding 10x higher spending—e.g., from $50\u002F1M tokens x 100M\u002Fmonth ($5k) to $5\u002F1M x 10B\u002Fmonth ($50k). Complex tasks, non-deterministic agent behavior (loops, hallucinations), and 'tokenmaxxing' (maximizing spend for perceived gains) amplify this. Multi-agent systems boost reliability but consume far more tokens than single agents, with performance gains not scaling linearly (no 10x tokens for 10x quality). Anthropic capped $200\u002Fmonth Max plans after users hit $5k token bills, proving even big teams struggle. Without harness-level optimizations—curating context\u002Ftools\u002Fmodels—costs outpace revenue at scale.",[17,26,28],{"id":27},"harness-tactics-slash-usage-without-sacrificing-results","Harness Tactics Slash Usage Without Sacrificing Results",[22,30,31],{},"Minimize context by trimming irrelevant details and using memory systems to forget unneeded info, keeping windows slim to boost focus, performance, and speed. Expose only task-specific tools to avoid wrong calls bloating context with large outputs (e.g., full datasets). Route statically via evals (Task A to cheap Model A) or dynamically with routers judging complexity (e.g., 'summarize' to simple model), saving on overkill for easy tasks. In multi-agent setups, orchestrators delegate to specialized subagents with tailored harnesses (prompts, tools, models), enabling parallelism for faster responses and less context per agent.",[22,33,34],{},"Cache input\u002Foutput tokens from providers at lower rates for similar requests—ideal for static\u002Frepetitive workloads like repeated analyses—cutting regen costs and latency. Set 'thinking budgets' (e.g., Gemini's thinking_budget, Claude's budget_tokens) to match task complexity, plus output limits (e.g., 10k chars) or stop sequences. Batch non-urgent requests via OpenAI's Batch API (50% cheaper). Offload to server-side compute (e.g., DB queries for filtering) replaces model reasoning with deterministic ops, saving hundreds\u002Fthousands of tokens per request.",[17,36,38],{"id":37},"trace-monitoring-reveals-optimization-paths","Trace Monitoring Reveals Optimization Paths",[22,40,41],{},"Track per-interaction traces with LangSmith\u002FLangfuse for token\u002Flatency\u002Ftool insights, spotting high-burn steps for rerouting or agent specialization. Granular data flags issues like overthinking or identifies self-hosting thresholds—hybrid setups route heavy workflows to owned\u002Fopen-source infra for long-term savings, especially sensitive tasks. Collective tactics don't yield huge single wins but compound to sustainable cost-performance balance as usage scales.",{"title":43,"searchDepth":44,"depth":44,"links":45},"",2,[46,47,48],{"id":19,"depth":44,"text":20},{"id":27,"depth":44,"text":28},{"id":37,"depth":44,"text":38},[],null,"md",false,{"content_references":54,"triage":90},[55,60,64,67,70,73,76,79,82,85],{"type":56,"title":57,"url":58,"context":59},"paper","Stop Wasting Your Tokens: Towards Efficient Runtime Multi-Agent Systems","https:\u002F\u002Farxiv.org\u002Fabs\u002F2510.26585v2","cited",{"type":61,"title":62,"url":63,"context":59},"other","Continually improving our agent harness","https:\u002F\u002Fcursor.com\u002Fblog\u002Fcontinually-improving-agent-harness",{"type":61,"title":65,"url":66,"context":59},"Token optimization: The backbone of effective prompt engineering","https:\u002F\u002Fdeveloper.ibm.com\u002Farticles\u002Fawb-token-optimization-backbone-of-effective-prompt-engineering\u002F",{"type":61,"title":68,"url":69,"context":59},"Why observability is essential for AI agents","https:\u002F\u002Fwww.ibm.com\u002Fthink\u002Finsights\u002Fai-agent-observability",{"type":61,"title":71,"url":72,"context":59},"Stop Burning Tokens: A Developer’s Guide to Claude AI Token Optimization","https:\u002F\u002Flevelup.gitconnected.com\u002Fstop-burning-tokens-a-developers-guide-to-claude-ai-token-optimization-4c70c7c52ffb",{"type":61,"title":74,"url":75,"context":59},"Stop wasting money on AI: 10 ways to cut token usage","https:\u002F\u002Fblog.logrocket.com\u002Fstop-wasting-ai-tokens-10-ways-to-reduce-usage\u002F",{"type":61,"title":77,"url":78,"context":59},"How to Reduce Token Usage in AI Agents: 10 MCP Optimization Techniques","https:\u002F\u002Fwww.mindstudio.ai\u002Fblog\u002Freduce-token-usage-ai-agents-mcp-optimization",{"type":61,"title":80,"url":81,"context":59},"LLM Token Optimization: Cut Costs & Latency in 2026","https:\u002F\u002Fredis.io\u002Fblog\u002Fllm-token-optimization-speed-up-apps\u002F",{"type":61,"title":83,"url":84,"context":59},"How to optimize machine learning inference costs and performance","https:\u002F\u002Fredis.io\u002Fblog\u002Fmachine-learning-inference-cost\u002F",{"type":86,"title":87,"url":88,"context":89},"tool","OpenAI’s Batch API","https:\u002F\u002Fdevelopers.openai.com\u002Fapi\u002Fdocs\u002Fguides\u002Fbatch","recommended",{"relevance":91,"novelty":92,"quality":92,"actionability":91,"composite":93,"reasoning":94},5,4,4.55,"Category: AI Automation. The article provides in-depth strategies for optimizing token usage in AI systems, addressing a critical pain point for product builders facing rising costs. It offers actionable tactics like caching tokens and setting 'thinking budgets' that can be directly implemented to improve efficiency.",true,"\u002Fsummaries\u002Fcut-ai-token-costs-with-harness-constraints-summary","2026-05-05 15:31:39","2026-05-08 15:33:24",{"title":5,"description":43},{"loc":96},"800e6a330db5a0e8","Priank's Newsletter (Agentic UX)","article","https:\u002F\u002Fpriankr.substack.com\u002Fp\u002Fbuilding-token-efficient-ai-systems","summaries\u002Fcut-ai-token-costs-with-harness-constraints-summary",[107,108,109,110],"llm","agents","ai-automation","dev-productivity","Token use surged 100x despite 10x cheaper pricing, driving 10x higher bills (e.g., $5k to $50k\u002Fmonth); route tasks to right models\u002Fagents\u002Ftools, cache tokens, limit outputs, and monitor traces to balance cost and performance.",[109,110],"3mFXB5P_f1aCyHf5MU-cyxWoh6eUspRdLn1EJJoE9GE",[115,118,120,123,125,128,131,134,137,139,141,143,145,147,149,151,154,156,158,160,162,164,166,169,171,173,175,177,179,181,183,185,187,189,191,193,195,197,199,201,203,205,207,209,211,214,216,218,220,222,224,226,228,230,232,234,236,238,240,242,244,246,248,250,252,254,256,258,260,262,264,266,268,270,272,274,276,278,280,282,284,286,288,290,292,294,296,298,300,302,304,306,308,310,312,314,316,318,320,322,324,326,328,330,332,334,336,338,340,342,344,346,348,350,352,354,356,358,360,362,364,366,368,370,372,374,376,378,380,382,384,386,388,390,392,394,396,398,400,402,404,406,408,410,412,414,416,418,420,422,424,426,428,430,432,434,436,438,440,442,444,446,448,450,452,454,456,458,460,462,464,466,468,470,472,474,476,479,481,483,485,487,489,491,493,495,497,499,501,503,505,507,509,511,513,515,517,519,521,523,525,527,529,531,533,535,537,539,541,543,545,547,549,551,553,555,557,559,561,563,566,568,570,572,574,576,578,580,582,584,586,588,590,592,594,596,598,600,602,604,606,608,610,612,614,616,618,620,622,624,626,628,630,632,634,636,638,640,642,644,646,648,650,652,654,656,658,660,662,664,666,668,670,672,674,676,678,680,682,684,686,688,690,692,694,696,698,700,702,704,706,708,710,712,714,716,718,720,722,724,726,728,730,732,734,736,738,740,742,744,746,748,750,752,754,756,758,760,762,764,766,768,770,772,774,776,778,780,782,784,786,788,790,792,794,796,798,800,802,804,806,808,810,812,814,816,818,820,822,824,826,828,830,832,834,836,838,840,842,844,846,848,850,852,854,856,858,860,862,864,866,868,870,872,874,876,878,880,882,884,886,888,890,892,894,896,898,900,902,904,906,908,910,912,914,916,918,920,922,924,926,928,930,932,934,936,938,940,942,944,946,948,950,952,954,956,958,960,962,964,966,968,970,972,974,976,978,980,982,984,986,988,990,992,994,996,998,1000,1002,1004,1006,1008,1010,1012,1014,1016,1018,1020,1022,1024,1026,1028,1030,1032,1034,1036,1038,1040,1042,1044,1046,1048,1050,1052,1054,1056,1058,1060,1062,1064,1066,1068,1070,1072,1074,1076,1078,1080,1082,1084,1086,1088,1090,1092,1094,1096,1098,1100,1102,1104,1106,1108,1110,1112,1114,1116,1118,1120,1122,1124,1126,1128,1130,1132,1134,1136,1138,1140,1142,1144,1146,1148,1150,1152,1154,1156,1158,1160,1162,1164,1166,1168,1170,1172,1174,1176,1178,1180,1182,1184,1186,1188,1190,1192,1194,1196,1198,1200,1202,1204,1206,1208,1210,1212,1214,1216,1218,1220,1222,1224,1226,1228,1230,1232,1234,1236,1238,1240,1242,1244,1246,1248,1250,1252,1254,1256,1258,1260,1262,1264,1266,1268,1270,1272,1274,1276,1278,1280,1282,1284,1286,1288,1290,1292,1294,1296,1298,1300,1302,1304,1306,1308,1310,1312,1314,1316,1318,1320,1322,1324,1326,1328,1330,1332,1334,1336,1338,1340,1342,1344,1346,1348,1350,1352,1354,1356,1358,1360,1362,1364,1366,1368,1370,1372,1374,1376,1378,1380,1382,1384,1386,1388,1390,1392,1394,1396,1398,1400,1402,1404,1406,1408,1410,1412,1414,1416,1418,1420,1422,1424,1426,1428,1430,1432,1434,1436,1438,1440,1442,1444,1446,1448,1450,1452,1454,1456,1458,1460,1462,1464,1466,1468,1470,1472,1474,1476,1478,1480,1482,1484,1486,1488,1490,1492,1494,1496,1498,1500,1502,1504,1506,1508,1510,1512,1514,1516,1518,1520,1522,1524,1526,1528,1530,1532,1534,1536,1538,1540,1542,1544,1546,1548,1550,1552,1554,1556,1558,1560,1562,1564,1566,1568,1570,1572,1574,1576,1578,1580,1582,1584,1586,1588,1590,1592,1594,1596,1598,1600,1602,1604,1606,1608,1610,1612,1614,1616,1618,1620,1622,1624,1626,1628,1630,1632,1634,1636,1638,1640,1642,1644,1646,1648,1650,1652,1654,1656,1658,1660,1662,1664,1666,1668,1670,1672,1674,1676,1678,1680,1682,1684,1686,1688,1690,1692,1694,1696,1698,1700,1702,1704,1706,1708,1710,1712,1714,1716,1718,1720,1722,1724,1726,1728,1730,1732,1734,1736,1738,1740,1742,1744,1746,1748,1750,1752,1754,1756,1758,1760,1762,1764,1766,1768,1770,1772,1774,1776,1778,1780,1782,1784,1786,1788,1790,1792,1794,1796,1798,1800,1802,1804,1806,1808,1810,1812,1814,1816,1818,1820,1822,1824,1826,1828,1830,1832,1834,1836,1838,1840,1842,1844,1846,1848,1850,1852,1854,1856,1858,1860,1862,1864,1866,1868,1870,1872,1874,1876,1878,1880,1882,1884,1886,1888,1890,1892,1894,1896,1898,1900,1902,1904,1906,1908,1910,1912,1914,1916,1918,1920,1922,1924,1926,1928,1930,1932,1934,1936,1938,1940,1942,1944,1946,1948,1950,1952,1954,1956,1958,1960,1962,1964,1966,1968,1970,1972,1974,1976,1978,1980,1982,1984,1986,1988,1990,1992,1994,1996,1998,2000,2002,2004,2006,2008,2010,2012,2014,2016,2018,2020,2022,2024,2026,2028,2030,2032,2034,2036,2038,2040,2042,2044,2046,2048,2050,2052,2054,2056,2058,2060,2062,2064,2066,2068,2070,2072,2074,2076,2078,2080,2082,2084,2086,2088,2090,2092,2094,2096,2098,2100,2102,2104,2106,2108,2110,2112,2114,2116,2118,2120,2122,2124,2126,2128,2130,2132,2134,2136,2138,2140,2142,2144,2146,2148,2150,2152,2154,2156,2158,2160,2162,2164,2166,2168,2170,2172,2174,2176,2178,2180,2182,2184,2186,2188,2190,2192,2194,2196,2198,2200,2202,2204,2206,2208,2210,2212,2214,2216,2218,2220,2222,2224,2226,2228,2230,2232,2234,2236,2238,2240,2242,2244,2246,2248,2250,2252,2254,2256,2258,2260,2262,2264,2266,2268,2270,2272,2274,2276,2278,2280,2282,2284,2286,2288,2290,2292,2294,2296,2298,2300,2302,2304,2306,2308,2310,2312,2314,2316,2318,2320,2322,2324,2326,2328,2330,2332,2334,2336,2338,2340,2342,2344,2346,2348,2350,2352,2354,2356,2358,2360,2362,2364,2366,2368,2370,2372,2374,2376,2378,2380,2382,2384,2386,2388,2390,2392,2394,2396,2398,2400,2402,2404,2406,2408,2410,2412,2414,2416,2418,2420,2422,2424,2426,2428,2430,2432,2434,2436,2438,2440,2442,2444,2446,2448,2450,2452,2454,2456,2458,2460,2462,2464,2466,2468,2470,2472,2474,2476,2478,2480,2482,2484,2486,2488,2490,2492,2494,2496,2498,2500,2502,2504,2506,2508,2510,2512,2514,2516,2518,2520,2522,2524,2526,2528,2530,2532,2534,2536,2538,2540,2542,2544,2546,2548,2550,2552,2554,2556,2558,2560,2562,2564,2566,2568,2570,2572,2574,2576,2578,2580,2582,2584,2586,2588,2590,2592,2594,2596,2598,2600,2602,2604,2606,2608,2610,2612,2614,2616,2618,2620,2622,2624,2626,2628,2630,2632,2634,2636,2638,2640,2642,2644,2646,2648,2650,2652,2654,2656,2658,2660,2662,2664,2666,2668,2670,2672,2674,2676,2678,2680,2682,2684,2686,2688,2690,2692,2694,2696,2698,2700,2702,2704,2706,2708,2710,2712,2714,2716,2718,2720,2722,2724,2726,2728,2730,2732,2734,2736,2738,2740,2742,2744,2746,2748,2750,2752,2754,2756,2758,2760,2762,2764,2766,2768,2770,2772,2774,2776,2778,2780,2782,2784,2786,2788,2790,2792,2794,2796,2798,2800,2802,2804,2806,2808,2810,2812,2814,2816,2818,2820,2822,2824,2826,2828,2830,2832,2834,2836,2838,2840,2842,2844,2846,2848,2850,2852,2854,2856,2858,2860,2862,2864,2866,2868,2870,2872,2874,2876,2878,2880,2882,2884,2886,2888,2890,2892,2894,2896,2898,2900,2902,2904,2906,2908,2910,2912,2914,2916,2918,2920,2922,2924,2926,2928,2930,2932,2934,2936,2938,2940,2942,2944,2946,2948,2950,2952,2954,2956,2958,2960,2962,2964,2966,2968,2970,2972,2974,2976,2978,2980,2982,2984,2986,2988,2990,2992,2994,2996,2998,3000,3002,3004,3006,3008,3010,3012,3014,3016,3018,3020,3022,3024,3026,3028,3030,3032,3034,3036,3038,3040,3042,3044,3046,3048,3050,3052,3054,3056,3058,3060,3062,3064,3066,3068,3070,3072,3074,3076,3078,3080,3082,3084,3086,3088,3090,3092,3094,3096,3098,3100,3102,3104,3106,3108,3110,3112,3114,3116,3118,3120,3122,3124,3126,3128,3130,3132,3134,3136,3138,3140,3142,3144,3146,3148,3150,3152,3154,3156,3158,3160,3162,3164,3166,3168,3170,3172,3174,3176,3178,3180,3182,3184,3186,3188,3190,3192,3194,3196,3198,3200,3202,3204,3206,3208,3210,3212,3214,3216,3218,3220,3222,3224,3226,3228,3230,3232,3234,3236,3238,3240,3242,3244,3246,3248,3250,3252,3254,3256,3258,3260,3262,3264,3266,3268,3270,3272,3274,3276,3278,3280,3282,3284,3286,3288,3290,3292,3294,3296,3298,3300,3302,3304,3306,3308,3310,3312,3314,3316,3318,3320,3322,3324,3326,3328,3330,3332,3334,3336,3338,3340,3342,3344,3346,3348,3350,3352,3354,3356,3358,3360,3362,3364,3366,3368,3370,3372,3374,3376,3378,3380,3382,3384,3386,3388,3390,3392,3394,3396,3398,3400,3402,3404,3406,3408,3410,3412,3414,3416,3418,3420,3422,3424,3426,3428,3430,3432,3434,3436,3438,3440,3442,3444,3446,3448,3450,3452,3454,3456,3458,3460,3462,3464,3466,3468,3470,3472,3474,3476,3478,3480,3482,3484,3486,3488,3490,3492,3494,3496,3498,3500,3502,3504,3506,3508,3510,3512,3514,3516,3518,3520,3522,3524,3526,3528,3530,3532,3534,3536,3538,3540,3542,3544,3546,3548,3550,3552,3554,3556,3558,3560,3562,3564,3566,3568,3570,3572,3574,3576,3578,3580,3582,3584,3586,3588,3590,3592,3594,3596,3598,3600,3602,3604,3606,3608,3610,3612,3614,3616,3618,3620,3622,3624,3626,3628,3630,3632,3634,3636,3638,3640,3642,3644,3646,3648,3650,3652,3654,3656,3658,3660,3662,3664,3666,3668,3670,3672,3674,3676,3678,3680,3682,3684,3686,3688,3690,3692,3694,3696,3698,3700,3702,3704,3706,3708,3710,3712,3714,3716,3718,3720,3722,3724,3726,3728,3730,3732,3734,3736,3738,3740,3742,3744,3746,3748,3750,3752,3754,3756,3758,3760,3762,3764,3766,3768,3770,3772,3774,3776,3778,3780,3782,3784,3786,3788,3790,3792,3794,3796,3798,3800,3802,3804,3806,3808,3810,3812,3814,3816,3818,3820,3822,3824,3826,3828,3830,3832,3834,3836,3838,3840,3842,3844,3846,3848,3850,3852,3854,3856,3858,3860,3862,3864,3866,3868,3870,3872,3874,3876,3878,3880,3882,3884,3886,3888,3890,3892,3894,3896,3898,3900,3902,3904,3906,3908,3910,3912,3914,3916,3918,3920,3922,3924,3926,3928,3930,3932,3934,3936,3938,3940,3942,3944,3946,3948,3950,3952,3954,3956,3958,3960,3962,3964,3966,3968,3970,3972,3974,3976,3978,3980,3982,3984,3986,3988,3990,3992,3994,3996,3998,4000,4002,4004,4006,4008,4010,4012,4014,4016,4018,4020,4022,4024,4026,4028,4030,4032,4034,4036,4038,4040,4042,4044,4046,4048,4050,4052,4054,4056,4058,4060,4062,4064,4066,4068,4070,4072,4074,4076,4078,4080,4082,4084,4086,4088,4090,4092,4094,4096,4098,4100,4102,4104,4106,4108,4110,4112,4114,4116,4118,4120,4122,4124,4126,4128,4130,4132,4134,4136,4138,4140,4142,4144,4146,4148,4150,4152,4154,4156,4158,4160,4162,4164,4166,4168,4170,4172,4174,4176,4178,4180,4182,4184,4186,4188,4190,4192,4194,4196,4198,4200,4202,4204,4206,4208,4210,4212,4214,4216,4218,4220,4222,4224,4226,4228,4230,4232,4234,4236,4238,4240,4242,4244,4246,4248,4250,4252,4254,4256,4258,4260,4262,4264,4266,4268,4270,4272,4274,4276,4278,4280,4282,4284,4286,4288,4290,4292,4294,4296,4298,4300,4302,4304,4306,4308,4310,4312,4314,4316,4318,4320,4322,4324,4326,4328,4330,4332,4334,4336,4338,4340,4342,4344,4346,4348,4350,4352,4354,4356,4358,4360,4362,4364,4366,4368,4370,4372,4374,4376,4378,4380,4382,4384,4386,4388,4390,4392,4394,4396,4398,4400,4402,4404,4406,4408,4410,4412,4414,4416,4418,4420,4422,4424,4426,4428,4430,4432,4434,4436,4438,4440,4442,4444,4446,4448,4450,4452,4454,4456,4458,4460,4462,4464,4466,4468,4470,4472,4474,4476,4478,4480,4482,4484,4486,4488,4490,4492,4494,4496,4498,4500,4502,4504,4506,4508,4510,4512,4514,4516,4518],{"categories":116},[117],"Business & SaaS",{"categories":119},[117],{"categories":121},[122],"AI News & Trends",{"categories":124},[],{"categories":126},[127],"AI Automation",{"categories":129},[130],"Marketing & Growth",{"categories":132},[133],"Design & Frontend",{"categories":135},[136],"Software Engineering",{"categories":138},[127],{"categories":140},[],{"categories":142},[133],{"categories":144},[133],{"categories":146},[127],{"categories":148},[133],{"categories":150},[133],{"categories":152},[153],"AI & LLMs",{"categories":155},[133],{"categories":157},[133],{"categories":159},[],{"categories":161},[133],{"categories":163},[133],{"categories":165},[153],{"categories":167},[168],"Developer Productivity",{"categories":170},[153],{"categories":172},[153],{"categories":174},[153],{"categories":176},[122],{"categories":178},[153],{"categories":180},[127],{"categories":182},[117],{"categories":184},[122],{"categories":186},[130],{"categories":188},[],{"categories":190},[],{"categories":192},[127],{"categories":194},[127],{"categories":196},[127],{"categories":198},[130],{"categories":200},[153],{"categories":202},[168],{"categories":204},[122],{"categories":206},[],{"categories":208},[],{"categories":210},[],{"categories":212},[213],"Data Science & Visualization",{"categories":215},[],{"categories":217},[127],{"categories":219},[136],{"categories":221},[127],{"categories":223},[127],{"categories":225},[153],{"categories":227},[130],{"categories":229},[127],{"categories":231},[],{"categories":233},[],{"categories":235},[],{"categories":237},[133],{"categories":239},[133],{"categories":241},[127],{"categories":243},[130],{"categories":245},[168],{"categories":247},[133],{"categories":249},[153],{"categories":251},[136],{"categories":253},[153],{"categories":255},[],{"categories":257},[127],{"categories":259},[153],{"categories":261},[168],{"categories":263},[168],{"categories":265},[],{"categories":267},[130],{"categories":269},[117],{"categories":271},[153],{"categories":273},[117],{"categories":275},[117],{"categories":277},[127],{"categories":279},[130],{"categories":281},[127],{"categories":283},[117],{"categories":285},[127],{"categories":287},[133],{"categories":289},[153],{"categories":291},[133],{"categories":293},[153],{"categories":295},[117],{"categories":297},[153],{"categories":299},[130],{"categories":301},[],{"categories":303},[153],{"categories":305},[117],{"categories":307},[],{"categories":309},[122],{"categories":311},[136],{"categories":313},[],{"categories":315},[153],{"categories":317},[133],{"categories":319},[153],{"categories":321},[133],{"categories":323},[],{"categories":325},[127],{"categories":327},[],{"categories":329},[],{"categories":331},[],{"categories":333},[153],{"categories":335},[],{"categories":337},[153],{"categories":339},[153],{"categories":341},[133],{"categories":343},[153],{"categories":345},[168],{"categories":347},[127],{"categories":349},[130],{"categories":351},[168],{"categories":353},[168],{"categories":355},[168],{"categories":357},[130],{"categories":359},[130],{"categories":361},[153],{"categories":363},[153],{"categories":365},[133],{"categories":367},[117],{"categories":369},[133],{"categories":371},[136],{"categories":373},[117],{"categories":375},[117],{"categories":377},[117],{"categories":379},[133],{"categories":381},[],{"categories":383},[],{"categories":385},[153],{"categories":387},[153],{"categories":389},[136],{"categories":391},[153],{"categories":393},[153],{"categories":395},[],{"categories":397},[153],{"categories":399},[153],{"categories":401},[],{"categories":403},[153],{"categories":405},[122],{"categories":407},[122],{"categories":409},[],{"categories":411},[],{"categories":413},[130],{"categories":415},[130],{"categories":417},[136],{"categories":419},[153],{"categories":421},[],{"categories":423},[],{"categories":425},[127],{"categories":427},[153],{"categories":429},[153],{"categories":431},[],{"categories":433},[153,117],{"categories":435},[153],{"categories":437},[],{"categories":439},[153],{"categories":441},[153],{"categories":443},[],{"categories":445},[],{"categories":447},[127],{"categories":449},[153],{"categories":451},[153],{"categories":453},[127],{"categories":455},[153],{"categories":457},[],{"categories":459},[],{"categories":461},[153],{"categories":463},[],{"categories":465},[153],{"categories":467},[153],{"categories":469},[],{"categories":471},[127],{"categories":473},[133],{"categories":475},[],{"categories":477},[127,478],"DevOps & Cloud",{"categories":480},[153],{"categories":482},[127],{"categories":484},[153],{"categories":486},[],{"categories":488},[],{"categories":490},[],{"categories":492},[],{"categories":494},[153],{"categories":496},[127],{"categories":498},[],{"categories":500},[127],{"categories":502},[],{"categories":504},[153],{"categories":506},[],{"categories":508},[],{"categories":510},[],{"categories":512},[],{"categories":514},[127],{"categories":516},[133],{"categories":518},[153],{"categories":520},[130],{"categories":522},[122],{"categories":524},[117],{"categories":526},[168],{"categories":528},[],{"categories":530},[127],{"categories":532},[127],{"categories":534},[153],{"categories":536},[],{"categories":538},[],{"categories":540},[],{"categories":542},[127],{"categories":544},[],{"categories":546},[127],{"categories":548},[127],{"categories":550},[122],{"categories":552},[127],{"categories":554},[153],{"categories":556},[],{"categories":558},[153],{"categories":560},[],{"categories":562},[122],{"categories":564},[127,565],"Product Strategy",{"categories":567},[136],{"categories":569},[478],{"categories":571},[565],{"categories":573},[153],{"categories":575},[127],{"categories":577},[],{"categories":579},[122],{"categories":581},[122],{"categories":583},[127],{"categories":585},[],{"categories":587},[127],{"categories":589},[153],{"categories":591},[153],{"categories":593},[168],{"categories":595},[153],{"categories":597},[],{"categories":599},[153,136],{"categories":601},[122],{"categories":603},[153],{"categories":605},[122],{"categories":607},[127],{"categories":609},[122],{"categories":611},[],{"categories":613},[136],{"categories":615},[117],{"categories":617},[],{"categories":619},[127],{"categories":621},[127],{"categories":623},[127],{"categories":625},[127],{"categories":627},[117],{"categories":629},[133],{"categories":631},[130],{"categories":633},[],{"categories":635},[127],{"categories":637},[],{"categories":639},[122],{"categories":641},[122],{"categories":643},[122],{"categories":645},[127],{"categories":647},[122],{"categories":649},[153],{"categories":651},[168],{"categories":653},[153],{"categories":655},[136],{"categories":657},[153,168],{"categories":659},[168],{"categories":661},[168],{"categories":663},[168],{"categories":665},[168],{"categories":667},[153],{"categories":669},[],{"categories":671},[],{"categories":673},[130],{"categories":675},[],{"categories":677},[153],{"categories":679},[168],{"categories":681},[153],{"categories":683},[133],{"categories":685},[136],{"categories":687},[],{"categories":689},[153],{"categories":691},[168],{"categories":693},[130],{"categories":695},[122],{"categories":697},[136],{"categories":699},[153],{"categories":701},[],{"categories":703},[136],{"categories":705},[133],{"categories":707},[117],{"categories":709},[117],{"categories":711},[],{"categories":713},[133],{"categories":715},[117],{"categories":717},[122],{"categories":719},[168],{"categories":721},[127],{"categories":723},[127],{"categories":725},[153],{"categories":727},[153],{"categories":729},[122],{"categories":731},[122],{"categories":733},[168],{"categories":735},[122],{"categories":737},[],{"categories":739},[565],{"categories":741},[127],{"categories":743},[122],{"categories":745},[122],{"categories":747},[122],{"categories":749},[153],{"categories":751},[127],{"categories":753},[127],{"categories":755},[117],{"categories":757},[117],{"categories":759},[153],{"categories":761},[122],{"categories":763},[],{"categories":765},[153],{"categories":767},[117],{"categories":769},[127],{"categories":771},[127],{"categories":773},[127],{"categories":775},[133],{"categories":777},[127],{"categories":779},[168],{"categories":781},[122],{"categories":783},[122],{"categories":785},[122],{"categories":787},[122],{"categories":789},[122],{"categories":791},[],{"categories":793},[],{"categories":795},[168],{"categories":797},[122],{"categories":799},[122],{"categories":801},[122],{"categories":803},[],{"categories":805},[153],{"categories":807},[],{"categories":809},[],{"categories":811},[133],{"categories":813},[117],{"categories":815},[],{"categories":817},[122],{"categories":819},[127],{"categories":821},[127],{"categories":823},[127],{"categories":825},[130],{"categories":827},[127],{"categories":829},[],{"categories":831},[122],{"categories":833},[122],{"categories":835},[153],{"categories":837},[],{"categories":839},[130],{"categories":841},[130],{"categories":843},[153],{"categories":845},[122],{"categories":847},[117],{"categories":849},[136],{"categories":851},[153],{"categories":853},[],{"categories":855},[153],{"categories":857},[153],{"categories":859},[136],{"categories":861},[153],{"categories":863},[153],{"categories":865},[153],{"categories":867},[130],{"categories":869},[122],{"categories":871},[153],{"categories":873},[153],{"categories":875},[122],{"categories":877},[127],{"categories":879},[168],{"categories":881},[117],{"categories":883},[153],{"categories":885},[168],{"categories":887},[168],{"categories":889},[],{"categories":891},[130],{"categories":893},[122],{"categories":895},[122],{"categories":897},[168],{"categories":899},[127],{"categories":901},[127],{"categories":903},[127],{"categories":905},[127],{"categories":907},[133],{"categories":909},[153],{"categories":911},[153],{"categories":913},[565],{"categories":915},[153],{"categories":917},[153],{"categories":919},[127],{"categories":921},[117],{"categories":923},[130],{"categories":925},[],{"categories":927},[117],{"categories":929},[117],{"categories":931},[],{"categories":933},[133],{"categories":935},[153],{"categories":937},[],{"categories":939},[],{"categories":941},[122],{"categories":943},[122],{"categories":945},[122],{"categories":947},[122],{"categories":949},[],{"categories":951},[122],{"categories":953},[153],{"categories":955},[153],{"categories":957},[],{"categories":959},[122],{"categories":961},[122],{"categories":963},[117],{"categories":965},[153],{"categories":967},[],{"categories":969},[],{"categories":971},[122],{"categories":973},[122],{"categories":975},[122],{"categories":977},[153],{"categories":979},[122],{"categories":981},[122],{"categories":983},[122],{"categories":985},[122],{"categories":987},[122],{"categories":989},[],{"categories":991},[127],{"categories":993},[153],{"categories":995},[130],{"categories":997},[117],{"categories":999},[127],{"categories":1001},[153],{"categories":1003},[],{"categories":1005},[130],{"categories":1007},[122],{"categories":1009},[122],{"categories":1011},[122],{"categories":1013},[122],{"categories":1015},[168],{"categories":1017},[136],{"categories":1019},[],{"categories":1021},[153],{"categories":1023},[127],{"categories":1025},[127],{"categories":1027},[127],{"categories":1029},[478],{"categories":1031},[127],{"categories":1033},[153],{"categories":1035},[153],{"categories":1037},[136],{"categories":1039},[478],{"categories":1041},[213],{"categories":1043},[153],{"categories":1045},[213],{"categories":1047},[],{"categories":1049},[130],{"categories":1051},[130],{"categories":1053},[133],{"categories":1055},[478],{"categories":1057},[127],{"categories":1059},[153],{"categories":1061},[153],{"categories":1063},[127],{"categories":1065},[127],{"categories":1067},[127],{"categories":1069},[168],{"categories":1071},[168],{"categories":1073},[127],{"categories":1075},[127],{"categories":1077},[],{"categories":1079},[127],{"categories":1081},[127],{"categories":1083},[153],{"categories":1085},[213],{"categories":1087},[127],{"categories":1089},[127],{"categories":1091},[127],{"categories":1093},[127],{"categories":1095},[117],{"categories":1097},[133],{"categories":1099},[122],{"categories":1101},[136],{"categories":1103},[478],{"categories":1105},[136],{"categories":1107},[213],{"categories":1109},[],{"categories":1111},[136],{"categories":1113},[],{"categories":1115},[],{"categories":1117},[136],{"categories":1119},[153],{"categories":1121},[],{"categories":1123},[],{"categories":1125},[],{"categories":1127},[117],{"categories":1129},[],{"categories":1131},[],{"categories":1133},[213],{"categories":1135},[153],{"categories":1137},[478],{"categories":1139},[153],{"categories":1141},[],{"categories":1143},[127],{"categories":1145},[168],{"categories":1147},[168],{"categories":1149},[130],{"categories":1151},[130],{"categories":1153},[130],{"categories":1155},[478],{"categories":1157},[136],{"categories":1159},[127],{"categories":1161},[117],{"categories":1163},[117],{"categories":1165},[136],{"categories":1167},[133],{"categories":1169},[213],{"categories":1171},[133],{"categories":1173},[],{"categories":1175},[153],{"categories":1177},[127],{"categories":1179},[127],{"categories":1181},[168],{"categories":1183},[127],{"categories":1185},[127],{"categories":1187},[133],{"categories":1189},[133],{"categories":1191},[127],{"categories":1193},[478],{"categories":1195},[153],{"categories":1197},[],{"categories":1199},[130],{"categories":1201},[127],{"categories":1203},[117],{"categories":1205},[127],{"categories":1207},[127],{"categories":1209},[],{"categories":1211},[153],{"categories":1213},[127],{"categories":1215},[127],{"categories":1217},[168],{"categories":1219},[127],{"categories":1221},[153],{"categories":1223},[],{"categories":1225},[127],{"categories":1227},[],{"categories":1229},[133],{"categories":1231},[168],{"categories":1233},[153],{"categories":1235},[136],{"categories":1237},[133],{"categories":1239},[168],{"categories":1241},[213],{"categories":1243},[168],{"categories":1245},[],{"categories":1247},[153],{"categories":1249},[153],{"categories":1251},[565],{"categories":1253},[136],{"categories":1255},[153,127],{"categories":1257},[127],{"categories":1259},[153],{"categories":1261},[127],{"categories":1263},[127,136],{"categories":1265},[127],{"categories":1267},[153],{"categories":1269},[],{"categories":1271},[168],{"categories":1273},[153],{"categories":1275},[127],{"categories":1277},[153],{"categories":1279},[],{"categories":1281},[136],{"categories":1283},[117],{"categories":1285},[127],{"categories":1287},[],{"categories":1289},[213],{"categories":1291},[136],{"categories":1293},[127],{"categories":1295},[136],{"categories":1297},[],{"categories":1299},[127],{"categories":1301},[],{"categories":1303},[127],{"categories":1305},[],{"categories":1307},[],{"categories":1309},[133],{"categories":1311},[168],{"categories":1313},[153],{"categories":1315},[127],{"categories":1317},[],{"categories":1319},[127],{"categories":1321},[136],{"categories":1323},[153],{"categories":1325},[153],{"categories":1327},[136],{"categories":1329},[136],{"categories":1331},[168],{"categories":1333},[117],{"categories":1335},[],{"categories":1337},[153],{"categories":1339},[153],{"categories":1341},[153],{"categories":1343},[127],{"categories":1345},[153],{"categories":1347},[],{"categories":1349},[133],{"categories":1351},[153],{"categories":1353},[127],{"categories":1355},[],{"categories":1357},[153],{"categories":1359},[],{"categories":1361},[153],{"categories":1363},[],{"categories":1365},[],{"categories":1367},[],{"categories":1369},[153],{"categories":1371},[153],{"categories":1373},[153],{"categories":1375},[153],{"categories":1377},[],{"categories":1379},[153],{"categories":1381},[153],{"categories":1383},[153],{"categories":1385},[],{"categories":1387},[153],{"categories":1389},[],{"categories":1391},[130],{"categories":1393},[153],{"categories":1395},[],{"categories":1397},[],{"categories":1399},[],{"categories":1401},[153],{"categories":1403},[122],{"categories":1405},[122],{"categories":1407},[],{"categories":1409},[127],{"categories":1411},[153],{"categories":1413},[],{"categories":1415},[153],{"categories":1417},[153],{"categories":1419},[122],{"categories":1421},[],{"categories":1423},[153],{"categories":1425},[122],{"categories":1427},[127],{"categories":1429},[153],{"categories":1431},[],{"categories":1433},[],{"categories":1435},[],{"categories":1437},[127],{"categories":1439},[127],{"categories":1441},[127],{"categories":1443},[127],{"categories":1445},[153],{"categories":1447},[133],{"categories":1449},[133],{"categories":1451},[127],{"categories":1453},[127],{"categories":1455},[168],{"categories":1457},[565],{"categories":1459},[168],{"categories":1461},[168],{"categories":1463},[153],{"categories":1465},[127],{"categories":1467},[153],{"categories":1469},[168],{"categories":1471},[153],{"categories":1473},[127],{"categories":1475},[127],{"categories":1477},[127],{"categories":1479},[127],{"categories":1481},[127],{"categories":1483},[153],{"categories":1485},[168],{"categories":1487},[168],{"categories":1489},[130],{"categories":1491},[127],{"categories":1493},[],{"categories":1495},[127],{"categories":1497},[],{"categories":1499},[122],{"categories":1501},[153],{"categories":1503},[],{"categories":1505},[117],{"categories":1507},[133],{"categories":1509},[133],{"categories":1511},[127],{"categories":1513},[127],{"categories":1515},[153],{"categories":1517},[153],{"categories":1519},[122],{"categories":1521},[122],{"categories":1523},[478],{"categories":1525},[127],{"categories":1527},[122],{"categories":1529},[],{"categories":1531},[153],{"categories":1533},[127],{"categories":1535},[127],{"categories":1537},[127],{"categories":1539},[127],{"categories":1541},[153],{"categories":1543},[153],{"categories":1545},[153],{"categories":1547},[153],{"categories":1549},[127],{"categories":1551},[127],{"categories":1553},[127],{"categories":1555},[127],{"categories":1557},[],{"categories":1559},[133],{"categories":1561},[153],{"categories":1563},[153],{"categories":1565},[153],{"categories":1567},[],{"categories":1569},[130],{"categories":1571},[],{"categories":1573},[168],{"categories":1575},[],{"categories":1577},[127],{"categories":1579},[168],{"categories":1581},[133],{"categories":1583},[168],{"categories":1585},[],{"categories":1587},[168],{"categories":1589},[168],{"categories":1591},[],{"categories":1593},[133],{"categories":1595},[127],{"categories":1597},[127],{"categories":1599},[168],{"categories":1601},[153],{"categories":1603},[153],{"categories":1605},[],{"categories":1607},[122],{"categories":1609},[],{"categories":1611},[130],{"categories":1613},[],{"categories":1615},[133],{"categories":1617},[122],{"categories":1619},[133],{"categories":1621},[133],{"categories":1623},[133],{"categories":1625},[133],{"categories":1627},[133],{"categories":1629},[133],{"categories":1631},[133],{"categories":1633},[133],{"categories":1635},[133],{"categories":1637},[133],{"categories":1639},[],{"categories":1641},[127],{"categories":1643},[133],{"categories":1645},[153],{"categories":1647},[153],{"categories":1649},[133],{"categories":1651},[133],{"categories":1653},[133],{"categories":1655},[133],{"categories":1657},[133],{"categories":1659},[133],{"categories":1661},[133],{"categories":1663},[153,133],{"categories":1665},[133],{"categories":1667},[133],{"categories":1669},[133],{"categories":1671},[133],{"categories":1673},[],{"categories":1675},[133],{"categories":1677},[133],{"categories":1679},[133],{"categories":1681},[133],{"categories":1683},[133],{"categories":1685},[133],{"categories":1687},[133],{"categories":1689},[133],{"categories":1691},[133],{"categories":1693},[133,153],{"categories":1695},[133],{"categories":1697},[133],{"categories":1699},[],{"categories":1701},[122],{"categories":1703},[],{"categories":1705},[153],{"categories":1707},[],{"categories":1709},[127],{"categories":1711},[478],{"categories":1713},[565],{"categories":1715},[127],{"categories":1717},[127],{"categories":1719},[],{"categories":1721},[127],{"categories":1723},[],{"categories":1725},[127],{"categories":1727},[],{"categories":1729},[],{"categories":1731},[153],{"categories":1733},[153],{"categories":1735},[153],{"categories":1737},[122],{"categories":1739},[122],{"categories":1741},[122],{"categories":1743},[122],{"categories":1745},[],{"categories":1747},[122],{"categories":1749},[],{"categories":1751},[122],{"categories":1753},[153],{"categories":1755},[122],{"categories":1757},[122],{"categories":1759},[122],{"categories":1761},[122],{"categories":1763},[153],{"categories":1765},[122],{"categories":1767},[127],{"categories":1769},[],{"categories":1771},[127],{"categories":1773},[122],{"categories":1775},[153],{"categories":1777},[122],{"categories":1779},[122],{"categories":1781},[122],{"categories":1783},[153],{"categories":1785},[153],{"categories":1787},[153],{"categories":1789},[],{"categories":1791},[],{"categories":1793},[153],{"categories":1795},[122],{"categories":1797},[],{"categories":1799},[153],{"categories":1801},[127],{"categories":1803},[153],{"categories":1805},[127],{"categories":1807},[127],{"categories":1809},[153],{"categories":1811},[],{"categories":1813},[],{"categories":1815},[127],{"categories":1817},[127],{"categories":1819},[127],{"categories":1821},[127],{"categories":1823},[127],{"categories":1825},[127],{"categories":1827},[127],{"categories":1829},[127],{"categories":1831},[],{"categories":1833},[127],{"categories":1835},[127],{"categories":1837},[127],{"categories":1839},[153],{"categories":1841},[153],{"categories":1843},[153],{"categories":1845},[122],{"categories":1847},[153],{"categories":1849},[153],{"categories":1851},[153],{"categories":1853},[127],{"categories":1855},[130],{"categories":1857},[130],{"categories":1859},[130],{"categories":1861},[127],{"categories":1863},[],{"categories":1865},[153],{"categories":1867},[],{"categories":1869},[],{"categories":1871},[153],{"categories":1873},[],{"categories":1875},[127],{"categories":1877},[133],{"categories":1879},[168],{"categories":1881},[213],{"categories":1883},[153],{"categories":1885},[127],{"categories":1887},[133],{"categories":1889},[],{"categories":1891},[127],{"categories":1893},[130,117],{"categories":1895},[127],{"categories":1897},[127],{"categories":1899},[478],{"categories":1901},[136],{"categories":1903},[130],{"categories":1905},[168],{"categories":1907},[153],{"categories":1909},[],{"categories":1911},[153],{"categories":1913},[],{"categories":1915},[153],{"categories":1917},[153],{"categories":1919},[127],{"categories":1921},[],{"categories":1923},[153],{"categories":1925},[127],{"categories":1927},[153],{"categories":1929},[168],{"categories":1931},[127],{"categories":1933},[153],{"categories":1935},[153,168],{"categories":1937},[168],{"categories":1939},[],{"categories":1941},[153],{"categories":1943},[153],{"categories":1945},[153],{"categories":1947},[],{"categories":1949},[],{"categories":1951},[127],{"categories":1953},[130],{"categories":1955},[122],{"categories":1957},[127],{"categories":1959},[153],{"categories":1961},[122],{"categories":1963},[],{"categories":1965},[168],{"categories":1967},[122],{"categories":1969},[],{"categories":1971},[213],{"categories":1973},[130],{"categories":1975},[117],{"categories":1977},[122],{"categories":1979},[153],{"categories":1981},[127],{"categories":1983},[153],{"categories":1985},[127],{"categories":1987},[127],{"categories":1989},[122],{"categories":1991},[168],{"categories":1993},[133],{"categories":1995},[117],{"categories":1997},[153],{"categories":1999},[153],{"categories":2001},[],{"categories":2003},[],{"categories":2005},[153],{"categories":2007},[],{"categories":2009},[153],{"categories":2011},[122],{"categories":2013},[],{"categories":2015},[127],{"categories":2017},[168],{"categories":2019},[122],{"categories":2021},[168],{"categories":2023},[127],{"categories":2025},[153],{"categories":2027},[],{"categories":2029},[127],{"categories":2031},[127],{"categories":2033},[133],{"categories":2035},[127],{"categories":2037},[133],{"categories":2039},[127],{"categories":2041},[127],{"categories":2043},[133],{"categories":2045},[],{"categories":2047},[],{"categories":2049},[133],{"categories":2051},[133],{"categories":2053},[133],{"categories":2055},[136],{"categories":2057},[168],{"categories":2059},[168],{"categories":2061},[127],{"categories":2063},[122],{"categories":2065},[168],{"categories":2067},[168],{"categories":2069},[130],{"categories":2071},[133],{"categories":2073},[127],{"categories":2075},[127],{"categories":2077},[153],{"categories":2079},[168],{"categories":2081},[153],{"categories":2083},[],{"categories":2085},[478],{"categories":2087},[565],{"categories":2089},[],{"categories":2091},[],{"categories":2093},[127],{"categories":2095},[122],{"categories":2097},[130],{"categories":2099},[130],{"categories":2101},[213],{"categories":2103},[133],{"categories":2105},[213],{"categories":2107},[213],{"categories":2109},[127],{"categories":2111},[],{"categories":2113},[],{"categories":2115},[213],{"categories":2117},[136],{"categories":2119},[153],{"categories":2121},[136],{"categories":2123},[213],{"categories":2125},[136],{"categories":2127},[213],{"categories":2129},[117],{"categories":2131},[136],{"categories":2133},[168],{"categories":2135},[153],{"categories":2137},[],{"categories":2139},[213],{"categories":2141},[478],{"categories":2143},[],{"categories":2145},[153],{"categories":2147},[153],{"categories":2149},[],{"categories":2151},[],{"categories":2153},[153],{"categories":2155},[153],{"categories":2157},[122],{"categories":2159},[153],{"categories":2161},[],{"categories":2163},[122],{"categories":2165},[],{"categories":2167},[],{"categories":2169},[122],{"categories":2171},[122],{"categories":2173},[153],{"categories":2175},[153],{"categories":2177},[153],{"categories":2179},[153],{"categories":2181},[153],{"categories":2183},[153],{"categories":2185},[130],{"categories":2187},[],{"categories":2189},[153],{"categories":2191},[],{"categories":2193},[],{"categories":2195},[127],{"categories":2197},[168],{"categories":2199},[],{"categories":2201},[478],{"categories":2203},[153,478],{"categories":2205},[153],{"categories":2207},[],{"categories":2209},[133],{"categories":2211},[133],{"categories":2213},[133],{"categories":2215},[133],{"categories":2217},[133],{"categories":2219},[],{"categories":2221},[],{"categories":2223},[],{"categories":2225},[136],{"categories":2227},[127],{"categories":2229},[117],{"categories":2231},[136],{"categories":2233},[168],{"categories":2235},[133],{"categories":2237},[],{"categories":2239},[130],{"categories":2241},[565],{"categories":2243},[213],{"categories":2245},[213],{"categories":2247},[213],{"categories":2249},[168],{"categories":2251},[565],{"categories":2253},[168],{"categories":2255},[],{"categories":2257},[117],{"categories":2259},[136],{"categories":2261},[153],{"categories":2263},[133],{"categories":2265},[130],{"categories":2267},[136],{"categories":2269},[130],{"categories":2271},[153],{"categories":2273},[133],{"categories":2275},[136],{"categories":2277},[478],{"categories":2279},[153],{"categories":2281},[122],{"categories":2283},[136],{"categories":2285},[],{"categories":2287},[153],{"categories":2289},[136],{"categories":2291},[136],{"categories":2293},[127],{"categories":2295},[],{"categories":2297},[130],{"categories":2299},[130],{"categories":2301},[130],{"categories":2303},[127],{"categories":2305},[153],{"categories":2307},[],{"categories":2309},[117],{"categories":2311},[168],{"categories":2313},[168],{"categories":2315},[213],{"categories":2317},[117],{"categories":2319},[122],{"categories":2321},[213],{"categories":2323},[],{"categories":2325},[122],{"categories":2327},[122],{"categories":2329},[122],{"categories":2331},[153],{"categories":2333},[117],{"categories":2335},[153],{"categories":2337},[],{"categories":2339},[],{"categories":2341},[],{"categories":2343},[136],{"categories":2345},[127],{"categories":2347},[],{"categories":2349},[168],{"categories":2351},[133],{"categories":2353},[],{"categories":2355},[130],{"categories":2357},[],{"categories":2359},[133],{"categories":2361},[153],{"categories":2363},[168],{"categories":2365},[117],{"categories":2367},[],{"categories":2369},[133],{"categories":2371},[133],{"categories":2373},[153],{"categories":2375},[],{"categories":2377},[],{"categories":2379},[136],{"categories":2381},[153],{"categories":2383},[],{"categories":2385},[127],{"categories":2387},[153],{"categories":2389},[],{"categories":2391},[136],{"categories":2393},[127],{"categories":2395},[153],{"categories":2397},[213],{"categories":2399},[153],{"categories":2401},[],{"categories":2403},[213],{"categories":2405},[153],{"categories":2407},[136],{"categories":2409},[153],{"categories":2411},[213],{"categories":2413},[127],{"categories":2415},[153],{"categories":2417},[153],{"categories":2419},[153,127],{"categories":2421},[127],{"categories":2423},[127],{"categories":2425},[127],{"categories":2427},[133],{"categories":2429},[168],{"categories":2431},[153],{"categories":2433},[168],{"categories":2435},[133],{"categories":2437},[153],{"categories":2439},[],{"categories":2441},[],{"categories":2443},[153],{"categories":2445},[153],{"categories":2447},[153],{"categories":2449},[127],{"categories":2451},[153],{"categories":2453},[],{"categories":2455},[153],{"categories":2457},[153],{"categories":2459},[127],{"categories":2461},[127],{"categories":2463},[153],{"categories":2465},[153],{"categories":2467},[],{"categories":2469},[153],{"categories":2471},[],{"categories":2473},[153],{"categories":2475},[153],{"categories":2477},[153],{"categories":2479},[153],{"categories":2481},[153],{"categories":2483},[153],{"categories":2485},[153],{"categories":2487},[],{"categories":2489},[153],{"categories":2491},[122],{"categories":2493},[122],{"categories":2495},[],{"categories":2497},[],{"categories":2499},[153],{"categories":2501},[],{"categories":2503},[153],{"categories":2505},[153,478],{"categories":2507},[],{"categories":2509},[122],{"categories":2511},[],{"categories":2513},[153],{"categories":2515},[],{"categories":2517},[],{"categories":2519},[],{"categories":2521},[153],{"categories":2523},[],{"categories":2525},[153],{"categories":2527},[],{"categories":2529},[153],{"categories":2531},[153],{"categories":2533},[],{"categories":2535},[],{"categories":2537},[153,478],{"categories":2539},[478,153],{"categories":2541},[122],{"categories":2543},[],{"categories":2545},[153],{"categories":2547},[],{"categories":2549},[153],{"categories":2551},[153],{"categories":2553},[],{"categories":2555},[122],{"categories":2557},[153,117],{"categories":2559},[122],{"categories":2561},[136],{"categories":2563},[],{"categories":2565},[127],{"categories":2567},[153],{"categories":2569},[130],{"categories":2571},[153],{"categories":2573},[168],{"categories":2575},[168],{"categories":2577},[478],{"categories":2579},[122],{"categories":2581},[153],{"categories":2583},[478],{"categories":2585},[136],{"categories":2587},[153],{"categories":2589},[168],{"categories":2591},[],{"categories":2593},[153],{"categories":2595},[],{"categories":2597},[],{"categories":2599},[153],{"categories":2601},[],{"categories":2603},[153],{"categories":2605},[136],{"categories":2607},[117],{"categories":2609},[168],{"categories":2611},[130],{"categories":2613},[127],{"categories":2615},[168],{"categories":2617},[],{"categories":2619},[130],{"categories":2621},[],{"categories":2623},[],{"categories":2625},[153],{"categories":2627},[122],{"categories":2629},[130],{"categories":2631},[],{"categories":2633},[153],{"categories":2635},[122],{"categories":2637},[122],{"categories":2639},[130],{"categories":2641},[122],{"categories":2643},[153],{"categories":2645},[122],{"categories":2647},[153],{"categories":2649},[],{"categories":2651},[153],{"categories":2653},[153],{"categories":2655},[153],{"categories":2657},[122],{"categories":2659},[],{"categories":2661},[],{"categories":2663},[133],{"categories":2665},[122],{"categories":2667},[],{"categories":2669},[153],{"categories":2671},[153],{"categories":2673},[153],{"categories":2675},[153],{"categories":2677},[153],{"categories":2679},[153],{"categories":2681},[153],{"categories":2683},[153],{"categories":2685},[153],{"categories":2687},[130],{"categories":2689},[153,133],{"categories":2691},[122],{"categories":2693},[122],{"categories":2695},[153],{"categories":2697},[136],{"categories":2699},[213],{"categories":2701},[153],{"categories":2703},[153],{"categories":2705},[],{"categories":2707},[],{"categories":2709},[153],{"categories":2711},[153],{"categories":2713},[],{"categories":2715},[133],{"categories":2717},[133],{"categories":2719},[168],{"categories":2721},[153],{"categories":2723},[168],{"categories":2725},[153],{"categories":2727},[153],{"categories":2729},[],{"categories":2731},[153],{"categories":2733},[],{"categories":2735},[],{"categories":2737},[153],{"categories":2739},[],{"categories":2741},[],{"categories":2743},[122],{"categories":2745},[],{"categories":2747},[153],{"categories":2749},[153],{"categories":2751},[153],{"categories":2753},[],{"categories":2755},[153],{"categories":2757},[122],{"categories":2759},[565],{"categories":2761},[127],{"categories":2763},[153],{"categories":2765},[],{"categories":2767},[127],{"categories":2769},[153],{"categories":2771},[],{"categories":2773},[153],{"categories":2775},[],{"categories":2777},[127],{"categories":2779},[],{"categories":2781},[],{"categories":2783},[127],{"categories":2785},[127],{"categories":2787},[127],{"categories":2789},[153],{"categories":2791},[],{"categories":2793},[127],{"categories":2795},[127],{"categories":2797},[],{"categories":2799},[],{"categories":2801},[127],{"categories":2803},[153],{"categories":2805},[122],{"categories":2807},[565],{"categories":2809},[130],{"categories":2811},[],{"categories":2813},[133],{"categories":2815},[153],{"categories":2817},[153],{"categories":2819},[117],{"categories":2821},[122],{"categories":2823},[122],{"categories":2825},[122],{"categories":2827},[122],{"categories":2829},[],{"categories":2831},[127],{"categories":2833},[127],{"categories":2835},[127],{"categories":2837},[127],{"categories":2839},[168],{"categories":2841},[153],{"categories":2843},[117],{"categories":2845},[],{"categories":2847},[168],{"categories":2849},[127],{"categories":2851},[133],{"categories":2853},[133],{"categories":2855},[133],{"categories":2857},[133],{"categories":2859},[133],{"categories":2861},[133],{"categories":2863},[153,117],{"categories":2865},[127],{"categories":2867},[117],{"categories":2869},[122],{"categories":2871},[122],{"categories":2873},[168],{"categories":2875},[],{"categories":2877},[],{"categories":2879},[130],{"categories":2881},[],{"categories":2883},[153],{"categories":2885},[130],{"categories":2887},[153],{"categories":2889},[136],{"categories":2891},[127],{"categories":2893},[117],{"categories":2895},[127],{"categories":2897},[136],{"categories":2899},[168],{"categories":2901},[127],{"categories":2903},[],{"categories":2905},[168],{"categories":2907},[],{"categories":2909},[],{"categories":2911},[127],{"categories":2913},[127],{"categories":2915},[127],{"categories":2917},[153],{"categories":2919},[153],{"categories":2921},[153],{"categories":2923},[153],{"categories":2925},[153],{"categories":2927},[],{"categories":2929},[478],{"categories":2931},[153],{"categories":2933},[],{"categories":2935},[],{"categories":2937},[],{"categories":2939},[168],{"categories":2941},[],{"categories":2943},[153],{"categories":2945},[],{"categories":2947},[122],{"categories":2949},[153],{"categories":2951},[122],{"categories":2953},[153],{"categories":2955},[127],{"categories":2957},[],{"categories":2959},[153],{"categories":2961},[153],{"categories":2963},[],{"categories":2965},[213],{"categories":2967},[213],{"categories":2969},[136],{"categories":2971},[133],{"categories":2973},[],{"categories":2975},[153],{"categories":2977},[127],{"categories":2979},[],{"categories":2981},[],{"categories":2983},[153],{"categories":2985},[136],{"categories":2987},[127],{"categories":2989},[117],{"categories":2991},[168,136],{"categories":2993},[136],{"categories":2995},[153],{"categories":2997},[127],{"categories":2999},[],{"categories":3001},[],{"categories":3003},[],{"categories":3005},[],{"categories":3007},[],{"categories":3009},[],{"categories":3011},[153],{"categories":3013},[],{"categories":3015},[],{"categories":3017},[153],{"categories":3019},[],{"categories":3021},[],{"categories":3023},[],{"categories":3025},[153],{"categories":3027},[122],{"categories":3029},[],{"categories":3031},[],{"categories":3033},[],{"categories":3035},[153],{"categories":3037},[],{"categories":3039},[153],{"categories":3041},[153],{"categories":3043},[],{"categories":3045},[153],{"categories":3047},[136],{"categories":3049},[],{"categories":3051},[168],{"categories":3053},[168],{"categories":3055},[],{"categories":3057},[130],{"categories":3059},[],{"categories":3061},[],{"categories":3063},[],{"categories":3065},[133],{"categories":3067},[122],{"categories":3069},[127],{"categories":3071},[153],{"categories":3073},[117],{"categories":3075},[153],{"categories":3077},[],{"categories":3079},[],{"categories":3081},[117],{"categories":3083},[130],{"categories":3085},[127],{"categories":3087},[],{"categories":3089},[478],{"categories":3091},[],{"categories":3093},[130],{"categories":3095},[153],{"categories":3097},[153],{"categories":3099},[130],{"categories":3101},[153],{"categories":3103},[133],{"categories":3105},[127],{"categories":3107},[153],{"categories":3109},[127],{"categories":3111},[153],{"categories":3113},[127],{"categories":3115},[168],{"categories":3117},[168],{"categories":3119},[133],{"categories":3121},[],{"categories":3123},[153],{"categories":3125},[153],{"categories":3127},[130],{"categories":3129},[565],{"categories":3131},[168],{"categories":3133},[122],{"categories":3135},[153],{"categories":3137},[122],{"categories":3139},[153],{"categories":3141},[153],{"categories":3143},[],{"categories":3145},[153],{"categories":3147},[],{"categories":3149},[153],{"categories":3151},[130],{"categories":3153},[153],{"categories":3155},[153],{"categories":3157},[153],{"categories":3159},[],{"categories":3161},[153],{"categories":3163},[153],{"categories":3165},[565],{"categories":3167},[],{"categories":3169},[122],{"categories":3171},[478],{"categories":3173},[136],{"categories":3175},[],{"categories":3177},[213],{"categories":3179},[],{"categories":3181},[],{"categories":3183},[122],{"categories":3185},[153],{"categories":3187},[],{"categories":3189},[153],{"categories":3191},[153],{"categories":3193},[127],{"categories":3195},[153],{"categories":3197},[122],{"categories":3199},[122],{"categories":3201},[133],{"categories":3203},[133],{"categories":3205},[133],{"categories":3207},[153],{"categories":3209},[213],{"categories":3211},[122],{"categories":3213},[168],{"categories":3215},[],{"categories":3217},[133],{"categories":3219},[133],{"categories":3221},[478],{"categories":3223},[133],{"categories":3225},[133],{"categories":3227},[127],{"categories":3229},[122],{"categories":3231},[478],{"categories":3233},[153],{"categories":3235},[153],{"categories":3237},[153],{"categories":3239},[153],{"categories":3241},[],{"categories":3243},[127],{"categories":3245},[153],{"categories":3247},[133],{"categories":3249},[],{"categories":3251},[],{"categories":3253},[122],{"categories":3255},[],{"categories":3257},[127],{"categories":3259},[127],{"categories":3261},[127],{"categories":3263},[127],{"categories":3265},[127],{"categories":3267},[127],{"categories":3269},[127],{"categories":3271},[127],{"categories":3273},[],{"categories":3275},[],{"categories":3277},[153],{"categories":3279},[],{"categories":3281},[127],{"categories":3283},[168],{"categories":3285},[168],{"categories":3287},[213],{"categories":3289},[117],{"categories":3291},[],{"categories":3293},[],{"categories":3295},[],{"categories":3297},[133],{"categories":3299},[153],{"categories":3301},[],{"categories":3303},[117],{"categories":3305},[117],{"categories":3307},[133],{"categories":3309},[168],{"categories":3311},[213],{"categories":3313},[133],{"categories":3315},[133],{"categories":3317},[],{"categories":3319},[127],{"categories":3321},[117],{"categories":3323},[117],{"categories":3325},[153],{"categories":3327},[127],{"categories":3329},[136],{"categories":3331},[133],{"categories":3333},[],{"categories":3335},[130],{"categories":3337},[213],{"categories":3339},[122],{"categories":3341},[122],{"categories":3343},[122],{"categories":3345},[478],{"categories":3347},[],{"categories":3349},[127],{"categories":3351},[],{"categories":3353},[127],{"categories":3355},[127],{"categories":3357},[153],{"categories":3359},[153],{"categories":3361},[136],{"categories":3363},[127],{"categories":3365},[136],{"categories":3367},[],{"categories":3369},[127],{"categories":3371},[133],{"categories":3373},[133],{"categories":3375},[133],{"categories":3377},[153],{"categories":3379},[127],{"categories":3381},[153],{"categories":3383},[117],{"categories":3385},[122],{"categories":3387},[133],{"categories":3389},[122],{"categories":3391},[153],{"categories":3393},[],{"categories":3395},[122],{"categories":3397},[127],{"categories":3399},[122],{"categories":3401},[122],{"categories":3403},[122],{"categories":3405},[122],{"categories":3407},[],{"categories":3409},[],{"categories":3411},[122],{"categories":3413},[122],{"categories":3415},[],{"categories":3417},[122],{"categories":3419},[122],{"categories":3421},[153],{"categories":3423},[153],{"categories":3425},[122],{"categories":3427},[122],{"categories":3429},[153],{"categories":3431},[],{"categories":3433},[153],{"categories":3435},[127],{"categories":3437},[153],{"categories":3439},[153],{"categories":3441},[],{"categories":3443},[153],{"categories":3445},[153],{"categories":3447},[153],{"categories":3449},[122],{"categories":3451},[],{"categories":3453},[],{"categories":3455},[],{"categories":3457},[],{"categories":3459},[153],{"categories":3461},[153],{"categories":3463},[],{"categories":3465},[130],{"categories":3467},[122],{"categories":3469},[],{"categories":3471},[],{"categories":3473},[],{"categories":3475},[],{"categories":3477},[],{"categories":3479},[153],{"categories":3481},[],{"categories":3483},[],{"categories":3485},[153],{"categories":3487},[],{"categories":3489},[127],{"categories":3491},[127],{"categories":3493},[127],{"categories":3495},[117],{"categories":3497},[],{"categories":3499},[130],{"categories":3501},[136],{"categories":3503},[136],{"categories":3505},[478],{"categories":3507},[122],{"categories":3509},[],{"categories":3511},[153],{"categories":3513},[153],{"categories":3515},[117],{"categories":3517},[],{"categories":3519},[117],{"categories":3521},[],{"categories":3523},[],{"categories":3525},[],{"categories":3527},[136],{"categories":3529},[127],{"categories":3531},[127],{"categories":3533},[127],{"categories":3535},[127],{"categories":3537},[127],{"categories":3539},[],{"categories":3541},[122],{"categories":3543},[153],{"categories":3545},[153],{"categories":3547},[153],{"categories":3549},[],{"categories":3551},[117],{"categories":3553},[],{"categories":3555},[133],{"categories":3557},[213],{"categories":3559},[133],{"categories":3561},[],{"categories":3563},[],{"categories":3565},[153],{"categories":3567},[127],{"categories":3569},[],{"categories":3571},[153],{"categories":3573},[153],{"categories":3575},[153],{"categories":3577},[127],{"categories":3579},[127],{"categories":3581},[153],{"categories":3583},[213],{"categories":3585},[127],{"categories":3587},[],{"categories":3589},[153],{"categories":3591},[],{"categories":3593},[565],{"categories":3595},[136],{"categories":3597},[213],{"categories":3599},[136],{"categories":3601},[478],{"categories":3603},[153],{"categories":3605},[136],{"categories":3607},[122],{"categories":3609},[478],{"categories":3611},[136],{"categories":3613},[133],{"categories":3615},[133],{"categories":3617},[],{"categories":3619},[136],{"categories":3621},[],{"categories":3623},[168],{"categories":3625},[136],{"categories":3627},[],{"categories":3629},[213],{"categories":3631},[213],{"categories":3633},[565],{"categories":3635},[],{"categories":3637},[153],{"categories":3639},[136],{"categories":3641},[478],{"categories":3643},[127],{"categories":3645},[127],{"categories":3647},[213],{"categories":3649},[153],{"categories":3651},[168],{"categories":3653},[153],{"categories":3655},[],{"categories":3657},[],{"categories":3659},[],{"categories":3661},[130],{"categories":3663},[153],{"categories":3665},[133],{"categories":3667},[136],{"categories":3669},[136],{"categories":3671},[153],{"categories":3673},[130],{"categories":3675},[168],{"categories":3677},[153],{"categories":3679},[136],{"categories":3681},[153],{"categories":3683},[136],{"categories":3685},[168],{"categories":3687},[168],{"categories":3689},[127],{"categories":3691},[168],{"categories":3693},[136],{"categories":3695},[117],{"categories":3697},[136],{"categories":3699},[136],{"categories":3701},[136],{"categories":3703},[136],{"categories":3705},[],{"categories":3707},[122],{"categories":3709},[],{"categories":3711},[213],{"categories":3713},[153],{"categories":3715},[153],{"categories":3717},[],{"categories":3719},[],{"categories":3721},[],{"categories":3723},[153],{"categories":3725},[122],{"categories":3727},[153],{"categories":3729},[153],{"categories":3731},[],{"categories":3733},[153],{"categories":3735},[133],{"categories":3737},[153],{"categories":3739},[153],{"categories":3741},[153],{"categories":3743},[],{"categories":3745},[],{"categories":3747},[],{"categories":3749},[478],{"categories":3751},[478],{"categories":3753},[117],{"categories":3755},[127],{"categories":3757},[117,130],{"categories":3759},[153],{"categories":3761},[122],{"categories":3763},[],{"categories":3765},[133],{"categories":3767},[213],{"categories":3769},[153],{"categories":3771},[136],{"categories":3773},[153],{"categories":3775},[],{"categories":3777},[213],{"categories":3779},[478],{"categories":3781},[127],{"categories":3783},[117],{"categories":3785},[478],{"categories":3787},[127],{"categories":3789},[168],{"categories":3791},[127],{"categories":3793},[168],{"categories":3795},[153],{"categories":3797},[168],{"categories":3799},[168],{"categories":3801},[136],{"categories":3803},[213],{"categories":3805},[153],{"categories":3807},[130],{"categories":3809},[],{"categories":3811},[153],{"categories":3813},[133],{"categories":3815},[213],{"categories":3817},[117],{"categories":3819},[153],{"categories":3821},[213],{"categories":3823},[168],{"categories":3825},[153],{"categories":3827},[153],{"categories":3829},[213],{"categories":3831},[153],{"categories":3833},[168],{"categories":3835},[153],{"categories":3837},[],{"categories":3839},[153],{"categories":3841},[153],{"categories":3843},[153],{"categories":3845},[153],{"categories":3847},[],{"categories":3849},[127],{"categories":3851},[478],{"categories":3853},[],{"categories":3855},[],{"categories":3857},[153],{"categories":3859},[117],{"categories":3861},[130],{"categories":3863},[117],{"categories":3865},[117],{"categories":3867},[127],{"categories":3869},[],{"categories":3871},[153],{"categories":3873},[122],{"categories":3875},[153],{"categories":3877},[153],{"categories":3879},[],{"categories":3881},[127],{"categories":3883},[122],{"categories":3885},[153,478],{"categories":3887},[127,478],{"categories":3889},[478],{"categories":3891},[153],{"categories":3893},[127],{"categories":3895},[127],{"categories":3897},[136],{"categories":3899},[136],{"categories":3901},[136],{"categories":3903},[153],{"categories":3905},[133],{"categories":3907},[127],{"categories":3909},[],{"categories":3911},[478],{"categories":3913},[],{"categories":3915},[478],{"categories":3917},[478],{"categories":3919},[117],{"categories":3921},[127],{"categories":3923},[],{"categories":3925},[478],{"categories":3927},[153],{"categories":3929},[122],{"categories":3931},[153],{"categories":3933},[133],{"categories":3935},[136],{"categories":3937},[136],{"categories":3939},[136],{"categories":3941},[478],{"categories":3943},[],{"categories":3945},[],{"categories":3947},[],{"categories":3949},[153],{"categories":3951},[136],{"categories":3953},[153],{"categories":3955},[136],{"categories":3957},[478],{"categories":3959},[478],{"categories":3961},[153],{"categories":3963},[127],{"categories":3965},[],{"categories":3967},[153],{"categories":3969},[153],{"categories":3971},[153],{"categories":3973},[],{"categories":3975},[],{"categories":3977},[478],{"categories":3979},[478],{"categories":3981},[153,478],{"categories":3983},[127],{"categories":3985},[127],{"categories":3987},[127],{"categories":3989},[127],{"categories":3991},[127],{"categories":3993},[127],{"categories":3995},[],{"categories":3997},[136],{"categories":3999},[153],{"categories":4001},[136],{"categories":4003},[130],{"categories":4005},[153],{"categories":4007},[565],{"categories":4009},[565],{"categories":4011},[127],{"categories":4013},[136],{"categories":4015},[],{"categories":4017},[127],{"categories":4019},[153],{"categories":4021},[],{"categories":4023},[133],{"categories":4025},[],{"categories":4027},[153],{"categories":4029},[127],{"categories":4031},[122],{"categories":4033},[153],{"categories":4035},[],{"categories":4037},[],{"categories":4039},[133],{"categories":4041},[133],{"categories":4043},[168],{"categories":4045},[133],{"categories":4047},[127],{"categories":4049},[],{"categories":4051},[127],{"categories":4053},[122],{"categories":4055},[153],{"categories":4057},[153],{"categories":4059},[],{"categories":4061},[153],{"categories":4063},[168],{"categories":4065},[153],{"categories":4067},[],{"categories":4069},[213],{"categories":4071},[136],{"categories":4073},[136],{"categories":4075},[117],{"categories":4077},[117],{"categories":4079},[117],{"categories":4081},[127],{"categories":4083},[117],{"categories":4085},[127],{"categories":4087},[478],{"categories":4089},[565],{"categories":4091},[122],{"categories":4093},[122],{"categories":4095},[122],{"categories":4097},[478],{"categories":4099},[122,117],{"categories":4101},[213],{"categories":4103},[127],{"categories":4105},[],{"categories":4107},[153],{"categories":4109},[],{"categories":4111},[136],{"categories":4113},[213],{"categories":4115},[133],{"categories":4117},[136],{"categories":4119},[168],{"categories":4121},[],{"categories":4123},[127],{"categories":4125},[],{"categories":4127},[565],{"categories":4129},[],{"categories":4131},[133],{"categories":4133},[133],{"categories":4135},[213],{"categories":4137},[],{"categories":4139},[153],{"categories":4141},[213],{"categories":4143},[],{"categories":4145},[153],{"categories":4147},[153],{"categories":4149},[],{"categories":4151},[168],{"categories":4153},[153],{"categories":4155},[],{"categories":4157},[153],{"categories":4159},[],{"categories":4161},[],{"categories":4163},[127],{"categories":4165},[127],{"categories":4167},[],{"categories":4169},[136],{"categories":4171},[136],{"categories":4173},[136],{"categories":4175},[153,127],{"categories":4177},[127],{"categories":4179},[127],{"categories":4181},[127],{"categories":4183},[213],{"categories":4185},[213],{"categories":4187},[],{"categories":4189},[122],{"categories":4191},[153],{"categories":4193},[213],{"categories":4195},[213],{"categories":4197},[122],{"categories":4199},[117],{"categories":4201},[127],{"categories":4203},[136],{"categories":4205},[153],{"categories":4207},[153],{"categories":4209},[127],{"categories":4211},[136],{"categories":4213},[127],{"categories":4215},[153],{"categories":4217},[130],{"categories":4219},[],{"categories":4221},[153],{"categories":4223},[],{"categories":4225},[153],{"categories":4227},[153],{"categories":4229},[136],{"categories":4231},[],{"categories":4233},[213],{"categories":4235},[153],{"categories":4237},[127],{"categories":4239},[127],{"categories":4241},[136],{"categories":4243},[168],{"categories":4245},[168],{"categories":4247},[122],{"categories":4249},[153],{"categories":4251},[127],{"categories":4253},[],{"categories":4255},[127],{"categories":4257},[153],{"categories":4259},[122],{"categories":4261},[153],{"categories":4263},[153],{"categories":4265},[153],{"categories":4267},[127],{"categories":4269},[213],{"categories":4271},[153],{"categories":4273},[133],{"categories":4275},[153],{"categories":4277},[153],{"categories":4279},[153],{"categories":4281},[153],{"categories":4283},[],{"categories":4285},[153],{"categories":4287},[213],{"categories":4289},[133],{"categories":4291},[153],{"categories":4293},[133],{"categories":4295},[],{"categories":4297},[],{"categories":4299},[],{"categories":4301},[153],{"categories":4303},[],{"categories":4305},[],{"categories":4307},[],{"categories":4309},[],{"categories":4311},[127],{"categories":4313},[168],{"categories":4315},[127],{"categories":4317},[127],{"categories":4319},[136],{"categories":4321},[117],{"categories":4323},[153],{"categories":4325},[153],{"categories":4327},[153],{"categories":4329},[117],{"categories":4331},[168],{"categories":4333},[],{"categories":4335},[213],{"categories":4337},[130],{"categories":4339},[153],{"categories":4341},[133],{"categories":4343},[168],{"categories":4345},[168],{"categories":4347},[565],{"categories":4349},[127],{"categories":4351},[153],{"categories":4353},[153],{"categories":4355},[168],{"categories":4357},[153],{"categories":4359},[],{"categories":4361},[],{"categories":4363},[478],{"categories":4365},[133],{"categories":4367},[168],{"categories":4369},[153],{"categories":4371},[122],{"categories":4373},[168],{"categories":4375},[117],{"categories":4377},[127],{"categories":4379},[127],{"categories":4381},[122],{"categories":4383},[153],{"categories":4385},[],{"categories":4387},[],{"categories":4389},[],{"categories":4391},[153],{"categories":4393},[],{"categories":4395},[122],{"categories":4397},[],{"categories":4399},[153],{"categories":4401},[],{"categories":4403},[122],{"categories":4405},[127],{"categories":4407},[153],{"categories":4409},[478],{"categories":4411},[153],{"categories":4413},[168],{"categories":4415},[153],{"categories":4417},[168],{"categories":4419},[168],{"categories":4421},[],{"categories":4423},[],{"categories":4425},[168],{"categories":4427},[168],{"categories":4429},[168],{"categories":4431},[],{"categories":4433},[168],{"categories":4435},[127],{"categories":4437},[127],{"categories":4439},[],{"categories":4441},[153],{"categories":4443},[130],{"categories":4445},[213],{"categories":4447},[153],{"categories":4449},[],{"categories":4451},[168],{"categories":4453},[153],{"categories":4455},[565],{"categories":4457},[168],{"categories":4459},[168],{"categories":4461},[130],{"categories":4463},[136],{"categories":4465},[136],{"categories":4467},[],{"categories":4469},[136],{"categories":4471},[153],{"categories":4473},[],{"categories":4475},[],{"categories":4477},[127],{"categories":4479},[],{"categories":4481},[127],{"categories":4483},[127],{"categories":4485},[122],{"categories":4487},[153],{"categories":4489},[122],{"categories":4491},[168],{"categories":4493},[122],{"categories":4495},[136],{"categories":4497},[136],{"categories":4499},[136],{"categories":4501},[122],{"categories":4503},[153],{"categories":4505},[127],{"categories":4507},[478],{"categories":4509},[117],{"categories":4511},[478],{"categories":4513},[478],{"categories":4515},[136],{"categories":4517},[478],{"categories":4519},[478],[4521,4657,4854,5017],{"id":4522,"title":4523,"ai":4524,"body":4529,"categories":4600,"created_at":50,"date_modified":50,"description":43,"extension":51,"faq":50,"featured":52,"kicker_label":50,"meta":4601,"navigation":95,"path":4644,"published_at":4645,"question":50,"scraped_at":4646,"seo":4647,"sitemap":4648,"source_id":4649,"source_name":4650,"source_type":103,"source_url":4651,"stem":4652,"tags":4653,"thumbnail_url":50,"tldr":4654,"tweet":50,"unknown_tags":4655,"__hash__":4656},"summaries\u002Fsummaries\u002Flong-running-agents-persist-across-sessions-for-da-summary.md","Long-Running Agents Persist Across Sessions for Days",{"provider":7,"model":8,"input_tokens":4525,"output_tokens":4526,"processing_time_ms":4527,"cost_usd":4528},8571,2109,19213,0.0027462,{"type":14,"value":4530,"toc":4595},[4531,4535,4551,4554,4558,4579,4582,4586,4589],[17,4532,4534],{"id":4533},"overcome-core-walls-with-external-state-and-decoupling","Overcome Core Walls with External State and Decoupling",[22,4536,4537,4538,4542,4543,4546,4547,4550],{},"Long-running agents address three universal challenges: finite context (1M-token windows degrade via context rot before limits), no persistent state (each session starts blank, like shift engineers with amnesia), and no self-verification (models prematurely declare completion). Solutions converge on external state outside the model's context: structured files like ",[4539,4540,4541],"code",{},"prd.json"," (task list), ",[4539,4544,4545],{},"progress.txt"," (lab notes), and ",[4539,4548,4549],{},"AGENTS.md"," (rules). The agent remains amnesiac per session, but the filesystem persists progress.",[22,4552,4553],{},"METR's time horizon metric shows frontier models doubling reliable task length every seven months since 2019; TH1.1 doubled 8-hour tasks, projecting day-scale by 2028 and year-scale by 2034. This enables economic shifts: 10-minute agents fix bugs, 10-hour ones own features or migrations stalled for quarters. Anthropic's Claude Sonnet ran 30+ hours autonomously, producing an 11,000-line Slack app. Persistence builds identity, accumulating context like competitor moves or flaky tests, as in Anthropic's month-long Project Vend vending simulation.",[17,4555,4557],{"id":4556},"architectures-ralph-loop-to-brainhandssessions","Architectures: Ralph Loop to Brain\u002FHands\u002FSessions",[22,4559,4560,4561,4563,4564,4566,4567,4570,4571,4574,4575,4578],{},"The Ralph loop—popularized by Geoffrey Huntley and Ryan Carson—is a bash script that iterates: pick next task from ",[4539,4562,4541],{},", prompt with context\u002Fnotes, call agent, run tests, append to ",[4539,4565,4545],{},", update tasks, repeat. It chains loops for analysis\u002Fplanning\u002Fexecution, mirroring planner-generator-evaluator triads. Anthropic productizes this in harnesses: initializer sets ",[4539,4568,4569],{},"feature-list.json"," and ",[4539,4572,4573],{},"init.sh","; coding agent progresses incrementally, commits, leaves ",[4539,4576,4577],{},"claude-progress.txt","; test ratchets prevent deleting tests.",[22,4580,4581],{},"Anthropic's Managed Agents decouple Brain (model + loop), Hands (ephemeral sandboxes), and Session (append-only event log), enabling stateless harnesses, cattle-not-pets sandboxes, and 60% p50 \u002F 90% p95 faster time-to-first-token. Sessions make recovery queryable. Cursor scales with Planners (emit tasks, spawn subs), Workers (execute), Judges (finish iterations); GPT outperforms Opus for extended work as Opus stops early. Google’s Gemini Enterprise Agent Platform offers Agent Runtime (days-long with sub-second starts), Sessions (pin to CRM), Memory Bank (curated long-term memory, 50% faster expense submission), and Sandbox.",[17,4583,4585],{"id":4584},"production-patterns-and-build-paths","Production Patterns and Build Paths",[22,4587,4588],{},"Five patterns distinguish production: 1) Checkpoint-and-resume (save every N units, recover granularly); 2) Delegated approval (pause with full state for human review, resume sub-second); 3) Memory-layered context (govern drift via identity\u002Fregistry\u002Fgateway); 4) Ambient processing (event-driven, policy in gateway); 5) Fleet orchestration (coordinator delegates to isolated specialists).",[22,4590,4591,4592,4594],{},"To build: For repo coding, use Claude Code\u002FCursor with Ralph loop, ",[4539,4593,4549],{}," checklist, git commits, worktrees for overnight runs. For hosted products, pick managed (Google Agent Platform, Claude Managed Agents) for brain\u002Fhands\u002Fsession split + observability. For operational (monitoring\u002Fresearch), stack ADK + Memory Bank + Cloud Run. Prompting drives behavior; match models to roles (e.g., GPT for endurance). Start with longest uninterrupted work unit to scope needs.",{"title":43,"searchDepth":44,"depth":44,"links":4596},[4597,4598,4599],{"id":4533,"depth":44,"text":4534},{"id":4556,"depth":44,"text":4557},{"id":4584,"depth":44,"text":4585},[],{"content_references":4602,"triage":4641},[4603,4608,4611,4615,4620,4624,4627,4630,4634,4638],{"type":4604,"title":4605,"author":4606,"url":4607,"context":59},"report","Time Horizons","METR","https:\u002F\u002Fmetr.org\u002Ftime-horizons\u002F",{"type":4604,"title":4609,"author":4606,"url":4610,"context":59},"TH1.1 update","https:\u002F\u002Fmetr.org\u002Fblog\u002F2026-1-29-time-horizon-1-1\u002F",{"type":61,"title":4612,"author":4613,"url":4614,"context":89},"Ralph","Geoffrey Huntley","https:\u002F\u002Fghuntley.com\u002Fralph\u002F",{"type":86,"title":4616,"author":4617,"url":4618,"context":4619},"Compound Product","Ryan Carson","https:\u002F\u002Fgithub.com\u002Fsnarktank\u002Fcompound-product","mentioned",{"type":61,"title":4621,"author":4622,"url":4623,"context":59},"Effective harnesses for long-running agents","Anthropic","https:\u002F\u002Fwww.anthropic.com\u002Fengineering\u002Feffective-harnesses-for-long-running-agents",{"type":61,"title":4625,"author":4622,"url":4626,"context":59},"Scaling Managed Agents: Decoupling the brain from the hands","https:\u002F\u002Fwww.anthropic.com\u002Fengineering\u002Fmanaged-agents",{"type":86,"title":4628,"author":4622,"url":4629,"context":89},"Claude Managed Agents","https:\u002F\u002Fplatform.claude.com\u002Fdocs\u002Fen\u002Fmanaged-agents\u002Foverview",{"type":61,"title":4631,"author":4632,"url":4633,"context":59},"Scaling long-running autonomous coding","Cursor","https:\u002F\u002Fcursor.com\u002Fblog\u002Fscaling-agents",{"type":86,"title":4635,"author":4636,"url":4637,"context":89},"Gemini Enterprise Agent Platform","Google","https:\u002F\u002Fcloud.google.com\u002Fproducts\u002Fgemini-enterprise-agent-platform",{"type":86,"title":4639,"author":4636,"url":4640,"context":4619},"Agent Memory Bank","https:\u002F\u002Fdocs.cloud.google.com\u002Fgemini-enterprise-agent-platform\u002Fscale\u002Fmemory-bank",{"relevance":91,"novelty":92,"quality":92,"actionability":92,"composite":4642,"reasoning":4643},4.35,"Category: AI Automation. The article provides in-depth insights into long-running agents and their practical applications in overcoming common challenges in AI tasks, which directly addresses the audience's need for actionable AI integration strategies. It discusses specific frameworks like the Ralph loop and the use of external state, offering concrete examples that builders can implement.","\u002Fsummaries\u002Flong-running-agents-persist-across-sessions-for-da-summary","2026-04-30 14:30:29","2026-05-03 17:01:21",{"title":4523,"description":43},{"loc":4644},"e1ccc0df695b698b","Addy Osmani","https:\u002F\u002Faddyo.substack.com\u002Fp\u002Flong-running-agents","summaries\u002Flong-running-agents-persist-across-sessions-for-da-summary",[108,107,109,110],"Long-running agents solve finite context, no persistent state, and self-verification walls using external files (plans, progress), decoupled brain\u002Fhands\u002Fsessions, and loops like Ralph, enabling hours-long tasks like 11k-line apps or week-scale prospecting.",[109,110],"I_tafXPT3lfuq2hr74ewWLQUB0X78LtNqiTZJ6sqSIo",{"id":4658,"title":4659,"ai":4660,"body":4665,"categories":4812,"created_at":50,"date_modified":50,"description":43,"extension":51,"faq":50,"featured":52,"kicker_label":50,"meta":4813,"navigation":95,"path":4841,"published_at":4842,"question":50,"scraped_at":4843,"seo":4844,"sitemap":4845,"source_id":4846,"source_name":4847,"source_type":103,"source_url":4848,"stem":4849,"tags":4850,"thumbnail_url":50,"tldr":4851,"tweet":50,"unknown_tags":4852,"__hash__":4853},"summaries\u002Fsummaries\u002Fshopify-s-ai-surge-custom-tools-beat-hype-summary.md","Shopify's AI Surge: Custom Tools Beat Hype",{"provider":7,"model":8,"input_tokens":4661,"output_tokens":4662,"processing_time_ms":4663,"cost_usd":4664},9419,2866,23896,0.0032943,{"type":14,"value":4666,"toc":4801},[4667,4671,4674,4677,4683,4687,4690,4693,4696,4701,4705,4708,4712,4715,4719,4722,4727,4731,4734,4737,4741,4744,4748,4751,4755,4786,4791],[17,4668,4670],{"id":4669},"shopifys-internal-ai-explosion-and-december-inflection","Shopify's Internal AI Explosion and December Inflection",[22,4672,4673],{},"Mikhail Parakhin, Shopify's CTO, shares exclusive data on the company's AI adoption: nearly 100% of employees now use AI tools daily, up from modest growth pre-2024. A December 2024 \"phase transition\"—driven by model quality jumps—sparked exponential token usage and tool adoption. CLI-based agents like internal \"River\" outpace IDE tools (e.g., Copilot, Cursor) in growth, as developers favor non-visual, high-speed interactions. Shopify funds unlimited tokens on top models like Claude Opus-4.6 or GPT-5.4, enforcing a floor of high-quality models while observing skewed usage: top 10% users consume disproportionately more, hinting at early power users dominating before broader diffusion.",[22,4675,4676],{},"Parakhin attributes this to Shopify's maturity as a $200B, 20-year-old firm going \"all-in\" on AI, now vocal about internals like Tobi's QMD and his SQLite preferences for agent data storage—echoing Andrej Karpathy's recent agent context queries.",[4678,4679,4680],"blockquote",{},[22,4681,4682],{},"\"It approaches really 100% by now. It’s hard to do your job now without interacting deeply, at least with one tool.\" — Mikhail Parakhin on daily AI active users.",[17,4684,4686],{"id":4685},"token-budgets-right-but-critique-parallel-agents","Token Budgets Right, But Critique > Parallel Agents",[22,4688,4689],{},"Jensen Huang's push for engineer token quotas (e.g., 100K tokens\u002Fyear per $200K engineer) gets Parakhin's endorsement as \"directionally correct,\" countering critics likening it to lines-of-code metrics. However, raw tokens mislead: anti-patterns like parallel non-communicating agents burn tokens inefficiently. True unlocks are critique loops—where one agent generates, another (ideally on a stronger model) critiques and iterates—yielding higher-quality code despite longer latency.",[22,4691,4692],{},"AI generates cleaner code than average humans but floods production with sheer volume, spiking bugs. Parakhin stresses spending more on review (e.g., GPT-5.4 Pro, Gemini Deep Think) than generation: few tokens generated slowly via debate beats swarms. Off-the-shelf tools fail here, lacking pro-models and sequential depth, so Shopify built custom PR reviewers prioritizing rigor over speed.",[22,4694,4695],{},"PR merges grew 30% MoM (vs. 10% pre-AI), with rising complexity, but test failures, flaky CI\u002FCD, and rollbacks now bottleneck deployments. Humans tolerate week-long reviews; AI can afford hours if it cuts aggregate cycle time.",[4678,4697,4698],{},[22,4699,4700],{},"\"The important metric is the ratio of budget spent during code generation versus... expensive tokens... checking on PR reviews.\" — Mikhail Parakhin on balancing AI coding costs.",[17,4702,4704],{"id":4703},"cicd-and-git-need-agent-era-reinvention","CI\u002FCD and Git Need Agent-Era Reinvention",[22,4706,4707],{},"Traditional Git, PRs, and CI\u002FCD—designed for humans—creak under machine-speed code volume. Stack diffs (via Graphite) help Shopify, but Parakhin foresees a paradigm shift: stabilize first (clamp bugs, speed tests), then rethink metaphors entirely. PR volume overwhelms; evicting bad PRs mid-pipeline eats time. No compelling replacements yet, but everyone's racing to adapt.",[17,4709,4711],{"id":4710},"tangle-reproducible-ml-beyond-airflow","Tangle: Reproducible ML Beyond Airflow",[22,4713,4714],{},"Tangle addresses ML\u002Fdata workflow irreproducibility: content-addressed caching creates team-wide network effects, making experiments collaborative and production-ready from day one. Unlike Airflow's DAGs (sequential, brittle), Tangle's idempotent, cache-first design enables reuse across repos—vital for Shopify's explosive AI growth.",[17,4716,4718],{"id":4717},"tangent-auto-research-democratizes-optimization","Tangent: Auto-Research Democratizes Optimization",[22,4720,4721],{},"Tangent automates research loops for search, themes, prompt compression, and storage. PMs and domain experts now run AutoML-style experiments sans ML engineers, fulfilling long-promised \"AutoML that feels real\" in the LLM era. Limits persist (e.g., poor hypothesis generation), but paired with Tangle\u002FSimGym, it compounds: reproducible evals on simulated data.",[4678,4723,4724],{},[22,4725,4726],{},"\"Tangent is becoming a democratizing tool for PMs and domain experts, not just ML engineers.\" — Mikhail Parakhin on broadening AI access.",[17,4728,4730],{"id":4729},"simgym-historical-data-moat-in-customer-simulation","SimGym: Historical Data Moat in Customer Simulation",[22,4732,4733],{},"SimGym simulates buyers\u002Fmerchants using Shopify's vast historical trajectories— a defensible moat vs. generic sims. Evolved from A\u002FB comparisons to live recommendations (e.g., \"change this storefront element to lift conversions\"). Multimodal models, browser farms, serving, and distillation make it costly; counterfactuals model interventions like discounts or notifications.",[22,4735,4736],{},"Category behaviors vary wildly (reviving Chinese Restaurant Processes for clustering). HSTU tracks trajectories; real data ensures fidelity over toy sims.",[17,4738,4740],{"id":4739},"ucp-liquid-ai-low-latency-non-transformer-wins","UCP, Liquid AI: Low-Latency Non-Transformer Wins",[22,4742,4743],{},"Shopify's UCP unifies catalog intelligence: runtime search, bulk lookups, identity linking. Liquid AI's non-transformer foundation models deliver sub-20ms latencies for query understanding, Sidekick Pulse, and scale workloads—first architecture Parakhin calls \"genuinely competitive.\" Pragmatic model choice: merit-based, not hype-driven; Liquid scales with compute but Shopify stays open.",[17,4745,4747],{"id":4746},"bing-sydney-lessons-and-hiring-push","Bing Sydney Lessons and Hiring Push",[22,4749,4750],{},"Parakhin recounts shaping Bing's Sydney personality deliberately (not accidental), learning early AI character control. Shopify hires aggressively: ML, data science, distributed DBs for AI infra.",[17,4752,4754],{"id":4753},"key-takeaways","Key Takeaways",[4756,4757,4758,4762,4765,4768,4771,4774,4777,4780,4783],"ul",{},[4759,4760,4761],"li",{},"Enforce high-model floors (e.g., Opus-4.6+) with unlimited budgets; track critique-to-generation ratios over raw tokens.",[4759,4763,4764],{},"Build custom PR reviewers with sequential pro-model debates; tolerate latency to cut CI\u002FCD flakiness.",[4759,4766,4767],{},"Use content-addressed caching (Tangle-style) for ML reproducibility; beats Airflow for collaboration.",[4759,4769,4770],{},"Democratize via auto-research (Tangent): let PMs optimize without ML PhDs.",[4759,4772,4773],{},"Leverage proprietary data for sims (SimGym): historical trajectories enable counterfactuals and moats.",[4759,4775,4776],{},"Reinvent CI\u002FCD metaphors for agents; stabilize human-era tools first.",[4759,4778,4779],{},"Test non-transformers like Liquid AI for latency wins in production.",[4759,4781,4782],{},"Monitor adoption skew: power users lead, but teach to distribute.",[4759,4784,4785],{},"AI volume > human quality\u002Fquantity; review spend must scale accordingly.",[4678,4787,4788],{},[22,4789,4790],{},"\"Good model writes code on average with fewer bugs than the average human. But since they write so much more of it... you have to have a very rigorous PR reviews.\" — Mikhail Parakhin on AI coding pitfalls.",[4678,4792,4793],{},[22,4794,4795,4796,4800],{},"\"We probably need a different metaphor or different whole design of how to process ",[4797,4798,4799],"span",{},"CI\u002FCD"," in new agentic world.\" — Mikhail Parakhin on dev tooling evolution.",{"title":43,"searchDepth":44,"depth":44,"links":4802},[4803,4804,4805,4806,4807,4808,4809,4810,4811],{"id":4669,"depth":44,"text":4670},{"id":4685,"depth":44,"text":4686},{"id":4703,"depth":44,"text":4704},{"id":4710,"depth":44,"text":4711},{"id":4717,"depth":44,"text":4718},{"id":4729,"depth":44,"text":4730},{"id":4739,"depth":44,"text":4740},{"id":4746,"depth":44,"text":4747},{"id":4753,"depth":44,"text":4754},[],{"content_references":4814,"triage":4837},[4815,4818,4821,4824,4827,4830,4834],{"type":86,"title":4816,"url":4817,"context":4619},"Tangle","https:\u002F\u002Fshopify.engineering\u002Ftangle",{"type":86,"title":4819,"url":4820,"context":4619},"Tangent","https:\u002F\u002Fapps.shopify.com\u002Ftangent-1",{"type":86,"title":4822,"url":4823,"context":4619},"SimGym","https:\u002F\u002Fapps.shopify.com\u002Fsimgym",{"type":86,"title":4825,"url":4826,"context":4619},"UCP","https:\u002F\u002Fwww.shopify.com\u002Fucp",{"type":61,"title":4828,"url":4829,"context":4619},"Liquid AI Partnership","https:\u002F\u002Fwww.liquid.ai\u002Fblog\u002Fliquid-ai-announces-multi-year-partnership-with-shopify-to-bring-sub-20ms-foundation-models-to-core-commerce-experiences",{"type":4831,"title":4832,"url":4833,"context":4619},"event","San Francisco World’s Fair","https:\u002F\u002Fwww.ai.engineer\u002Fwf",{"type":61,"title":4835,"url":4836,"context":4619},"December model-quality inflection","https:\u002F\u002Fwww.latent.space\u002Fp\u002Fwtf2025",{"relevance":91,"novelty":92,"quality":92,"actionability":4838,"composite":4839,"reasoning":4840},3,4.15,"Category: AI & LLMs. The article provides in-depth insights into Shopify's internal AI adoption and the practical tools being used, addressing the audience's need for understanding real-world applications of AI in product development. It discusses specific tools and strategies like critique loops that can be actionable, though it lacks detailed frameworks for implementation.","\u002Fsummaries\u002Fshopify-s-ai-surge-custom-tools-beat-hype-summary","2026-04-23 19:37:19","2026-04-26 17:23:18",{"title":4659,"description":43},{"loc":4841},"0135fe82d9bd61d6","Latent Space (Swyx + Alessio)","https:\u002F\u002Fwww.latent.space\u002Fp\u002Fshopify","summaries\u002Fshopify-s-ai-surge-custom-tools-beat-hype-summary",[107,108,109,110],"Shopify CTO Mikhail Parakhin details near-100% internal AI adoption post-Dec 2024, unlimited Opus-4.6 tokens, and tools like Tangle, Tangent, SimGym that make ML reproducible, auto-optimized, and customer-simulatable—revealing review loops and CI\u002FCD as true agent bottlenecks.",[109,110],"wsfVpTIWf_SvlYxi7oGsXd-rb1US3LlVSzRmfNj6yRo",{"id":4855,"title":4856,"ai":4857,"body":4862,"categories":5000,"created_at":50,"date_modified":50,"description":5001,"extension":51,"faq":50,"featured":52,"kicker_label":50,"meta":5002,"navigation":95,"path":5003,"published_at":5004,"question":50,"scraped_at":5005,"seo":5006,"sitemap":5007,"source_id":5008,"source_name":5009,"source_type":5010,"source_url":5011,"stem":5012,"tags":5013,"thumbnail_url":50,"tldr":5014,"tweet":50,"unknown_tags":5015,"__hash__":5016},"summaries\u002Fsummaries\u002Fmulti-team-agents-crush-single-agents-in-productio-summary.md","Multi-Team Agents Crush Single Agents in Production Coding",{"provider":7,"model":8,"input_tokens":4858,"output_tokens":4859,"processing_time_ms":4860,"cost_usd":4861},8336,2417,24343,0.0028532,{"type":14,"value":4863,"toc":4992},[4864,4868,4871,4874,4877,4881,4884,4887,4890,4893,4897,4905,4908,4911,4914,4918,4921,4928,4939,4942,4945,4949,4952,4955,4958,4961,4963],[17,4865,4867],{"id":4866},"single-agents-fail-at-scaleteams-dominate-production-workloads","Single Agents Fail at Scale—Teams Dominate Production Workloads",[22,4869,4870],{},"You've hit the wall with one-off agents: they forget context, overstep domains, and underperform on complex codebases. The fix? A 3-tier hierarchy: an orchestrator routes tasks to specialized team leads (planning, engineering, validation), who delegate to workers (backend dev, QA engineer, security reviewer). This mirrors human teams, yielding consistent, high-quality outputs.",[22,4872,4873],{},"In the demo, a simple \"present tree structure\" ping cascades: orchestrator pings leads → engineering lead delegates to frontend\u002Fbackend devs → workers analyze files → lead synthesizes → orchestrator summarizes. Total cost tracks in real-time (orchestrator + leads + workers). Trade-off: higher upfront token spend (e.g., loading full context), but 18 minutes of work yields precise file trees without manual intervention.",[22,4875,4876],{},"\"One agent is not enough. Multi-agent orchestration and tools like Clawude Code are the current frontier. But today, I want to show you a system that pushes beyond cloud code.\" — IndyDevDan introduces the thesis, emphasizing evolution from single agents to outperforming human coworkers by 2026.",[17,4878,4880],{"id":4879},"persistent-mental-models-turn-agents-into-experts","Persistent Mental Models Turn Agents into Experts",[22,4882,4883],{},"Agents boot with loaded \"expertise\" files—personal mental models that grow across sessions. Every run, they read conversation logs, update notes on codebase quirks, tools, and past decisions. This compounds: workers specialize (e.g., backend dev recalls scikit-learn patterns), leads coordinate without reinventing wheels.",[22,4885,4886],{},"Orchestrator and leads cap expertise at 10k lines (scalable to 1M-token windows). Workers stay verbose for code details; leads use \"conversational response\" skills for concise summaries. Result: agents outperform generic prompts because they \"remember every time this agent boots up, it's going to load from its expertise file.\"",[22,4888,4889],{},"\"Every time you run your team, they're all taking notes. They're all building up their mental model. And then they're loading it at the beginning.\" — Explaining how expertise stacking creates compounding advantages over stateless agents.",[22,4891,4892],{},"Trade-offs: Mental models risk bloat (mitigated by max lines); requires PI agent harness for persistence (not native in Claude Code). But for production, this beats one-shot agents: engineering team auto-loads memory for file ops, hitting high context without prompting.",[17,4894,4896],{"id":4895},"domain-locks-and-zero-micromanagement-enforce-specialization","Domain Locks and Zero-Micromanagement Enforce Specialization",[22,4898,4899,4900,4904],{},"Domains restrict access: planners read codebase\u002F** but can't write (delegate updates); engineering lead reads .py\u002F",[4901,4902,4903],"strong",{},", updates own expertise\u002F"," only. Hooks integrate with PI\u002FClaude Code for enforcement. Leads have \"zero micromanagement\" skill: \"Delegate, never execute.\"",[22,4906,4907],{},"Orchestrator delegates via custom tool, injecting team YAML dynamically into prompts. All agents are \"active listeners\"—read full conversation JSON before responding. Config via multi-team.yaml: paths to prompts, models (Opus for orchestrator, tiered for workers), colors for chat UI.",[22,4909,4910],{},"This prevents hallucinations: engineering lead detects no frontend perms, delegates correctly. In large repos (thousands of files), subdomain agents (e.g., data-science only) scale without chaos.",[22,4912,4913],{},"\"We're not afraid to spend to win here. We're not afraid to give our agents all the relevant context they need.\" — On leveraging 1M-token windows for full codebase + convo loads, a massive edge if you're not cost-minmaxing.",[17,4915,4917],{"id":4916},"prompt-routing-demo-agents-build-cost-optimizers-autonomously","Prompt Routing Demo: Agents Build Cost Optimizers Autonomously",[22,4919,4920],{},"Target: prompt-complexity classifier for LLM apps (route simple prompts to cheap models like Haiku, complex to Sonnet\u002FOpus). Existing sklearn baseline predicts \"medium\" for \"summarize codebase\" (100% conf).",[22,4922,4923,4924,4927],{},"Task: \"Ask all teams for two additional sklearn classifiers.\" Orchestrator broadcasts identical prompts → leads delegate (engineering to backend; validation to QA\u002Fsecurity) → consensus on LinearSVC + ComplementNB (skip others). Then: \"Plan, engineer, validate—add ",[4539,4925,4926],{},"just prompt-both"," commands.\"",[22,4929,4930,4931,4934,4935,4938],{},"Flow: Planning lead loads full context → engineers implement (backend runs evals) → QA flags issues (e.g., key errors), security says \"ship it\" → orchestrator summarizes. New ",[4539,4932,4933],{},"just predict-both"," agrees on \"mid\" routing; ",[4539,4936,4937],{},"just head-to-head"," evals holdout data.",[22,4940,4941],{},"18 minutes: full lifecycle—plan, code, test, validate. Multiple perspectives catch bugs single agents miss (QA vs. security). Costs tick up but deliver production-ready code.",[22,4943,4944],{},"No metrics like \"40% faster,\" but qualitative: unanimous picks, split recs with rationale (engineering favors SGD). Replicable in your repo via PI harness.",[17,4946,4948],{"id":4947},"config-driven-customization-scales-teams-effortlessly","Config-Driven Customization Scales Teams Effortlessly",[22,4950,4951],{},"PI harness > Claude Code: full-folder customization (skills\u002F, agents\u002F, expertise\u002F). YAML defines teams (orchestrator → planning\u002Fengineering\u002Fvalidation → members). System prompts inject vars: {teams}, {session_dir}, {tools}. Skills shared (delegate, mental_model_update).",[22,4953,4954],{},"Orchestrator prompt: lists all skills\u002Ftools\u002Fdomains. Workers verbose; leads concise. Hooks for pre\u002Fpost-actions. Evolve: copy YAML, tweak teams (drop frontend for backend-heavy repos).",[22,4956,4957],{},"Converging trends: 1M contexts + expertise + harness = \"far away from the normal distribution of results.\" Not for cheapskates—optimized for results in mid\u002Flarge codebases.",[22,4959,4960],{},"\"You always want to be thinking about where the ball is going, not where it is.\" — On stacking large contexts, agent learning, and custom harnesses for future-proof systems.",[17,4962,4754],{"id":4753},[4756,4964,4965,4968,4971,4974,4977,4980,4983,4986,4989],{},[4759,4966,4967],{},"Bootstrap multi-team YAML: orchestrator (Opus) → 3 leads (planning\u002Feng\u002Fvalidate) → 5-10 workers; use PI harness for chat UI.",[4759,4969,4970],{},"Mandate expertise files: agents load\u002Fupdate mental models on boot—grows expertise over sessions.",[4759,4972,4973],{},"Lock domains: read\u002Fwrite perms per dir (e.g., planners read-only codebase); enforce via skills\u002Fhooks.",[4759,4975,4976],{},"Inject dynamic vars into prompts: {teams}, {convo_log} for awareness without manual chaining.",[4759,4978,4979],{},"Tier models: high-intel orchestrator\u002Fleads, cheap workers; classify prompts to route dynamically.",[4759,4981,4982],{},"Always delegate: zero-micromanagement skill for leads—orchestrator routes, leads subdivide.",[4759,4984,4985],{},"Active listen everywhere: read full JSON convo before responding for context-rich teams.",[4759,4987,4988],{},"Test via evals: build head-to-head benchmarks (e.g., sklearn classifiers on holdout data).",[4759,4990,4991],{},"Spend on context: 1M tokens unlock full-repo loads—beats token-pinching for production wins.",{"title":43,"searchDepth":44,"depth":44,"links":4993},[4994,4995,4996,4997,4998,4999],{"id":4866,"depth":44,"text":4867},{"id":4879,"depth":44,"text":4880},{"id":4895,"depth":44,"text":4896},{"id":4916,"depth":44,"text":4917},{"id":4947,"depth":44,"text":4948},{"id":4753,"depth":44,"text":4754},[],"One agent is a CEILING and most engineers don't even realize they've hit it. If you're still re-prompting a single AI coding agent over and over, YOU are the orchestrator and that's the problem.\n\n🚀 MASTER AGENTIC CODING\nUnlock your Teams of Agents:  https:\u002F\u002Fagenticengineer.com\u002Ftactical-agentic-coding?y=M30gp1315Y4\n\n⭐️ RESOURCES FOR YOU\n\n- CEO Agents: https:\u002F\u002Fyoutu.be\u002FTqjmTZRL31E\n- Pi Vs Claude Code: https:\u002F\u002Fyoutu.be\u002Ff8cfH5XX-XU\n- Pi Coding Agent: https:\u002F\u002Fpi.dev\u002F\n\nI built a multi-agent chat room where I type one message and 9 specialized agents across 3 teams spin up, decompose the task, build the feature, and validate the results — all while I watch in real time. No babysitting. No manual coordination. Just pure multi-agent orchestration doing what a single Claude Code instance never could.\n\n🔥 In this video, I'm breaking down the 6 pillars of multi-agent team orchestration — the exact architecture that turns agentic coding from a solo act into a coordinated team sport. You'll see team leads decomposing tasks and delegating to specialized workers, domain ownership enforcement that keeps blast radius at absolute zero, and agent memory that makes your AI coding agents smarter with every single session. This isn't a slide deck. This is a working prototype.\n\n🛠️ The 6 pillars driving this multi-agent architecture:\n\n- Team Leads and Workers — a 3-tier hierarchy that removes YOU as the bottleneck\n- Expertise and Specialization — specialized agents make expert decisions while generalist agents make mediocre ones\n- Agent Memory — persistent mental models that compound intelligence over time\n- Domain Ownership — boundary enforcement that makes full agent autonomy safe\n- Chat Room Interface — the coordination primitive where agent teams communicate, delegate, and report back\n- Configuration-Driven Harness — your entire multi-agent coding setup defined in a single YAML config file\n\n🚀 The key moments that will change how you think about agentic coding: watching 9 config-driven agents fire up from a single message, seeing an agent get REJECTED from touching another team's code, and the YAML reveal showing the complete multi-agent architecture in one config. 2 teams, 3 members each, 9 agents pulling from 1M tokens each — all working for YOU.\n\n💡 Here's my prediction: by the end of 2026, engineers still coding with a single AI agent will be behind. Not because the models got worse — because everyone around them figured out how to run agent teams. Multi-agent orchestration is the frontier of agentic coding right now. Claude Code, CMUX, and the tools are here. The engineers who build these patterns NOW get the asymmetric advantage. Whether you're scaling beyond a single context window or looking for a concrete framework to orchestrate specialized agents across your codebase — this is your blueprint.\n\nStay focused and Keep Building.\n- Dan\n\n📖 Chapters\n\n00:00 One Agent is NOT ENOUGH\n01:30 Your Teams Of Agents\n11:05 Manging Teams of Agents\n17:01 Agents That Work Together\n31:10 Tactical Agentic Coding\n\n#agenticengineering #agenticcoding #aiagents",{},"\u002Fsummaries\u002Fmulti-team-agents-crush-single-agents-in-productio-summary","2026-03-30 13:00:00","2026-04-03 21:12:32",{"title":4856,"description":5001},{"loc":5003},"7d1265c64c98e6c8","IndyDevDan","video","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=M30gp1315Y4","summaries\u002Fmulti-team-agents-crush-single-agents-in-productio-summary",[108,107,109,110],"For mid-to-large codebases, deploy 3-tier agent teams—orchestrator, leads, workers—with persistent mental models and domain locks to outperform solo agents and Claude Code.",[109,110],"umIb3VAvBvd-k1CTHd1g8ZcYlGxLtiY8EXk5UQxOLPQ",{"id":5018,"title":5019,"ai":5020,"body":5025,"categories":5115,"created_at":50,"date_modified":50,"description":43,"extension":51,"faq":50,"featured":52,"kicker_label":50,"meta":5116,"navigation":95,"path":5132,"published_at":5133,"question":50,"scraped_at":5134,"seo":5135,"sitemap":5136,"source_id":5137,"source_name":5138,"source_type":103,"source_url":5139,"stem":5140,"tags":5141,"thumbnail_url":50,"tldr":5142,"tweet":50,"unknown_tags":5143,"__hash__":5144},"summaries\u002Fsummaries\u002Fkarpathy-agents-flip-coding-to-loopy-autonomy-summary.md","Karpathy: Agents Flip Coding to Loopy Autonomy",{"provider":7,"model":8,"input_tokens":5021,"output_tokens":5022,"processing_time_ms":5023,"cost_usd":5024},8720,2492,22485,0.00296735,{"type":14,"value":5026,"toc":5109},[5027,5031,5034,5037,5040,5044,5047,5050,5053,5056,5060,5063,5066,5069,5072,5075,5077],[17,5028,5030],{"id":5029},"delegating-code-to-macro-actions-unlocks-solo-builder-scale","Delegating Code to Macro Actions Unlocks Solo Builder Scale",[22,5032,5033],{},"Andrej Karpathy hasn't typed a line of code since December, shifting from 80\u002F20 manual-to-agent coding to near-total delegation. He describes his workflow as \"expressing my will to my agents for 16 hours a day,\" orchestrating multiple sessions across tools like Claude, Codex, and agent harnesses. The key unlock: macro actions over repositories, where one agent handles a full feature while others research or plan in parallel.",[22,5035,5036],{},"\"I don't think I've typed like a line of code probably since December basically,\" Karpathy tells Sarah Guo. He credits this to setups like Peter Steinberg's OpenClaw, which runs 10 repos simultaneously, each agent taking 20 minutes on high-effort prompts. Review only what's critical; the rest ships. Trade-off: You're now token-bound, not compute-bound—nervous if subscriptions aren't maxed, akin to idle GPUs in PhD days. Mastery means parallelizing tasks: \"If you have access to more tokens, then like I should just parallelize, add more tasks.\"",[22,5038,5039],{},"Karpathy pushes boundaries by running agents non-interactively, optimizing instructions via an agents.md file, adding memory tools, and refining prompts. Everyone feels \"skill issue\" when agents fail—better instructions or tools fix it. Guo notes teams where engineers whisper to mic'd agents, no keyboards: \"I thought they were crazy and now I fully accept this was the way.\"",[17,5041,5043],{"id":5042},"persistent-claws-replace-apps-with-natural-language-glue","Persistent Claws Replace Apps with Natural Language Glue",[22,5045,5046],{},"Karpathy built \"Dobby the elf claw,\" a WhatsApp-interfaced agent controlling his home: Sonos music, lights, HVAC, pool, spa, security cams. In three prompts, it IP-scanned his network, reverse-engineered APIs (no passwords needed), built a dashboard, and executed commands like \"sleepy time\" to kill all lights. A Qwen model detects motion, texts alerts: \"FedEx truck just pulled up.\"",[22,5048,5049],{},"This unifies six apps into one natural language portal, exposing why bespoke UIs overproduce friction. \"These apps that are in the app store for using these smart home devices etc. shouldn't even exist,\" Karpathy argues. Future: Pure APIs for agent glue, no human UIs—the customer becomes the agent. His treadmill logging? Agents pull data directly, no logins.",[22,5051,5052],{},"Personality sells it: OpenClaw's \"soul and D document\" crafts a compelling teammate—upbeat like Claude (which dials psychopathy so praise feels earned), unlike dry Codex. \"When Claude gives me praise I do feel like I slightly deserve it.\" Security holds back deeper integration (email\u002Fcalendar), but barriers drop fast: \"This is trivial... any AI even the open source models etc can like do this.\"",[22,5054,5055],{},"\"I can't believe I just typed in like, 'Can you find my Sonos?' And that suddenly it's playing music,\" Karpathy marvels. Ephemeral software emerges: Claws sandbox-loop without oversight, presenting UIs on demand.",[17,5057,5059],{"id":5058},"autoresearch-enables-agentic-loops-for-llm-self-improvement","AutoResearch Enables Agentic Loops for LLM Self-Improvement",[22,5061,5062],{},"Karpathy's AutoResearch removes humans from AI research: Give agents an objective, metric, boundaries—then hit go. It designs experiments, collects data, trains, optimizes nanoGPT-like models recursively. He tuned nanoGPT manually for decades (hyperparameter sweeps, thousands of runs), hitting a plateau—AutoResearch beat it autonomously.",[22,5064,5065],{},"Motivation: \"To get the most out of the tools... you have to remove yourself as the bottleneck.\" Maximize leverage—few upfront tokens, massive output. Implications scale to frontier labs chasing recursive self-improvement. nanoGPT is his playground for LLM-training harnesses, testing agent loops.",[22,5067,5068],{},"\"The name of the game now is to increase your leverage... how can you get more agents running for longer periods of time without your involvement,\" Karpathy says. He was shocked it worked: Agents close the full loop, from ideation to better models.",[22,5070,5071],{},"Broader: This sparks \"model speciation\"—specialized models per task. Jobs shift to agent orchestration; education via MicroGPT-like agent tutors. Robotics next: Agents reach physical loops. Open vs. closed models? Open wins collaboration.",[22,5073,5074],{},"\"Everything like so many things even if they don't work I think to a large extent you feel like it's skill issue. It's not that the capability is not there.\"",[17,5076,4754],{"id":4753},[4756,5078,5079,5082,5085,5088,5091,5094,5097,5100,5103,5106],{},[4759,5080,5081],{},"Orchestrate macro actions: Delegate full features to parallel agents across repos; review selectively to scale solo building.",[4759,5083,5084],{},"Build claws for persistence: Use sophisticated memory, personalities, and sandboxes for looping tasks without interactivity—start with home APIs.",[4759,5086,5087],{},"Maximize token throughput: Treat unused subscriptions like idle GPUs; parallelize ruthlessly to unbound your leverage.",[4759,5089,5090],{},"Expose APIs, ditch UIs: Agents glue hardware\u002Fsoftware; bespoke apps die as natural language becomes the interface.",[4759,5092,5093],{},"Run autonomous loops like AutoResearch: Set objective\u002Fmetric\u002Fboundaries for agents to self-improve LLMs—humans set initial conditions only.",[4759,5095,5096],{},"Refine agent personality: Craft souls that feel like teammates; earned praise boosts collaboration.",[4759,5098,5099],{},"Push to multi-agent teams: Mastery is claw swarms optimizing instructions\u002Fmemory\u002Ftools collaboratively.",[4759,5101,5102],{},"Refactor for agent customers: Industry pivots to agent-first web\u002Ftools; humans vibe-code minimally today, zero tomorrow.",[4759,5104,5105],{},"Evaluate by skill issue: Agent failures signal better prompting\u002Fmemory—not capability limits.",[4759,5107,5108],{},"Speculate on speciation: Task-specific models emerge from recursive loops, accelerating via open collaboration.",{"title":43,"searchDepth":44,"depth":44,"links":5110},[5111,5112,5113,5114],{"id":5029,"depth":44,"text":5030},{"id":5042,"depth":44,"text":5043},{"id":5058,"depth":44,"text":5059},{"id":4753,"depth":44,"text":4754},[],{"content_references":5117,"triage":5130},[5118,5121,5124,5126,5128],{"type":86,"title":5119,"author":5120,"context":4619},"OpenClaw","Peter Steinberg",{"type":86,"title":5122,"author":5123,"context":4619},"AutoResearch","Andrej Karpathy",{"type":86,"title":5125,"author":5123,"context":4619},"nanoGPT",{"type":86,"title":5127,"context":4619},"Claude",{"type":86,"title":5129,"context":4619},"Codex",{"relevance":91,"novelty":92,"quality":92,"actionability":92,"composite":4642,"reasoning":5131},"Category: AI Automation. The article discusses practical applications of AI agents in coding and automation, addressing the audience's pain point of maximizing productivity through delegation. Karpathy's approach to using agents for coding and home automation provides actionable insights into how builders can leverage AI to enhance their workflows.","\u002Fsummaries\u002Fkarpathy-agents-flip-coding-to-loopy-autonomy-summary","2026-03-20 13:27:35","2026-04-19 01:20:30",{"title":5019,"description":43},{"loc":5132},"da9ba1a5d3d118cd","AI Summaries (evaluation playlist)","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=kwSVtQ7dziU","summaries\u002Fkarpathy-agents-flip-coding-to-loopy-autonomy-summary",[108,107,109,110],"Andrej Karpathy delegates all coding to agents, builds persistent 'claws' for home automation, and demos AutoResearch where AI agents autonomously run experiments to improve LLMs—maximizing token throughput without human loops.",[109,110],"QLP0j_IdgF1NbPlDM8zgg__2XhqI52kfM7BFu5Gj5VI"]