[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"summary-e94ca77e549bd19e-reliability-and-safety-in-production-voice-agents-summary":3,"summaries-facets-categories":128,"summary-related-e94ca77e549bd19e-reliability-and-safety-in-production-voice-agents-summary":7506},{"id":4,"title":5,"ai":6,"body":13,"categories":90,"created_at":92,"date_modified":92,"description":84,"extension":93,"faq":92,"featured":94,"kicker_label":92,"meta":95,"navigation":107,"path":108,"published_at":109,"question":92,"scraped_at":110,"seo":111,"sitemap":112,"source_id":113,"source_name":114,"source_type":115,"source_url":116,"stem":117,"tags":118,"thumbnail_url":123,"tldr":124,"tweet":125,"unknown_tags":126,"__hash__":127},"summaries\u002Fsummaries\u002Fe94ca77e549bd19e-reliability-and-safety-in-production-voice-agents-summary.md","Reliability and Safety in Production Voice Agents",{"provider":7,"model":8,"input_tokens":9,"output_tokens":10,"processing_time_ms":11,"cost_usd":12},"openrouter","google\u002Fgemini-3.1-flash-lite",6805,663,3810,0.00269575,{"type":14,"value":15,"toc":83},"minimark",[16,21,25,29,32,55,59,62],[17,18,20],"h2",{"id":19},"the-reliability-gap-in-voice-agents","The Reliability Gap in Voice Agents",[22,23,24],"p",{},"Voice agents are moving from demos to production, but they suffer from a significant reliability gap. While they sound natural and confident, they frequently provide incorrect information or fail to execute tasks correctly. Unlike crime, which is hyper-local and decentralized, voice agent deployments are centralized; a single prompt or architectural change can propagate errors to millions of users simultaneously. With an estimated trillion phone calls annually, even a 1% error rate results in 10 billion incidents. In practice, monitoring 10,000 agents reveals an error rate closer to 10%.",[17,26,28],{"id":27},"a-framework-for-systematic-improvement","A Framework for Systematic Improvement",[22,30,31],{},"To manage these risks, teams must move beyond simple \"fix-and-deploy\" cycles toward a structured observability loop:",[33,34,35,43,49],"ol",{},[36,37,38,42],"li",{},[39,40,41],"strong",{},"Identify & Prioritize:"," Categorize problems by frequency and severity. Use a matrix to distinguish between \"trash fires\" (annoying but low impact, like repetition) and \"P0\" systematic failures (e.g., failing to freeze a credit card or skipping eligibility checks).",[36,44,45,48],{},[39,46,47],{},"Manual to Automated Coverage:"," Start by listening to calls manually to build intuition. Scale this by creating rubrics for core logic, then transition to automated evaluation products that compute both deterministic and stochastic scores.",[36,50,51,54],{},[39,52,53],{},"Cross-Conversation Analysis:"," The most critical insights emerge not from single calls, but from patterns across thousands of conversations. Teams should look for emerging behaviors that are invisible when analyzing calls in isolation.",[17,56,58],{"id":57},"testing-and-adversarial-defense","Testing and Adversarial Defense",[22,60,61],{},"Fixing an agent is the easiest part of the pipeline; verifying the fix is the hardest. Naive testing—replaying a single failed call—is insufficient. Robust testing requires:",[63,64,65,71,77],"ul",{},[36,66,67,70],{},[39,68,69],{},"Synthetic Variation:"," Re-run failed scenarios while varying wording, accents, styles, and intent combinations to ensure the fix is generalized.",[36,72,73,76],{},[39,74,75],{},"AB Testing:"," For critical moments like the first five seconds of an outbound call, simulation is insufficient; live AB testing is the only way to validate performance.",[36,78,79,82],{},[39,80,81],{},"24\u002F7 Red Teaming:"," Adversarial testing is non-negotiable. Current red-teaming efforts can break roughly one in five agents, bypassing verification or extracting sensitive data. As agents gain more tool access and capability, the surface area for exploitation grows, necessitating continuous, automated adversarial testing.",{"title":84,"searchDepth":85,"depth":85,"links":86},"",2,[87,88,89],{"id":19,"depth":85,"text":20},{"id":27,"depth":85,"text":28},{"id":57,"depth":85,"text":58},[91],"AI & LLMs",null,"md",false,{"content_references":96,"triage":102},[97],{"type":98,"title":99,"url":100,"context":101},"tool","Hamming","https:\u002F\u002Fhamming.ai","recommended",{"relevance":103,"novelty":104,"quality":104,"actionability":104,"composite":105,"reasoning":106},5,4,4.35,"Category: AI & LLMs. The article addresses the reliability and safety of voice agents, a critical aspect for product builders in AI, particularly in production settings. It provides a structured framework for systematic improvement, which is actionable for teams looking to enhance their voice agent deployments.",true,"\u002Fsummaries\u002Fe94ca77e549bd19e-reliability-and-safety-in-production-voice-agents-summary","2026-09-15 15:00:06","2026-09-16 03:11:37",{"title":5,"description":84},{"loc":108},"e94ca77e549bd19e","AI Engineer","video","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=qStB9GbppMU","summaries\u002Fe94ca77e549bd19e-reliability-and-safety-in-production-voice-agents-summary",[119,120,121,122],"agents","automation","product-strategy","ai-llms","https:\u002F\u002Fi.ytimg.com\u002Fvi\u002FqStB9GbppMU\u002Fhqdefault.jpg","Voice agents are scaling rapidly, but with a ~10% error rate, their centralized nature creates massive blast radii. Success requires a rigorous loop of manual evaluation, cross-call pattern analysis, and continuous red teaming.","This talk outlines a framework for managing voice agent reliability by treating production errors as a systematic engineering problem rather than isolated glitches. The speaker advocates for a continuous loop of adversarial testing and cross-conversation analysis to mitigate the high \"blast radius\" of centralized AI deployments, as offered by [Hamming AI](https:\u002F\u002Fhamming.ai).",[122],"xUvtPghP_p_33u1nfb3NFBi8kHrNwrpGqfazGemGAsw",[129,131,134,136,139,141,144,147,149,151,153,155,158,161,163,165,167,169,172,174,176,178,180,183,185,187,189,191,193,195,197,199,201,203,205,207,209,211,213,215,217,219,221,223,225,227,229,231,233,235,238,240,242,244,246,248,250,252,254,256,258,260,262,264,266,269,271,273,275,277,279,281,283,285,287,289,291,293,295,297,299,301,303,305,307,310,312,314,316,318,320,322,324,326,328,330,332,334,336,338,340,342,345,347,349,351,353,355,357,359,361,363,365,367,369,371,373,375,377,379,381,383,385,387,389,391,393,395,397,399,401,403,405,407,409,411,413,416,418,420,422,424,426,428,430,432,434,436,439,441,443,445,447,449,451,453,455,457,459,461,463,465,467,469,472,474,476,478,480,482,484,486,488,490,492,494,497,499,501,503,505,507,509,511,513,515,517,519,521,523,525,527,529,531,533,535,537,539,541,543,545,547,549,551,553,555,557,559,561,563,566,568,570,573,575,577,579,581,583,585,587,589,591,593,595,597,599,601,603,605,607,609,612,614,616,618,620,622,624,626,628,630,632,634,636,639,641,643,645,647,649,651,653,655,657,659,661,663,665,667,669,671,673,675,677,679,681,683,685,687,689,691,693,695,697,699,701,703,705,707,709,711,713,715,717,719,721,723,725,727,729,731,733,735,737,739,741,743,745,747,749,751,753,755,757,759,761,763,765,767,769,771,773,775,777,779,781,783,785,787,789,791,793,795,797,799,801,803,805,807,809,811,813,815,817,819,821,823,825,827,829,831,833,835,837,839,841,843,845,847,849,851,853,855,857,859,861,863,865,867,869,871,873,875,877,879,881,883,885,887,889,891,893,895,897,899,901,903,905,907,909,911,913,915,917,919,921,923,925,927,929,931,933,935,938,940,942,944,946,949,951,953,955,957,959,961,963,965,967,969,971,973,975,978,980,982,984,986,988,990,992,994,996,998,1000,1002,1004,1006,1008,1010,1012,1014,1016,1018,1020,1022,1024,1026,1028,1030,1032,1034,1036,1038,1040,1042,1044,1046,1048,1050,1052,1054,1056,1058,1060,1062,1064,1066,1068,1070,1072,1074,1076,1078,1080,1082,1084,1086,1088,1090,1092,1094,1096,1098,1100,1102,1104,1106,1108,1110,1112,1114,1116,1118,1120,1122,1124,1126,1128,1130,1132,1134,1136,1138,1140,1142,1144,1146,1148,1150,1152,1154,1156,1158,1160,1162,1164,1166,1168,1170,1172,1174,1176,1178,1180,1182,1184,1186,1188,1190,1192,1194,1196,1198,1200,1202,1204,1206,1208,1210,1212,1214,1216,1218,1220,1222,1224,1226,1228,1230,1232,1234,1236,1238,1240,1242,1244,1246,1248,1250,1252,1254,1256,1258,1260,1262,1264,1266,1268,1270,1272,1274,1276,1278,1280,1282,1284,1286,1288,1290,1292,1294,1296,1298,1300,1302,1304,1306,1308,1310,1312,1314,1316,1319,1321,1323,1325,1327,1329,1331,1333,1335,1337,1339,1341,1343,1345,1347,1349,1351,1353,1355,1357,1359,1361,1363,1365,1367,1369,1371,1373,1375,1377,1379,1381,1383,1385,1387,1389,1391,1393,1395,1397,1399,1401,1403,1405,1407,1409,1411,1413,1415,1417,1419,1421,1423,1425,1427,1429,1431,1433,1435,1437,1439,1441,1443,1445,1447,1449,1451,1453,1455,1457,1459,1461,1463,1465,1467,1469,1471,1473,1475,1477,1479,1481,1483,1485,1487,1489,1491,1493,1495,1497,1499,1501,1503,1505,1507,1509,1511,1513,1515,1517,1519,1521,1523,1525,1527,1529,1531,1533,1535,1537,1539,1542,1544,1546,1548,1550,1552,1554,1556,1558,1560,1562,1564,1566,1568,1570,1572,1574,1576,1578,1580,1582,1584,1586,1588,1590,1592,1594,1596,1598,1600,1602,1604,1606,1608,1610,1612,1614,1616,1618,1620,1622,1624,1626,1628,1630,1632,1634,1636,1638,1640,1642,1644,1646,1648,1650,1652,1654,1656,1658,1660,1662,1664,1666,1668,1670,1672,1674,1676,1678,1680,1682,1684,1686,1688,1690,1692,1694,1696,1699,1701,1703,1705,1707,1709,1711,1713,1715,1717,1719,1721,1723,1725,1727,1729,1731,1733,1735,1737,1739,1741,1743,1745,1747,1749,1751,1753,1755,1757,1759,1761,1763,1765,1767,1769,1771,1773,1775,1777,1779,1781,1783,1785,1787,1789,1791,1793,1795,1797,1799,1801,1803,1805,1807,1809,1811,1813,1815,1817,1819,1821,1823,1825,1827,1829,1831,1833,1835,1837,1839,1841,1843,1845,1847,1849,1851,1853,1855,1857,1859,1861,1863,1865,1868,1870,1872,1874,1876,1878,1880,1882,1884,1886,1888,1890,1892,1894,1896,1898,1900,1902,1904,1906,1908,1910,1912,1914,1916,1918,1920,1922,1924,1926,1928,1930,1932,1934,1937,1939,1941,1943,1945,1947,1949,1951,1953,1955,1957,1959,1961,1963,1965,1967,1969,1971,1973,1975,1977,1979,1981,1983,1985,1987,1989,1991,1993,1995,1997,1999,2001,2003,2005,2007,2009,2011,2013,2015,2017,2019,2021,2023,2025,2027,2029,2031,2033,2035,2037,2039,2041,2043,2045,2047,2049,2051,2053,2055,2057,2059,2061,2063,2065,2067,2069,2071,2073,2075,2077,2079,2081,2083,2085,2087,2089,2091,2093,2095,2097,2099,2101,2103,2105,2107,2109,2111,2113,2115,2117,2119,2121,2123,2125,2127,2129,2131,2133,2135,2137,2139,2141,2143,2145,2147,2149,2151,2153,2155,2157,2159,2161,2163,2165,2167,2169,2171,2173,2175,2177,2179,2181,2183,2185,2187,2189,2191,2193,2195,2197,2199,2201,2203,2205,2207,2209,2211,2213,2215,2217,2219,2221,2223,2225,2227,2229,2231,2233,2235,2237,2239,2241,2243,2245,2247,2249,2251,2253,2255,2257,2259,2261,2263,2265,2267,2269,2271,2273,2275,2277,2279,2281,2283,2285,2287,2289,2291,2293,2295,2297,2299,2301,2303,2305,2307,2309,2311,2313,2315,2317,2319,2321,2323,2325,2327,2329,2331,2333,2335,2337,2339,2341,2343,2345,2347,2349,2351,2353,2355,2357,2359,2361,2363,2365,2367,2369,2371,2373,2375,2377,2379,2381,2383,2385,2387,2389,2391,2393,2395,2397,2399,2401,2403,2405,2407,2409,2411,2413,2415,2417,2419,2422,2424,2426,2428,2430,2432,2434,2436,2438,2440,2442,2444,2446,2448,2450,2452,2454,2456,2458,2460,2462,2464,2466,2468,2470,2472,2474,2476,2478,2480,2482,2484,2486,2488,2490,2492,2494,2496,2498,2500,2502,2504,2506,2508,2510,2512,2514,2516,2518,2521,2523,2525,2527,2529,2531,2533,2535,2537,2539,2541,2543,2545,2547,2549,2551,2553,2555,2557,2559,2561,2563,2565,2567,2569,2571,2573,2575,2577,2579,2581,2583,2585,2587,2589,2591,2593,2595,2597,2599,2601,2603,2605,2607,2609,2611,2613,2615,2617,2619,2621,2623,2625,2627,2629,2631,2633,2635,2637,2639,2641,2643,2645,2648,2650,2652,2654,2656,2658,2660,2662,2664,2666,2668,2670,2672,2674,2676,2678,2680,2682,2684,2686,2688,2690,2692,2694,2697,2699,2701,2703,2705,2707,2709,2711,2713,2715,2717,2719,2721,2723,2725,2727,2729,2731,2733,2735,2737,2739,2741,2743,2745,2747,2749,2751,2753,2755,2757,2759,2761,2763,2765,2767,2769,2771,2773,2775,2777,2779,2781,2783,2785,2787,2789,2791,2793,2795,2797,2799,2801,2803,2805,2807,2809,2811,2813,2815,2817,2819,2821,2823,2825,2827,2829,2831,2833,2835,2837,2839,2841,2843,2845,2847,2849,2851,2853,2855,2857,2859,2861,2863,2865,2867,2869,2871,2873,2875,2877,2879,2881,2883,2885,2887,2889,2891,2893,2895,2897,2899,2901,2903,2905,2907,2909,2911,2913,2915,2917,2919,2921,2923,2925,2927,2929,2931,2933,2935,2937,2939,2941,2943,2945,2947,2949,2951,2953,2955,2957,2959,2961,2963,2965,2967,2969,2971,2973,2975,2977,2979,2981,2983,2985,2987,2989,2991,2993,2995,2997,2999,3001,3003,3005,3007,3009,3011,3013,3015,3017,3019,3021,3023,3025,3027,3029,3031,3033,3035,3037,3039,3041,3043,3045,3047,3049,3051,3053,3055,3057,3059,3061,3063,3065,3067,3069,3071,3073,3075,3077,3079,3081,3083,3085,3087,3089,3091,3093,3095,3097,3099,3101,3103,3105,3107,3109,3111,3113,3115,3117,3119,3121,3123,3125,3127,3129,3131,3133,3135,3137,3139,3141,3143,3145,3147,3149,3151,3153,3155,3157,3159,3161,3163,3165,3167,3169,3171,3173,3175,3177,3179,3181,3183,3185,3187,3189,3191,3193,3195,3197,3199,3201,3203,3205,3207,3209,3211,3213,3215,3217,3219,3221,3223,3225,3227,3229,3231,3233,3235,3237,3239,3241,3243,3245,3247,3249,3251,3253,3255,3257,3259,3261,3263,3265,3267,3269,3271,3273,3275,3277,3279,3281,3283,3285,3287,3289,3291,3293,3295,3297,3299,3301,3303,3305,3307,3309,3311,3313,3315,3317,3319,3321,3323,3325,3327,3329,3331,3333,3335,3337,3339,3341,3343,3345,3347,3349,3351,3353,3355,3357,3359,3361,3363,3365,3367,3369,3371,3373,3375,3378,3380,3382,3384,3386,3388,3390,3392,3394,3396,3398,3400,3402,3404,3406,3408,3410,3412,3414,3416,3418,3420,3422,3424,3426,3428,3430,3432,3434,3436,3438,3440,3442,3444,3446,3448,3450,3452,3454,3456,3458,3460,3462,3464,3466,3468,3470,3472,3474,3476,3478,3480,3482,3484,3486,3488,3490,3492,3494,3496,3498,3500,3502,3504,3506,3508,3511,3513,3515,3517,3519,3521,3523,3525,3527,3529,3531,3533,3535,3537,3539,3541,3543,3545,3547,3549,3551,3553,3555,3557,3559,3561,3563,3565,3567,3569,3571,3573,3575,3577,3579,3581,3583,3585,3587,3589,3591,3593,3595,3597,3599,3601,3603,3605,3607,3609,3611,3613,3615,3617,3619,3621,3623,3625,3627,3629,3631,3633,3635,3637,3639,3641,3643,3645,3647,3649,3651,3653,3655,3657,3659,3661,3663,3665,3667,3669,3671,3673,3675,3677,3679,3681,3683,3685,3687,3689,3691,3693,3695,3697,3699,3701,3703,3705,3707,3709,3711,3713,3715,3717,3719,3721,3723,3725,3727,3729,3731,3733,3735,3737,3739,3741,3743,3745,3747,3749,3751,3753,3755,3757,3759,3761,3763,3765,3767,3769,3771,3773,3775,3777,3779,3781,3783,3785,3787,3789,3791,3793,3795,3797,3799,3801,3803,3805,3807,3809,3811,3813,3815,3817,3819,3821,3823,3825,3827,3829,3831,3833,3835,3837,3839,3841,3843,3845,3847,3849,3851,3853,3855,3857,3859,3861,3863,3865,3867,3869,3871,3873,3875,3877,3879,3881,3883,3885,3887,3889,3891,3893,3895,3897,3899,3901,3903,3905,3907,3909,3911,3913,3915,3917,3919,3921,3923,3925,3927,3929,3931,3933,3935,3937,3939,3941,3943,3945,3947,3949,3951,3953,3955,3957,3959,3961,3963,3965,3967,3969,3971,3973,3975,3977,3979,3981,3983,3985,3987,3989,3991,3993,3995,3997,3999,4001,4003,4005,4007,4009,4011,4013,4015,4017,4019,4021,4023,4025,4027,4029,4031,4033,4035,4037,4039,4041,4043,4045,4047,4049,4051,4053,4055,4057,4059,4061,4063,4065,4067,4069,4071,4073,4075,4077,4079,4081,4083,4085,4087,4089,4091,4093,4095,4097,4099,4101,4103,4105,4107,4109,4111,4113,4115,4117,4119,4121,4123,4125,4127,4129,4131,4133,4135,4137,4139,4141,4143,4145,4147,4149,4151,4153,4155,4157,4159,4161,4163,4165,4167,4169,4171,4173,4175,4177,4179,4181,4183,4185,4187,4189,4191,4193,4195,4197,4199,4201,4203,4205,4207,4209,4211,4213,4215,4217,4219,4221,4223,4225,4227,4229,4231,4233,4235,4237,4239,4241,4243,4245,4247,4249,4251,4253,4255,4257,4259,4261,4263,4265,4267,4269,4271,4273,4275,4277,4279,4281,4283,4285,4287,4289,4291,4293,4295,4297,4299,4301,4303,4305,4307,4309,4311,4313,4315,4317,4319,4321,4323,4325,4327,4329,4331,4333,4335,4337,4339,4341,4343,4345,4347,4349,4351,4353,4355,4357,4359,4361,4363,4365,4367,4369,4371,4373,4375,4377,4379,4381,4383,4385,4387,4389,4391,4393,4395,4397,4399,4401,4403,4405,4407,4409,4411,4413,4415,4417,4419,4421,4423,4425,4427,4429,4431,4433,4435,4437,4439,4441,4443,4445,4447,4449,4451,4453,4455,4457,4459,4461,4463,4465,4467,4469,4471,4473,4475,4477,4479,4481,4483,4485,4487,4489,4491,4493,4495,4497,4499,4501,4503,4505,4507,4509,4511,4513,4515,4517,4519,4521,4523,4525,4527,4529,4531,4533,4535,4537,4539,4541,4543,4545,4547,4549,4551,4553,4555,4557,4559,4561,4563,4565,4567,4569,4571,4573,4575,4577,4579,4581,4583,4585,4587,4589,4591,4593,4595,4597,4599,4601,4603,4605,4607,4609,4611,4613,4615,4617,4619,4621,4623,4625,4627,4629,4631,4633,4635,4637,4639,4641,4643,4645,4647,4649,4651,4653,4655,4657,4659,4661,4663,4665,4667,4669,4671,4673,4675,4677,4679,4681,4683,4685,4687,4689,4691,4693,4695,4697,4699,4701,4703,4705,4707,4709,4711,4713,4715,4717,4719,4721,4723,4725,4727,4729,4731,4733,4735,4737,4739,4741,4743,4745,4747,4749,4751,4753,4755,4757,4759,4761,4763,4765,4767,4769,4771,4773,4775,4777,4779,4781,4783,4785,4787,4789,4791,4793,4795,4797,4799,4801,4803,4805,4807,4809,4811,4813,4815,4817,4819,4821,4823,4825,4827,4829,4831,4833,4835,4837,4839,4841,4843,4845,4847,4849,4851,4853,4855,4857,4859,4861,4863,4865,4867,4869,4871,4873,4875,4877,4879,4881,4883,4885,4887,4889,4891,4893,4895,4897,4899,4902,4904,4906,4908,4910,4912,4914,4916,4918,4920,4922,4924,4926,4928,4930,4932,4934,4936,4938,4940,4942,4944,4946,4948,4950,4952,4954,4956,4958,4960,4962,4964,4966,4968,4970,4972,4974,4976,4978,4980,4982,4984,4986,4988,4990,4992,4994,4996,4998,5000,5002,5004,5006,5008,5010,5012,5014,5016,5018,5020,5022,5024,5026,5028,5030,5032,5034,5036,5038,5040,5042,5044,5046,5048,5050,5052,5054,5056,5058,5060,5062,5064,5066,5068,5070,5072,5074,5076,5078,5080,5082,5084,5086,5088,5090,5092,5094,5096,5098,5100,5102,5104,5106,5108,5110,5112,5114,5116,5118,5120,5122,5124,5126,5128,5130,5132,5134,5136,5138,5140,5142,5144,5146,5148,5150,5152,5154,5156,5158,5160,5162,5164,5166,5168,5170,5172,5174,5176,5178,5180,5182,5184,5186,5188,5190,5192,5194,5196,5198,5200,5202,5204,5206,5208,5210,5212,5214,5216,5218,5220,5222,5224,5226,5228,5230,5232,5234,5236,5238,5240,5242,5244,5246,5248,5250,5252,5254,5256,5258,5260,5262,5264,5266,5268,5270,5272,5274,5276,5278,5280,5282,5284,5286,5288,5290,5292,5294,5296,5298,5300,5302,5304,5306,5308,5310,5312,5314,5316,5318,5320,5322,5324,5326,5328,5330,5332,5334,5336,5338,5340,5342,5344,5346,5348,5350,5352,5354,5356,5358,5360,5362,5364,5366,5368,5370,5372,5374,5376,5378,5380,5382,5384,5386,5388,5390,5392,5394,5396,5398,5400,5402,5404,5406,5408,5410,5412,5414,5416,5418,5420,5422,5424,5426,5428,5430,5432,5434,5436,5438,5440,5442,5444,5446,5448,5450,5452,5454,5456,5458,5460,5462,5464,5466,5468,5470,5472,5474,5476,5478,5480,5482,5484,5486,5488,5490,5492,5494,5496,5498,5500,5502,5504,5506,5508,5510,5512,5514,5516,5518,5520,5522,5524,5526,5528,5530,5532,5534,5536,5538,5540,5542,5544,5546,5548,5550,5552,5554,5556,5558,5560,5562,5564,5566,5568,5570,5572,5574,5576,5578,5580,5582,5584,5586,5588,5590,5592,5594,5596,5598,5600,5602,5604,5606,5608,5610,5612,5614,5616,5618,5620,5622,5624,5626,5628,5630,5632,5634,5636,5638,5640,5642,5644,5646,5648,5650,5652,5654,5656,5658,5660,5662,5664,5666,5668,5670,5672,5674,5676,5678,5680,5682,5684,5686,5688,5690,5692,5694,5696,5698,5700,5702,5704,5706,5708,5710,5712,5714,5716,5718,5720,5722,5724,5726,5728,5730,5732,5734,5736,5738,5740,5742,5744,5746,5748,5750,5752,5754,5756,5758,5760,5762,5764,5766,5768,5770,5772,5774,5776,5778,5780,5782,5784,5786,5788,5790,5792,5794,5796,5798,5800,5803,5805,5807,5809,5811,5813,5815,5817,5819,5821,5823,5825,5827,5829,5831,5833,5835,5837,5839,5841,5843,5845,5847,5849,5851,5853,5855,5857,5859,5861,5863,5865,5867,5869,5871,5873,5875,5877,5879,5881,5883,5885,5887,5889,5891,5893,5895,5897,5899,5901,5903,5905,5907,5909,5911,5913,5915,5917,5919,5921,5923,5925,5927,5929,5931,5933,5935,5937,5939,5941,5943,5945,5947,5949,5951,5953,5955,5957,5959,5961,5963,5965,5967,5969,5971,5973,5975,5977,5979,5981,5983,5985,5987,5989,5991,5993,5995,5997,5999,6001,6003,6005,6007,6009,6011,6013,6015,6018,6020,6022,6024,6026,6028,6030,6032,6034,6036,6038,6040,6042,6044,6046,6048,6050,6052,6054,6056,6058,6060,6062,6064,6066,6068,6070,6072,6074,6076,6078,6080,6082,6084,6086,6088,6090,6092,6094,6096,6098,6100,6102,6104,6106,6108,6110,6112,6114,6116,6118,6120,6122,6124,6126,6128,6130,6132,6134,6136,6138,6140,6142,6144,6146,6148,6150,6152,6154,6156,6158,6160,6162,6164,6166,6168,6170,6172,6174,6176,6178,6180,6182,6184,6186,6188,6190,6192,6194,6196,6198,6200,6202,6204,6206,6208,6210,6212,6214,6216,6218,6220,6222,6224,6226,6228,6230,6232,6234,6236,6238,6240,6242,6244,6246,6248,6250,6252,6254,6256,6258,6260,6262,6264,6266,6268,6270,6272,6274,6276,6278,6280,6282,6284,6286,6288,6290,6292,6294,6296,6298,6300,6302,6304,6306,6308,6310,6312,6314,6316,6318,6320,6322,6324,6326,6328,6330,6332,6334,6336,6338,6340,6342,6344,6346,6348,6350,6352,6354,6356,6358,6360,6362,6364,6366,6368,6370,6372,6374,6376,6378,6380,6382,6384,6386,6388,6390,6392,6394,6396,6398,6400,6402,6404,6406,6408,6410,6412,6414,6416,6418,6420,6422,6424,6426,6428,6430,6432,6434,6436,6438,6440,6442,6444,6446,6448,6450,6452,6454,6456,6458,6460,6462,6464,6466,6468,6470,6472,6474,6476,6478,6480,6482,6484,6486,6488,6490,6492,6494,6496,6498,6500,6502,6504,6506,6508,6510,6512,6514,6516,6518,6520,6522,6524,6526,6528,6530,6532,6534,6536,6538,6540,6542,6544,6546,6548,6550,6552,6554,6556,6558,6560,6562,6564,6566,6568,6570,6572,6574,6576,6578,6580,6582,6584,6586,6588,6590,6592,6594,6596,6598,6600,6602,6604,6606,6608,6610,6612,6614,6616,6618,6620,6622,6624,6626,6628,6630,6632,6634,6636,6638,6640,6642,6644,6646,6648,6650,6652,6654,6656,6658,6660,6662,6664,6666,6668,6670,6672,6674,6676,6678,6680,6682,6684,6686,6688,6690,6692,6694,6696,6698,6700,6702,6704,6706,6708,6710,6712,6714,6716,6718,6720,6722,6724,6726,6728,6730,6732,6734,6736,6738,6740,6742,6744,6746,6748,6750,6752,6754,6756,6758,6760,6762,6764,6766,6768,6770,6772,6774,6776,6778,6780,6782,6784,6786,6788,6790,6792,6794,6796,6798,6800,6802,6804,6806,6808,6810,6812,6814,6816,6818,6820,6822,6824,6826,6828,6830,6832,6834,6836,6838,6840,6842,6844,6846,6848,6850,6852,6854,6856,6858,6860,6862,6864,6866,6868,6870,6872,6874,6876,6878,6880,6882,6884,6886,6888,6890,6892,6894,6896,6898,6900,6902,6904,6906,6908,6910,6912,6914,6916,6918,6920,6922,6924,6926,6928,6930,6932,6934,6936,6938,6940,6942,6944,6946,6948,6950,6952,6954,6956,6958,6960,6962,6964,6966,6968,6970,6972,6974,6976,6978,6980,6982,6984,6986,6988,6990,6992,6994,6996,6998,7000,7002,7004,7006,7008,7010,7012,7014,7016,7018,7020,7022,7024,7026,7028,7030,7032,7034,7036,7038,7040,7042,7044,7046,7048,7050,7052,7054,7056,7058,7060,7062,7064,7066,7068,7070,7072,7074,7076,7078,7080,7082,7084,7086,7088,7090,7092,7094,7096,7098,7100,7102,7104,7106,7108,7110,7112,7114,7116,7118,7120,7122,7124,7126,7128,7130,7132,7134,7136,7138,7140,7142,7144,7146,7148,7150,7152,7154,7156,7158,7160,7162,7164,7166,7168,7170,7172,7174,7176,7178,7180,7182,7184,7186,7188,7190,7192,7194,7196,7198,7200,7202,7204,7206,7208,7210,7212,7214,7216,7218,7220,7222,7224,7226,7228,7230,7232,7234,7236,7238,7240,7242,7244,7246,7248,7250,7252,7254,7256,7258,7260,7262,7264,7266,7268,7270,7272,7274,7276,7278,7280,7282,7284,7286,7288,7290,7292,7294,7296,7298,7300,7302,7304,7306,7308,7310,7312,7314,7316,7318,7320,7322,7324,7326,7328,7330,7332,7334,7336,7338,7340,7342,7344,7346,7348,7350,7352,7354,7356,7358,7360,7362,7364,7366,7368,7370,7372,7374,7376,7378,7380,7382,7384,7386,7388,7390,7392,7394,7396,7398,7400,7402,7404,7406,7408,7410,7412,7414,7416,7418,7420,7422,7424,7426,7428,7430,7432,7434,7436,7438,7440,7442,7444,7446,7448,7450,7452,7454,7456,7458,7460,7462,7464,7466,7468,7470,7472,7474,7476,7478,7480,7482,7484,7486,7488,7490,7492,7494,7496,7498,7500,7502,7504],{"categories":130},[91],{"categories":132},[133],"Developer Productivity",{"categories":135},[91],{"categories":137},[138],"Business & SaaS",{"categories":140},[91],{"categories":142},[143],"AI Automation",{"categories":145},[146],"Product Strategy",{"categories":148},[143],{"categories":150},[91],{"categories":152},[133],{"categories":154},[143],{"categories":156},[157],"Software Engineering",{"categories":159},[160],"Data Science & Visualization",{"categories":162},[91],{"categories":164},[138],{"categories":166},[],{"categories":168},[91],{"categories":170},[171],"Inference & Serving",{"categories":173},[91],{"categories":175},[91],{"categories":177},[143],{"categories":179},[],{"categories":181},[182],"AI News & Trends",{"categories":184},[160],{"categories":186},[143],{"categories":188},[91],{"categories":190},[91],{"categories":192},[91],{"categories":194},[138],{"categories":196},[133],{"categories":198},[91],{"categories":200},[143],{"categories":202},[182],{"categories":204},[91],{"categories":206},[143],{"categories":208},[143],{"categories":210},[91],{"categories":212},[91],{"categories":214},[143],{"categories":216},[91],{"categories":218},[91],{"categories":220},[91],{"categories":222},[138],{"categories":224},[143],{"categories":226},[182],{"categories":228},[91],{"categories":230},[91],{"categories":232},[91],{"categories":234},[],{"categories":236},[237],"Design & Frontend",{"categories":239},[91],{"categories":241},[160],{"categories":243},[182],{"categories":245},[91],{"categories":247},[91],{"categories":249},[91],{"categories":251},[],{"categories":253},[91],{"categories":255},[91],{"categories":257},[143],{"categories":259},[157],{"categories":261},[91],{"categories":263},[143],{"categories":265},[91],{"categories":267},[268],"Marketing & Growth",{"categories":270},[237],{"categories":272},[91],{"categories":274},[143],{"categories":276},[91],{"categories":278},[91],{"categories":280},[157],{"categories":282},[91],{"categories":284},[],{"categories":286},[],{"categories":288},[237],{"categories":290},[91],{"categories":292},[143],{"categories":294},[133],{"categories":296},[157],{"categories":298},[143],{"categories":300},[237],{"categories":302},[146],{"categories":304},[91],{"categories":306},[157],{"categories":308},[309],"DevOps & Cloud",{"categories":311},[143],{"categories":313},[146],{"categories":315},[182],{"categories":317},[91],{"categories":319},[],{"categories":321},[91],{"categories":323},[91],{"categories":325},[91],{"categories":327},[],{"categories":329},[143],{"categories":331},[157],{"categories":333},[],{"categories":335},[157],{"categories":337},[143],{"categories":339},[91],{"categories":341},[237],{"categories":343},[344],"Governance & Standards",{"categories":346},[138],{"categories":348},[],{"categories":350},[91],{"categories":352},[],{"categories":354},[91],{"categories":356},[91],{"categories":358},[143],{"categories":360},[143],{"categories":362},[91],{"categories":364},[91],{"categories":366},[143],{"categories":368},[91],{"categories":370},[91],{"categories":372},[91],{"categories":374},[],{"categories":376},[157],{"categories":378},[],{"categories":380},[],{"categories":382},[91],{"categories":384},[157],{"categories":386},[],{"categories":388},[157],{"categories":390},[91],{"categories":392},[143],{"categories":394},[91],{"categories":396},[268],{"categories":398},[91],{"categories":400},[91],{"categories":402},[91],{"categories":404},[237],{"categories":406},[237],{"categories":408},[91],{"categories":410},[157],{"categories":412},[143],{"categories":414},[415],"GovTech & Public-Sector Adoption",{"categories":417},[157],{"categories":419},[91],{"categories":421},[91],{"categories":423},[91],{"categories":425},[143],{"categories":427},[143],{"categories":429},[160],{"categories":431},[91],{"categories":433},[182],{"categories":435},[143],{"categories":437},[438],"Legal AI Tools",{"categories":440},[91],{"categories":442},[143],{"categories":444},[91],{"categories":446},[268],{"categories":448},[143],{"categories":450},[146],{"categories":452},[91],{"categories":454},[157],{"categories":456},[415],{"categories":458},[],{"categories":460},[143],{"categories":462},[],{"categories":464},[138],{"categories":466},[143],{"categories":468},[143],{"categories":470},[471],"RAG & Retrieval",{"categories":473},[138],{"categories":475},[91],{"categories":477},[157],{"categories":479},[157],{"categories":481},[309],{"categories":483},[237],{"categories":485},[143],{"categories":487},[91],{"categories":489},[91],{"categories":491},[],{"categories":493},[143],{"categories":495},[496],"Agents & Orchestration",{"categories":498},[157],{"categories":500},[91],{"categories":502},[],{"categories":504},[143],{"categories":506},[138],{"categories":508},[],{"categories":510},[91],{"categories":512},[],{"categories":514},[91],{"categories":516},[133],{"categories":518},[157],{"categories":520},[138],{"categories":522},[91],{"categories":524},[91],{"categories":526},[91],{"categories":528},[143],{"categories":530},[91],{"categories":532},[91],{"categories":534},[182],{"categories":536},[91],{"categories":538},[],{"categories":540},[91],{"categories":542},[91],{"categories":544},[],{"categories":546},[91],{"categories":548},[157],{"categories":550},[91],{"categories":552},[143],{"categories":554},[160],{"categories":556},[],{"categories":558},[91],{"categories":560},[91],{"categories":562},[237],{"categories":564},[565],"Models & Frontier Labs",{"categories":567},[],{"categories":569},[237],{"categories":571},[572],"Regulation & Governance of AI",{"categories":574},[146],{"categories":576},[143],{"categories":578},[],{"categories":580},[91],{"categories":582},[91],{"categories":584},[143],{"categories":586},[143],{"categories":588},[182],{"categories":590},[91],{"categories":592},[138],{"categories":594},[91],{"categories":596},[143],{"categories":598},[],{"categories":600},[157],{"categories":602},[143],{"categories":604},[91],{"categories":606},[146],{"categories":608},[91],{"categories":610},[611],"AI Policy & Regulation",{"categories":613},[],{"categories":615},[91],{"categories":617},[143],{"categories":619},[143],{"categories":621},[146],{"categories":623},[143],{"categories":625},[91],{"categories":627},[91],{"categories":629},[91],{"categories":631},[143],{"categories":633},[],{"categories":635},[160],{"categories":637},[638],"Evals & Reliability",{"categories":640},[91],{"categories":642},[91],{"categories":644},[],{"categories":646},[160],{"categories":648},[133],{"categories":650},[415],{"categories":652},[611],{"categories":654},[91],{"categories":656},[138],{"categories":658},[91],{"categories":660},[143],{"categories":662},[91],{"categories":664},[143],{"categories":666},[496],{"categories":668},[91],{"categories":670},[157],{"categories":672},[91],{"categories":674},[91],{"categories":676},[],{"categories":678},[237],{"categories":680},[],{"categories":682},[91],{"categories":684},[415],{"categories":686},[91],{"categories":688},[91],{"categories":690},[91],{"categories":692},[],{"categories":694},[91],{"categories":696},[237],{"categories":698},[157],{"categories":700},[],{"categories":702},[91],{"categories":704},[],{"categories":706},[143],{"categories":708},[91],{"categories":710},[237],{"categories":712},[],{"categories":714},[91],{"categories":716},[91],{"categories":718},[160],{"categories":720},[143],{"categories":722},[91],{"categories":724},[138],{"categories":726},[143],{"categories":728},[91],{"categories":730},[91],{"categories":732},[157],{"categories":734},[237],{"categories":736},[91],{"categories":738},[143],{"categories":740},[],{"categories":742},[157],{"categories":744},[143],{"categories":746},[160],{"categories":748},[],{"categories":750},[91],{"categories":752},[182],{"categories":754},[91],{"categories":756},[],{"categories":758},[91],{"categories":760},[91],{"categories":762},[91],{"categories":764},[138,268],{"categories":766},[],{"categories":768},[157],{"categories":770},[91],{"categories":772},[91],{"categories":774},[143],{"categories":776},[91],{"categories":778},[91],{"categories":780},[],{"categories":782},[],{"categories":784},[91],{"categories":786},[237],{"categories":788},[91],{"categories":790},[],{"categories":792},[91],{"categories":794},[309],{"categories":796},[],{"categories":798},[143],{"categories":800},[182],{"categories":802},[91],{"categories":804},[138],{"categories":806},[91],{"categories":808},[157],{"categories":810},[237],{"categories":812},[],{"categories":814},[182],{"categories":816},[91],{"categories":818},[171],{"categories":820},[91],{"categories":822},[91],{"categories":824},[143],{"categories":826},[182],{"categories":828},[565],{"categories":830},[91],{"categories":832},[268],{"categories":834},[],{"categories":836},[143],{"categories":838},[138],{"categories":840},[157],{"categories":842},[91],{"categories":844},[143],{"categories":846},[],{"categories":848},[91,309],{"categories":850},[91],{"categories":852},[91],{"categories":854},[91],{"categories":856},[143],{"categories":858},[91,157],{"categories":860},[160],{"categories":862},[91],{"categories":864},[91],{"categories":866},[91],{"categories":868},[157],{"categories":870},[91],{"categories":872},[143],{"categories":874},[143],{"categories":876},[611],{"categories":878},[268],{"categories":880},[91],{"categories":882},[143],{"categories":884},[91],{"categories":886},[91],{"categories":888},[143],{"categories":890},[],{"categories":892},[143],{"categories":894},[91],{"categories":896},[91],{"categories":898},[143],{"categories":900},[91],{"categories":902},[91,138],{"categories":904},[91],{"categories":906},[138],{"categories":908},[],{"categories":910},[237],{"categories":912},[237],{"categories":914},[91],{"categories":916},[],{"categories":918},[],{"categories":920},[91],{"categories":922},[182],{"categories":924},[],{"categories":926},[133],{"categories":928},[91],{"categories":930},[157],{"categories":932},[143],{"categories":934},[91],{"categories":936},[937],"Generative UI & Design-to-Code",{"categories":939},[91],{"categories":941},[91],{"categories":943},[237],{"categories":945},[91],{"categories":947},[948],"Algorithmic Accountability",{"categories":950},[143],{"categories":952},[157],{"categories":954},[182],{"categories":956},[237],{"categories":958},[91],{"categories":960},[],{"categories":962},[146],{"categories":964},[91],{"categories":966},[91],{"categories":968},[91],{"categories":970},[91],{"categories":972},[91],{"categories":974},[143],{"categories":976},[977],"MLOps & Infrastructure",{"categories":979},[91],{"categories":981},[91],{"categories":983},[91],{"categories":985},[91],{"categories":987},[91],{"categories":989},[157],{"categories":991},[182],{"categories":993},[91],{"categories":995},[91],{"categories":997},[146],{"categories":999},[133],{"categories":1001},[91],{"categories":1003},[143],{"categories":1005},[309],{"categories":1007},[91],{"categories":1009},[138],{"categories":1011},[91],{"categories":1013},[237],{"categories":1015},[91],{"categories":1017},[146],{"categories":1019},[91],{"categories":1021},[143],{"categories":1023},[],{"categories":1025},[],{"categories":1027},[91],{"categories":1029},[171],{"categories":1031},[237],{"categories":1033},[182],{"categories":1035},[160],{"categories":1037},[],{"categories":1039},[91],{"categories":1041},[91],{"categories":1043},[138],{"categories":1045},[143],{"categories":1047},[91],{"categories":1049},[91],{"categories":1051},[91],{"categories":1053},[91],{"categories":1055},[91],{"categories":1057},[182],{"categories":1059},[171],{"categories":1061},[91],{"categories":1063},[237],{"categories":1065},[91],{"categories":1067},[],{"categories":1069},[143],{"categories":1071},[157],{"categories":1073},[],{"categories":1075},[91],{"categories":1077},[91],{"categories":1079},[143],{"categories":1081},[157],{"categories":1083},[91],{"categories":1085},[160],{"categories":1087},[237],{"categories":1089},[],{"categories":1091},[91],{"categories":1093},[],{"categories":1095},[91],{"categories":1097},[],{"categories":1099},[91],{"categories":1101},[91],{"categories":1103},[146],{"categories":1105},[138],{"categories":1107},[143],{"categories":1109},[143],{"categories":1111},[],{"categories":1113},[91],{"categories":1115},[133],{"categories":1117},[91],{"categories":1119},[91],{"categories":1121},[138],{"categories":1123},[182],{"categories":1125},[133],{"categories":1127},[],{"categories":1129},[91],{"categories":1131},[],{"categories":1133},[91],{"categories":1135},[],{"categories":1137},[91],{"categories":1139},[182],{"categories":1141},[182],{"categories":1143},[],{"categories":1145},[496],{"categories":1147},[91],{"categories":1149},[237],{"categories":1151},[157],{"categories":1153},[],{"categories":1155},[438],{"categories":1157},[143],{"categories":1159},[138],{"categories":1161},[],{"categories":1163},[],{"categories":1165},[133],{"categories":1167},[160],{"categories":1169},[],{"categories":1171},[268],{"categories":1173},[143],{"categories":1175},[138],{"categories":1177},[143],{"categories":1179},[91],{"categories":1181},[138],{"categories":1183},[91],{"categories":1185},[157],{"categories":1187},[],{"categories":1189},[171],{"categories":1191},[146],{"categories":1193},[91],{"categories":1195},[237],{"categories":1197},[157],{"categories":1199},[138],{"categories":1201},[91],{"categories":1203},[157],{"categories":1205},[91],{"categories":1207},[143],{"categories":1209},[138],{"categories":1211},[91],{"categories":1213},[91],{"categories":1215},[91],{"categories":1217},[91],{"categories":1219},[91],{"categories":1221},[91],{"categories":1223},[],{"categories":1225},[],{"categories":1227},[157],{"categories":1229},[160],{"categories":1231},[146],{"categories":1233},[91],{"categories":1235},[143],{"categories":1237},[157],{"categories":1239},[157],{"categories":1241},[91],{"categories":1243},[],{"categories":1245},[91],{"categories":1247},[182],{"categories":1249},[146],{"categories":1251},[146],{"categories":1253},[157],{"categories":1255},[91],{"categories":1257},[638],{"categories":1259},[309],{"categories":1261},[],{"categories":1263},[143],{"categories":1265},[91],{"categories":1267},[133],{"categories":1269},[],{"categories":1271},[133],{"categories":1273},[],{"categories":1275},[91],{"categories":1277},[91],{"categories":1279},[91],{"categories":1281},[237],{"categories":1283},[268],{"categories":1285},[146],{"categories":1287},[91],{"categories":1289},[157],{"categories":1291},[91],{"categories":1293},[143],{"categories":1295},[],{"categories":1297},[157],{"categories":1299},[91],{"categories":1301},[133],{"categories":1303},[],{"categories":1305},[138],{"categories":1307},[91],{"categories":1309},[91],{"categories":1311},[182],{"categories":1313},[91,309],{"categories":1315},[91],{"categories":1317},[1318],"Design Systems for AI",{"categories":1320},[91],{"categories":1322},[91],{"categories":1324},[182],{"categories":1326},[91],{"categories":1328},[91],{"categories":1330},[91],{"categories":1332},[138],{"categories":1334},[91],{"categories":1336},[91],{"categories":1338},[91],{"categories":1340},[],{"categories":1342},[91],{"categories":1344},[91],{"categories":1346},[138],{"categories":1348},[91],{"categories":1350},[],{"categories":1352},[143],{"categories":1354},[143],{"categories":1356},[157],{"categories":1358},[182],{"categories":1360},[157],{"categories":1362},[91],{"categories":1364},[237],{"categories":1366},[182],{"categories":1368},[160],{"categories":1370},[91],{"categories":1372},[91],{"categories":1374},[91],{"categories":1376},[91],{"categories":1378},[143],{"categories":1380},[133],{"categories":1382},[611],{"categories":1384},[91],{"categories":1386},[91],{"categories":1388},[143],{"categories":1390},[91],{"categories":1392},[157],{"categories":1394},[91],{"categories":1396},[157],{"categories":1398},[],{"categories":1400},[237],{"categories":1402},[],{"categories":1404},[91],{"categories":1406},[143],{"categories":1408},[146],{"categories":1410},[],{"categories":1412},[138],{"categories":1414},[91],{"categories":1416},[],{"categories":1418},[237],{"categories":1420},[157],{"categories":1422},[143],{"categories":1424},[157],{"categories":1426},[91],{"categories":1428},[237],{"categories":1430},[91],{"categories":1432},[157],{"categories":1434},[91],{"categories":1436},[237],{"categories":1438},[],{"categories":1440},[],{"categories":1442},[182],{"categories":1444},[143],{"categories":1446},[143],{"categories":1448},[143],{"categories":1450},[91],{"categories":1452},[91],{"categories":1454},[91],{"categories":1456},[91],{"categories":1458},[91],{"categories":1460},[91],{"categories":1462},[138],{"categories":1464},[91],{"categories":1466},[91],{"categories":1468},[],{"categories":1470},[157],{"categories":1472},[157],{"categories":1474},[91],{"categories":1476},[157],{"categories":1478},[138],{"categories":1480},[],{"categories":1482},[91],{"categories":1484},[91],{"categories":1486},[237],{"categories":1488},[91],{"categories":1490},[91],{"categories":1492},[91],{"categories":1494},[143],{"categories":1496},[133],{"categories":1498},[138],{"categories":1500},[91],{"categories":1502},[143],{"categories":1504},[182],{"categories":1506},[143],{"categories":1508},[171],{"categories":1510},[268],{"categories":1512},[91],{"categories":1514},[143],{"categories":1516},[91],{"categories":1518},[91],{"categories":1520},[91],{"categories":1522},[],{"categories":1524},[237],{"categories":1526},[],{"categories":1528},[91],{"categories":1530},[91],{"categories":1532},[],{"categories":1534},[91],{"categories":1536},[157],{"categories":1538},[138],{"categories":1540},[1541],"Visual & Generative Media",{"categories":1543},[143],{"categories":1545},[],{"categories":1547},[91],{"categories":1549},[91],{"categories":1551},[157],{"categories":1553},[91],{"categories":1555},[309],{"categories":1557},[91],{"categories":1559},[160],{"categories":1561},[611],{"categories":1563},[157],{"categories":1565},[268],{"categories":1567},[91],{"categories":1569},[146],{"categories":1571},[237],{"categories":1573},[91],{"categories":1575},[91],{"categories":1577},[157],{"categories":1579},[143],{"categories":1581},[91],{"categories":1583},[],{"categories":1585},[],{"categories":1587},[143],{"categories":1589},[157],{"categories":1591},[133],{"categories":1593},[143],{"categories":1595},[565],{"categories":1597},[91],{"categories":1599},[146],{"categories":1601},[91],{"categories":1603},[138],{"categories":1605},[],{"categories":1607},[91],{"categories":1609},[146],{"categories":1611},[91],{"categories":1613},[91],{"categories":1615},[91],{"categories":1617},[146],{"categories":1619},[91],{"categories":1621},[91],{"categories":1623},[268],{"categories":1625},[91],{"categories":1627},[496],{"categories":1629},[143],{"categories":1631},[91],{"categories":1633},[143],{"categories":1635},[91],{"categories":1637},[91],{"categories":1639},[143],{"categories":1641},[91],{"categories":1643},[91],{"categories":1645},[143],{"categories":1647},[91],{"categories":1649},[237],{"categories":1651},[143],{"categories":1653},[],{"categories":1655},[143],{"categories":1657},[91],{"categories":1659},[],{"categories":1661},[309],{"categories":1663},[157],{"categories":1665},[],{"categories":1667},[565],{"categories":1669},[91],{"categories":1671},[143],{"categories":1673},[143],{"categories":1675},[91],{"categories":1677},[237,91],{"categories":1679},[91],{"categories":1681},[133],{"categories":1683},[91],{"categories":1685},[143],{"categories":1687},[237],{"categories":1689},[],{"categories":1691},[91],{"categories":1693},[133],{"categories":1695},[91],{"categories":1697},[1698],"Medical Imaging & Radiology",{"categories":1700},[91],{"categories":1702},[91],{"categories":1704},[91],{"categories":1706},[237],{"categories":1708},[143],{"categories":1710},[157],{"categories":1712},[],{"categories":1714},[91],{"categories":1716},[91],{"categories":1718},[91],{"categories":1720},[],{"categories":1722},[],{"categories":1724},[91],{"categories":1726},[91],{"categories":1728},[496],{"categories":1730},[91],{"categories":1732},[133],{"categories":1734},[91],{"categories":1736},[91],{"categories":1738},[],{"categories":1740},[143],{"categories":1742},[91],{"categories":1744},[146],{"categories":1746},[157],{"categories":1748},[91],{"categories":1750},[143],{"categories":1752},[496],{"categories":1754},[91],{"categories":1756},[143],{"categories":1758},[91],{"categories":1760},[91],{"categories":1762},[91],{"categories":1764},[91],{"categories":1766},[237],{"categories":1768},[143],{"categories":1770},[309],{"categories":1772},[237],{"categories":1774},[138],{"categories":1776},[143],{"categories":1778},[182],{"categories":1780},[91],{"categories":1782},[91],{"categories":1784},[146],{"categories":1786},[91],{"categories":1788},[91],{"categories":1790},[91],{"categories":1792},[91],{"categories":1794},[91],{"categories":1796},[143],{"categories":1798},[91],{"categories":1800},[157],{"categories":1802},[157],{"categories":1804},[91],{"categories":1806},[146],{"categories":1808},[],{"categories":1810},[182],{"categories":1812},[],{"categories":1814},[146],{"categories":1816},[143],{"categories":1818},[91],{"categories":1820},[91],{"categories":1822},[143],{"categories":1824},[1318],{"categories":1826},[91],{"categories":1828},[1318],{"categories":1830},[237],{"categories":1832},[91],{"categories":1834},[91],{"categories":1836},[91],{"categories":1838},[143],{"categories":1840},[157],{"categories":1842},[237],{"categories":1844},[143],{"categories":1846},[182],{"categories":1848},[],{"categories":1850},[91],{"categories":1852},[],{"categories":1854},[91],{"categories":1856},[91],{"categories":1858},[91],{"categories":1860},[91],{"categories":1862},[91],{"categories":1864},[143],{"categories":1866},[1867],"Contract Review & E-Discovery",{"categories":1869},[91],{"categories":1871},[237],{"categories":1873},[91],{"categories":1875},[133],{"categories":1877},[91],{"categories":1879},[182],{"categories":1881},[91],{"categories":1883},[91],{"categories":1885},[268],{"categories":1887},[157],{"categories":1889},[143],{"categories":1891},[91],{"categories":1893},[91],{"categories":1895},[91],{"categories":1897},[143],{"categories":1899},[143],{"categories":1901},[948],{"categories":1903},[91],{"categories":1905},[91],{"categories":1907},[143],{"categories":1909},[143],{"categories":1911},[91],{"categories":1913},[91],{"categories":1915},[91],{"categories":1917},[143],{"categories":1919},[91],{"categories":1921},[157],{"categories":1923},[91],{"categories":1925},[496],{"categories":1927},[471],{"categories":1929},[91],{"categories":1931},[143],{"categories":1933},[91],{"categories":1935},[1936],"Law-Firm Practice & Adoption",{"categories":1938},[91],{"categories":1940},[143],{"categories":1942},[237],{"categories":1944},[91],{"categories":1946},[91],{"categories":1948},[91],{"categories":1950},[],{"categories":1952},[157],{"categories":1954},[],{"categories":1956},[157],{"categories":1958},[91],{"categories":1960},[],{"categories":1962},[143],{"categories":1964},[133],{"categories":1966},[309],{"categories":1968},[91],{"categories":1970},[],{"categories":1972},[91],{"categories":1974},[133],{"categories":1976},[138],{"categories":1978},[91],{"categories":1980},[268],{"categories":1982},[91],{"categories":1984},[],{"categories":1986},[138],{"categories":1988},[143],{"categories":1990},[138],{"categories":1992},[],{"categories":1994},[91],{"categories":1996},[146],{"categories":1998},[91],{"categories":2000},[157],{"categories":2002},[],{"categories":2004},[],{"categories":2006},[],{"categories":2008},[],{"categories":2010},[91],{"categories":2012},[146],{"categories":2014},[143],{"categories":2016},[309],{"categories":2018},[91],{"categories":2020},[133],{"categories":2022},[157],{"categories":2024},[91],{"categories":2026},[91],{"categories":2028},[157],{"categories":2030},[146],{"categories":2032},[91],{"categories":2034},[91],{"categories":2036},[91],{"categories":2038},[977],{"categories":2040},[91],{"categories":2042},[157],{"categories":2044},[91],{"categories":2046},[268],{"categories":2048},[157],{"categories":2050},[138],{"categories":2052},[91],{"categories":2054},[91],{"categories":2056},[91],{"categories":2058},[237],{"categories":2060},[91],{"categories":2062},[91],{"categories":2064},[91],{"categories":2066},[91],{"categories":2068},[138],{"categories":2070},[143],{"categories":2072},[91,133],{"categories":2074},[496],{"categories":2076},[91],{"categories":2078},[91],{"categories":2080},[157],{"categories":2082},[157],{"categories":2084},[237],{"categories":2086},[143],{"categories":2088},[143],{"categories":2090},[157],{"categories":2092},[91],{"categories":2094},[143],{"categories":2096},[91],{"categories":2098},[91],{"categories":2100},[],{"categories":2102},[],{"categories":2104},[91],{"categories":2106},[160],{"categories":2108},[91],{"categories":2110},[237],{"categories":2112},[143],{"categories":2114},[],{"categories":2116},[91],{"categories":2118},[91],{"categories":2120},[157],{"categories":2122},[160],{"categories":2124},[182],{"categories":2126},[146],{"categories":2128},[237],{"categories":2130},[91],{"categories":2132},[143],{"categories":2134},[91],{"categories":2136},[157],{"categories":2138},[],{"categories":2140},[143],{"categories":2142},[91],{"categories":2144},[91],{"categories":2146},[91],{"categories":2148},[91],{"categories":2150},[91],{"categories":2152},[],{"categories":2154},[143],{"categories":2156},[91],{"categories":2158},[91],{"categories":2160},[91],{"categories":2162},[],{"categories":2164},[143],{"categories":2166},[143],{"categories":2168},[91],{"categories":2170},[91],{"categories":2172},[138],{"categories":2174},[91],{"categories":2176},[91],{"categories":2178},[],{"categories":2180},[133],{"categories":2182},[91],{"categories":2184},[91],{"categories":2186},[91],{"categories":2188},[237],{"categories":2190},[91],{"categories":2192},[157],{"categories":2194},[91],{"categories":2196},[133],{"categories":2198},[91],{"categories":2200},[157],{"categories":2202},[268],{"categories":2204},[157],{"categories":2206},[143],{"categories":2208},[143],{"categories":2210},[91],{"categories":2212},[91],{"categories":2214},[91,237],{"categories":2216},[91],{"categories":2218},[143],{"categories":2220},[182],{"categories":2222},[91],{"categories":2224},[182],{"categories":2226},[143],{"categories":2228},[237],{"categories":2230},[91],{"categories":2232},[],{"categories":2234},[157],{"categories":2236},[309],{"categories":2238},[237],{"categories":2240},[157],{"categories":2242},[91],{"categories":2244},[146],{"categories":2246},[91],{"categories":2248},[91],{"categories":2250},[143],{"categories":2252},[],{"categories":2254},[],{"categories":2256},[91],{"categories":2258},[],{"categories":2260},[],{"categories":2262},[146],{"categories":2264},[157],{"categories":2266},[91],{"categories":2268},[91],{"categories":2270},[143],{"categories":2272},[143],{"categories":2274},[138],{"categories":2276},[143],{"categories":2278},[309],{"categories":2280},[91],{"categories":2282},[91],{"categories":2284},[91],{"categories":2286},[171],{"categories":2288},[91],{"categories":2290},[91],{"categories":2292},[91],{"categories":2294},[91],{"categories":2296},[157],{"categories":2298},[143],{"categories":2300},[91],{"categories":2302},[91],{"categories":2304},[91],{"categories":2306},[157],{"categories":2308},[438],{"categories":2310},[143],{"categories":2312},[948],{"categories":2314},[],{"categories":2316},[143],{"categories":2318},[237],{"categories":2320},[1936],{"categories":2322},[157],{"categories":2324},[],{"categories":2326},[],{"categories":2328},[91],{"categories":2330},[143],{"categories":2332},[],{"categories":2334},[],{"categories":2336},[91],{"categories":2338},[268],{"categories":2340},[91],{"categories":2342},[268],{"categories":2344},[91],{"categories":2346},[143],{"categories":2348},[91],{"categories":2350},[91],{"categories":2352},[160],{"categories":2354},[91],{"categories":2356},[157],{"categories":2358},[146],{"categories":2360},[],{"categories":2362},[91],{"categories":2364},[91],{"categories":2366},[91],{"categories":2368},[157],{"categories":2370},[91],{"categories":2372},[1867],{"categories":2374},[91],{"categories":2376},[237],{"categories":2378},[237],{"categories":2380},[91],{"categories":2382},[143],{"categories":2384},[133],{"categories":2386},[91],{"categories":2388},[91],{"categories":2390},[91],{"categories":2392},[91],{"categories":2394},[237],{"categories":2396},[237],{"categories":2398},[143],{"categories":2400},[143],{"categories":2402},[143],{"categories":2404},[91],{"categories":2406},[91],{"categories":2408},[91],{"categories":2410},[143],{"categories":2412},[],{"categories":2414},[91],{"categories":2416},[],{"categories":2418},[237],{"categories":2420},[2421],"Interaction & Product Design",{"categories":2423},[91],{"categories":2425},[143],{"categories":2427},[157],{"categories":2429},[344],{"categories":2431},[182],{"categories":2433},[157],{"categories":2435},[91],{"categories":2437},[91],{"categories":2439},[91],{"categories":2441},[157],{"categories":2443},[91],{"categories":2445},[133],{"categories":2447},[143],{"categories":2449},[91],{"categories":2451},[],{"categories":2453},[143],{"categories":2455},[143],{"categories":2457},[143],{"categories":2459},[],{"categories":2461},[157],{"categories":2463},[91],{"categories":2465},[143],{"categories":2467},[133],{"categories":2469},[2421],{"categories":2471},[91],{"categories":2473},[133],{"categories":2475},[133],{"categories":2477},[91],{"categories":2479},[],{"categories":2481},[91],{"categories":2483},[143],{"categories":2485},[157],{"categories":2487},[],{"categories":2489},[143],{"categories":2491},[146],{"categories":2493},[182],{"categories":2495},[91],{"categories":2497},[143],{"categories":2499},[91],{"categories":2501},[143],{"categories":2503},[143],{"categories":2505},[91],{"categories":2507},[91],{"categories":2509},[182],{"categories":2511},[160],{"categories":2513},[91],{"categories":2515},[146],{"categories":2517},[157],{"categories":2519},[2520],"Coding Agents & Dev Productivity",{"categories":2522},[182],{"categories":2524},[237],{"categories":2526},[91],{"categories":2528},[91],{"categories":2530},[],{"categories":2532},[91],{"categories":2534},[948],{"categories":2536},[],{"categories":2538},[91],{"categories":2540},[91],{"categories":2542},[309],{"categories":2544},[91],{"categories":2546},[182],{"categories":2548},[],{"categories":2550},[],{"categories":2552},[91],{"categories":2554},[],{"categories":2556},[143],{"categories":2558},[91],{"categories":2560},[143],{"categories":2562},[],{"categories":2564},[157],{"categories":2566},[157],{"categories":2568},[91],{"categories":2570},[160],{"categories":2572},[],{"categories":2574},[91],{"categories":2576},[91],{"categories":2578},[91],{"categories":2580},[160],{"categories":2582},[157],{"categories":2584},[143],{"categories":2586},[],{"categories":2588},[],{"categories":2590},[91],{"categories":2592},[91],{"categories":2594},[91],{"categories":2596},[91],{"categories":2598},[143],{"categories":2600},[143],{"categories":2602},[415],{"categories":2604},[157],{"categories":2606},[146],{"categories":2608},[157],{"categories":2610},[143],{"categories":2612},[182],{"categories":2614},[182],{"categories":2616},[143],{"categories":2618},[143],{"categories":2620},[91],{"categories":2622},[133],{"categories":2624},[2421],{"categories":2626},[146],{"categories":2628},[91,309],{"categories":2630},[160],{"categories":2632},[],{"categories":2634},[237],{"categories":2636},[143],{"categories":2638},[157],{"categories":2640},[133],{"categories":2642},[91],{"categories":2644},[143],{"categories":2646},[2647],"The Designer's Role & Craft",{"categories":2649},[237],{"categories":2651},[],{"categories":2653},[143],{"categories":2655},[91],{"categories":2657},[143],{"categories":2659},[143],{"categories":2661},[91],{"categories":2663},[268],{"categories":2665},[91],{"categories":2667},[157],{"categories":2669},[143],{"categories":2671},[91],{"categories":2673},[237],{"categories":2675},[91],{"categories":2677},[],{"categories":2679},[143],{"categories":2681},[237],{"categories":2683},[146],{"categories":2685},[91],{"categories":2687},[143],{"categories":2689},[91],{"categories":2691},[91],{"categories":2693},[91],{"categories":2695},[2696],"AI UX Patterns",{"categories":2698},[143],{"categories":2700},[143],{"categories":2702},[143],{"categories":2704},[91],{"categories":2706},[143],{"categories":2708},[268],{"categories":2710},[160],{"categories":2712},[91],{"categories":2714},[143],{"categories":2716},[91],{"categories":2718},[1318],{"categories":2720},[],{"categories":2722},[268],{"categories":2724},[143],{"categories":2726},[182],{"categories":2728},[157],{"categories":2730},[91],{"categories":2732},[143],{"categories":2734},[],{"categories":2736},[],{"categories":2738},[91],{"categories":2740},[91],{"categories":2742},[143],{"categories":2744},[91],{"categories":2746},[143],{"categories":2748},[415],{"categories":2750},[237],{"categories":2752},[91],{"categories":2754},[182],{"categories":2756},[157],{"categories":2758},[91],{"categories":2760},[143],{"categories":2762},[143],{"categories":2764},[],{"categories":2766},[91],{"categories":2768},[],{"categories":2770},[91],{"categories":2772},[],{"categories":2774},[91],{"categories":2776},[91],{"categories":2778},[91],{"categories":2780},[143],{"categories":2782},[157],{"categories":2784},[],{"categories":2786},[],{"categories":2788},[160],{"categories":2790},[171],{"categories":2792},[91],{"categories":2794},[91],{"categories":2796},[91],{"categories":2798},[160],{"categories":2800},[160],{"categories":2802},[91],{"categories":2804},[91],{"categories":2806},[182],{"categories":2808},[91],{"categories":2810},[91],{"categories":2812},[91],{"categories":2814},[143],{"categories":2816},[91],{"categories":2818},[143],{"categories":2820},[91],{"categories":2822},[91],{"categories":2824},[91],{"categories":2826},[143],{"categories":2828},[],{"categories":2830},[91],{"categories":2832},[],{"categories":2834},[91],{"categories":2836},[91],{"categories":2838},[309],{"categories":2840},[91],{"categories":2842},[],{"categories":2844},[],{"categories":2846},[237],{"categories":2848},[977],{"categories":2850},[143],{"categories":2852},[133],{"categories":2854},[2647],{"categories":2856},[],{"categories":2858},[],{"categories":2860},[91],{"categories":2862},[],{"categories":2864},[],{"categories":2866},[157],{"categories":2868},[182],{"categories":2870},[268],{"categories":2872},[143],{"categories":2874},[138],{"categories":2876},[91],{"categories":2878},[91],{"categories":2880},[138],{"categories":2882},[],{"categories":2884},[237],{"categories":2886},[146],{"categories":2888},[91],{"categories":2890},[91],{"categories":2892},[143],{"categories":2894},[138],{"categories":2896},[91],{"categories":2898},[91],{"categories":2900},[133],{"categories":2902},[91],{"categories":2904},[91],{"categories":2906},[],{"categories":2908},[133],{"categories":2910},[91],{"categories":2912},[268],{"categories":2914},[143],{"categories":2916},[182],{"categories":2918},[91],{"categories":2920},[157],{"categories":2922},[91],{"categories":2924},[91],{"categories":2926},[91],{"categories":2928},[91],{"categories":2930},[138],{"categories":2932},[91],{"categories":2934},[91],{"categories":2936},[91],{"categories":2938},[143],{"categories":2940},[91],{"categories":2942},[91],{"categories":2944},[],{"categories":2946},[91],{"categories":2948},[157],{"categories":2950},[133],{"categories":2952},[91],{"categories":2954},[91],{"categories":2956},[237],{"categories":2958},[91],{"categories":2960},[],{"categories":2962},[91],{"categories":2964},[496],{"categories":2966},[143],{"categories":2968},[138],{"categories":2970},[182],{"categories":2972},[91],{"categories":2974},[91],{"categories":2976},[],{"categories":2978},[138],{"categories":2980},[138],{"categories":2982},[91],{"categories":2984},[91],{"categories":2986},[146],{"categories":2988},[91],{"categories":2990},[91],{"categories":2992},[91],{"categories":2994},[91],{"categories":2996},[157],{"categories":2998},[160],{"categories":3000},[157],{"categories":3002},[91],{"categories":3004},[],{"categories":3006},[91],{"categories":3008},[157],{"categories":3010},[91],{"categories":3012},[157],{"categories":3014},[143],{"categories":3016},[611],{"categories":3018},[],{"categories":3020},[],{"categories":3022},[91],{"categories":3024},[182],{"categories":3026},[],{"categories":3028},[309],{"categories":3030},[91],{"categories":3032},[91],{"categories":3034},[91],{"categories":3036},[237],{"categories":3038},[937],{"categories":3040},[],{"categories":3042},[91],{"categories":3044},[91],{"categories":3046},[91],{"categories":3048},[157],{"categories":3050},[91],{"categories":3052},[91],{"categories":3054},[91],{"categories":3056},[91,309],{"categories":3058},[91],{"categories":3060},[91],{"categories":3062},[237],{"categories":3064},[143],{"categories":3066},[],{"categories":3068},[143],{"categories":3070},[143],{"categories":3072},[91],{"categories":3074},[91],{"categories":3076},[91],{"categories":3078},[91],{"categories":3080},[160],{"categories":3082},[91],{"categories":3084},[91],{"categories":3086},[2696],{"categories":3088},[133],{"categories":3090},[91],{"categories":3092},[160],{"categories":3094},[133],{"categories":3096},[157],{"categories":3098},[237],{"categories":3100},[143],{"categories":3102},[91],{"categories":3104},[],{"categories":3106},[138],{"categories":3108},[91],{"categories":3110},[91],{"categories":3112},[182],{"categories":3114},[91],{"categories":3116},[91],{"categories":3118},[91],{"categories":3120},[143],{"categories":3122},[91],{"categories":3124},[91],{"categories":3126},[237],{"categories":3128},[91],{"categories":3130},[138],{"categories":3132},[],{"categories":3134},[309],{"categories":3136},[91],{"categories":3138},[415],{"categories":3140},[237],{"categories":3142},[237],{"categories":3144},[157],{"categories":3146},[143],{"categories":3148},[91],{"categories":3150},[138],{"categories":3152},[182],{"categories":3154},[91],{"categories":3156},[91],{"categories":3158},[91],{"categories":3160},[237],{"categories":3162},[143],{"categories":3164},[91],{"categories":3166},[143],{"categories":3168},[91],{"categories":3170},[143],{"categories":3172},[91],{"categories":3174},[565],{"categories":3176},[91],{"categories":3178},[143],{"categories":3180},[],{"categories":3182},[91],{"categories":3184},[91],{"categories":3186},[91],{"categories":3188},[91],{"categories":3190},[],{"categories":3192},[],{"categories":3194},[91],{"categories":3196},[91],{"categories":3198},[143],{"categories":3200},[91],{"categories":3202},[91],{"categories":3204},[91],{"categories":3206},[157],{"categories":3208},[91],{"categories":3210},[91],{"categories":3212},[143],{"categories":3214},[91],{"categories":3216},[91],{"categories":3218},[91],{"categories":3220},[91],{"categories":3222},[91],{"categories":3224},[],{"categories":3226},[157],{"categories":3228},[160],{"categories":3230},[91],{"categories":3232},[143],{"categories":3234},[143],{"categories":3236},[91],{"categories":3238},[91],{"categories":3240},[],{"categories":3242},[],{"categories":3244},[91],{"categories":3246},[91],{"categories":3248},[91],{"categories":3250},[182],{"categories":3252},[160],{"categories":3254},[],{"categories":3256},[91],{"categories":3258},[237],{"categories":3260},[91],{"categories":3262},[309],{"categories":3264},[1936],{"categories":3266},[91],{"categories":3268},[182],{"categories":3270},[157],{"categories":3272},[91],{"categories":3274},[157],{"categories":3276},[157],{"categories":3278},[91],{"categories":3280},[91],{"categories":3282},[157],{"categories":3284},[182],{"categories":3286},[182],{"categories":3288},[309],{"categories":3290},[143],{"categories":3292},[],{"categories":3294},[182],{"categories":3296},[138],{"categories":3298},[91],{"categories":3300},[143],{"categories":3302},[133],{"categories":3304},[157],{"categories":3306},[91],{"categories":3308},[182],{"categories":3310},[],{"categories":3312},[91],{"categories":3314},[157],{"categories":3316},[157],{"categories":3318},[160],{"categories":3320},[91],{"categories":3322},[182],{"categories":3324},[91],{"categories":3326},[157],{"categories":3328},[143],{"categories":3330},[143],{"categories":3332},[182],{"categories":3334},[143],{"categories":3336},[309],{"categories":3338},[143],{"categories":3340},[91],{"categories":3342},[91],{"categories":3344},[91],{"categories":3346},[91],{"categories":3348},[91],{"categories":3350},[157],{"categories":3352},[91],{"categories":3354},[],{"categories":3356},[143],{"categories":3358},[138],{"categories":3360},[157],{"categories":3362},[],{"categories":3364},[],{"categories":3366},[91],{"categories":3368},[143],{"categories":3370},[91],{"categories":3372},[91],{"categories":3374},[91],{"categories":3376},[3377],"Frameworks & Tooling",{"categories":3379},[91],{"categories":3381},[91],{"categories":3383},[157],{"categories":3385},[91],{"categories":3387},[91],{"categories":3389},[],{"categories":3391},[160],{"categories":3393},[160],{"categories":3395},[91],{"categories":3397},[133],{"categories":3399},[91],{"categories":3401},[143],{"categories":3403},[91],{"categories":3405},[237],{"categories":3407},[],{"categories":3409},[1936],{"categories":3411},[91],{"categories":3413},[157],{"categories":3415},[91],{"categories":3417},[309],{"categories":3419},[309],{"categories":3421},[],{"categories":3423},[143],{"categories":3425},[143],{"categories":3427},[91],{"categories":3429},[91],{"categories":3431},[182],{"categories":3433},[143],{"categories":3435},[182],{"categories":3437},[91],{"categories":3439},[143],{"categories":3441},[],{"categories":3443},[237],{"categories":3445},[91],{"categories":3447},[91],{"categories":3449},[],{"categories":3451},[91],{"categories":3453},[143],{"categories":3455},[91],{"categories":3457},[91],{"categories":3459},[91],{"categories":3461},[],{"categories":3463},[138],{"categories":3465},[157],{"categories":3467},[91],{"categories":3469},[157],{"categories":3471},[309],{"categories":3473},[91],{"categories":3475},[91],{"categories":3477},[91],{"categories":3479},[157],{"categories":3481},[91],{"categories":3483},[138],{"categories":3485},[91],{"categories":3487},[1936],{"categories":3489},[],{"categories":3491},[143],{"categories":3493},[133],{"categories":3495},[91],{"categories":3497},[133],{"categories":3499},[91],{"categories":3501},[],{"categories":3503},[143],{"categories":3505},[91],{"categories":3507},[91],{"categories":3509},[3510],"AI Design Tooling",{"categories":3512},[237],{"categories":3514},[91],{"categories":3516},[91],{"categories":3518},[157],{"categories":3520},[237],{"categories":3522},[91],{"categories":3524},[91],{"categories":3526},[157],{"categories":3528},[143],{"categories":3530},[182],{"categories":3532},[146],{"categories":3534},[157],{"categories":3536},[91],{"categories":3538},[91],{"categories":3540},[91],{"categories":3542},[143],{"categories":3544},[91],{"categories":3546},[],{"categories":3548},[143],{"categories":3550},[91],{"categories":3552},[91],{"categories":3554},[143],{"categories":3556},[91],{"categories":3558},[91],{"categories":3560},[91],{"categories":3562},[143],{"categories":3564},[],{"categories":3566},[143],{"categories":3568},[3377],{"categories":3570},[91],{"categories":3572},[91],{"categories":3574},[143],{"categories":3576},[143],{"categories":3578},[157],{"categories":3580},[157],{"categories":3582},[91],{"categories":3584},[91],{"categories":3586},[],{"categories":3588},[157],{"categories":3590},[91],{"categories":3592},[91],{"categories":3594},[143],{"categories":3596},[138],{"categories":3598},[91],{"categories":3600},[],{"categories":3602},[91],{"categories":3604},[91],{"categories":3606},[2421],{"categories":3608},[],{"categories":3610},[91],{"categories":3612},[91],{"categories":3614},[91],{"categories":3616},[91],{"categories":3618},[237],{"categories":3620},[91],{"categories":3622},[],{"categories":3624},[91],{"categories":3626},[91],{"categories":3628},[91],{"categories":3630},[91],{"categories":3632},[268],{"categories":3634},[182],{"categories":3636},[91],{"categories":3638},[91],{"categories":3640},[1936],{"categories":3642},[91],{"categories":3644},[133],{"categories":3646},[91],{"categories":3648},[91],{"categories":3650},[160],{"categories":3652},[143],{"categories":3654},[91],{"categories":3656},[91],{"categories":3658},[182],{"categories":3660},[143],{"categories":3662},[],{"categories":3664},[91],{"categories":3666},[91],{"categories":3668},[237],{"categories":3670},[91],{"categories":3672},[268],{"categories":3674},[143],{"categories":3676},[91],{"categories":3678},[143],{"categories":3680},[91],{"categories":3682},[],{"categories":3684},[],{"categories":3686},[],{"categories":3688},[133],{"categories":3690},[182],{"categories":3692},[143],{"categories":3694},[91],{"categories":3696},[91],{"categories":3698},[91],{"categories":3700},[91],{"categories":3702},[438],{"categories":3704},[237],{"categories":3706},[143],{"categories":3708},[91],{"categories":3710},[],{"categories":3712},[143],{"categories":3714},[143],{"categories":3716},[],{"categories":3718},[91],{"categories":3720},[143],{"categories":3722},[91],{"categories":3724},[],{"categories":3726},[91],{"categories":3728},[91],{"categories":3730},[91],{"categories":3732},[182],{"categories":3734},[237],{"categories":3736},[143],{"categories":3738},[237],{"categories":3740},[143],{"categories":3742},[91],{"categories":3744},[138],{"categories":3746},[],{"categories":3748},[],{"categories":3750},[91],{"categories":3752},[91],{"categories":3754},[91],{"categories":3756},[133],{"categories":3758},[91],{"categories":3760},[143],{"categories":3762},[182],{"categories":3764},[],{"categories":3766},[237],{"categories":3768},[143],{"categories":3770},[],{"categories":3772},[157],{"categories":3774},[91],{"categories":3776},[157],{"categories":3778},[237],{"categories":3780},[157],{"categories":3782},[91],{"categories":3784},[],{"categories":3786},[91],{"categories":3788},[91],{"categories":3790},[143],{"categories":3792},[],{"categories":3794},[91],{"categories":3796},[91],{"categories":3798},[268],{"categories":3800},[91],{"categories":3802},[91],{"categories":3804},[309],{"categories":3806},[157],{"categories":3808},[91],{"categories":3810},[143],{"categories":3812},[],{"categories":3814},[91],{"categories":3816},[143],{"categories":3818},[91],{"categories":3820},[133],{"categories":3822},[565],{"categories":3824},[91],{"categories":3826},[91],{"categories":3828},[91],{"categories":3830},[143],{"categories":3832},[91],{"categories":3834},[143],{"categories":3836},[91],{"categories":3838},[91],{"categories":3840},[91],{"categories":3842},[143],{"categories":3844},[91],{"categories":3846},[91],{"categories":3848},[],{"categories":3850},[91],{"categories":3852},[133],{"categories":3854},[91],{"categories":3856},[138],{"categories":3858},[157],{"categories":3860},[237],{"categories":3862},[],{"categories":3864},[91],{"categories":3866},[],{"categories":3868},[143],{"categories":3870},[91],{"categories":3872},[143],{"categories":3874},[],{"categories":3876},[143],{"categories":3878},[91],{"categories":3880},[157],{"categories":3882},[237],{"categories":3884},[182],{"categories":3886},[91],{"categories":3888},[182],{"categories":3890},[143],{"categories":3892},[237],{"categories":3894},[91],{"categories":3896},[],{"categories":3898},[91],{"categories":3900},[171],{"categories":3902},[143],{"categories":3904},[91],{"categories":3906},[237],{"categories":3908},[182],{"categories":3910},[91],{"categories":3912},[138],{"categories":3914},[157],{"categories":3916},[91],{"categories":3918},[91],{"categories":3920},[91],{"categories":3922},[91],{"categories":3924},[91],{"categories":3926},[182],{"categories":3928},[157],{"categories":3930},[268],{"categories":3932},[],{"categories":3934},[],{"categories":3936},[160],{"categories":3938},[496],{"categories":3940},[91],{"categories":3942},[143],{"categories":3944},[91,157],{"categories":3946},[182],{"categories":3948},[91],{"categories":3950},[91],{"categories":3952},[91],{"categories":3954},[91],{"categories":3956},[91],{"categories":3958},[91],{"categories":3960},[91],{"categories":3962},[143],{"categories":3964},[91],{"categories":3966},[91],{"categories":3968},[143],{"categories":3970},[91],{"categories":3972},[91],{"categories":3974},[91],{"categories":3976},[],{"categories":3978},[91],{"categories":3980},[1318],{"categories":3982},[157],{"categories":3984},[237],{"categories":3986},[91],{"categories":3988},[91],{"categories":3990},[91],{"categories":3992},[91],{"categories":3994},[160],{"categories":3996},[143],{"categories":3998},[268],{"categories":4000},[309],{"categories":4002},[],{"categories":4004},[157],{"categories":4006},[91],{"categories":4008},[138],{"categories":4010},[143],{"categories":4012},[91],{"categories":4014},[133],{"categories":4016},[143],{"categories":4018},[91],{"categories":4020},[143],{"categories":4022},[143],{"categories":4024},[146],{"categories":4026},[157],{"categories":4028},[91],{"categories":4030},[91],{"categories":4032},[],{"categories":4034},[],{"categories":4036},[],{"categories":4038},[309],{"categories":4040},[91],{"categories":4042},[182],{"categories":4044},[91],{"categories":4046},[91],{"categories":4048},[91],{"categories":4050},[91],{"categories":4052},[157],{"categories":4054},[91],{"categories":4056},[],{"categories":4058},[91],{"categories":4060},[160],{"categories":4062},[138],{"categories":4064},[143],{"categories":4066},[91],{"categories":4068},[],{"categories":4070},[91],{"categories":4072},[143],{"categories":4074},[157],{"categories":4076},[91],{"categories":4078},[91],{"categories":4080},[91],{"categories":4082},[309],{"categories":4084},[],{"categories":4086},[237],{"categories":4088},[237],{"categories":4090},[91],{"categories":4092},[143],{"categories":4094},[],{"categories":4096},[157],{"categories":4098},[91],{"categories":4100},[237],{"categories":4102},[91],{"categories":4104},[138],{"categories":4106},[143],{"categories":4108},[91],{"categories":4110},[],{"categories":4112},[182],{"categories":4114},[91],{"categories":4116},[91],{"categories":4118},[91],{"categories":4120},[91],{"categories":4122},[237],{"categories":4124},[143],{"categories":4126},[182],{"categories":4128},[],{"categories":4130},[143],{"categories":4132},[91],{"categories":4134},[138],{"categories":4136},[143],{"categories":4138},[237],{"categories":4140},[91],{"categories":4142},[91],{"categories":4144},[91],{"categories":4146},[496],{"categories":4148},[91],{"categories":4150},[143],{"categories":4152},[],{"categories":4154},[91],{"categories":4156},[91],{"categories":4158},[309],{"categories":4160},[182],{"categories":4162},[160],{"categories":4164},[611],{"categories":4166},[160],{"categories":4168},[160],{"categories":4170},[91],{"categories":4172},[],{"categories":4174},[],{"categories":4176},[],{"categories":4178},[143],{"categories":4180},[91],{"categories":4182},[91],{"categories":4184},[143],{"categories":4186},[143],{"categories":4188},[157],{"categories":4190},[91],{"categories":4192},[471],{"categories":4194},[157],{"categories":4196},[91],{"categories":4198},[143],{"categories":4200},[91],{"categories":4202},[91],{"categories":4204},[91],{"categories":4206},[138],{"categories":4208},[91],{"categories":4210},[91],{"categories":4212},[91],{"categories":4214},[143],{"categories":4216},[91],{"categories":4218},[],{"categories":4220},[],{"categories":4222},[91],{"categories":4224},[],{"categories":4226},[91],{"categories":4228},[143],{"categories":4230},[237],{"categories":4232},[91],{"categories":4234},[91],{"categories":4236},[143],{"categories":4238},[],{"categories":4240},[143],{"categories":4242},[91],{"categories":4244},[91],{"categories":4246},[146],{"categories":4248},[91],{"categories":4250},[237],{"categories":4252},[91],{"categories":4254},[143],{"categories":4256},[138],{"categories":4258},[91],{"categories":4260},[91],{"categories":4262},[91],{"categories":4264},[268],{"categories":4266},[143],{"categories":4268},[91],{"categories":4270},[91],{"categories":4272},[937],{"categories":4274},[91],{"categories":4276},[143],{"categories":4278},[91],{"categories":4280},[157],{"categories":4282},[91],{"categories":4284},[565],{"categories":4286},[237],{"categories":4288},[],{"categories":4290},[91],{"categories":4292},[91],{"categories":4294},[182],{"categories":4296},[496],{"categories":4298},[143],{"categories":4300},[91],{"categories":4302},[],{"categories":4304},[182],{"categories":4306},[415],{"categories":4308},[143],{"categories":4310},[143],{"categories":4312},[143],{"categories":4314},[91],{"categories":4316},[91],{"categories":4318},[143],{"categories":4320},[91],{"categories":4322},[],{"categories":4324},[138],{"categories":4326},[91],{"categories":4328},[237],{"categories":4330},[138],{"categories":4332},[143],{"categories":4334},[],{"categories":4336},[157],{"categories":4338},[91],{"categories":4340},[91],{"categories":4342},[133],{"categories":4344},[91],{"categories":4346},[182],{"categories":4348},[309],{"categories":4350},[171],{"categories":4352},[143],{"categories":4354},[143],{"categories":4356},[91],{"categories":4358},[91],{"categories":4360},[143],{"categories":4362},[91],{"categories":4364},[133],{"categories":4366},[],{"categories":4368},[143],{"categories":4370},[91],{"categories":4372},[91],{"categories":4374},[91],{"categories":4376},[143],{"categories":4378},[91],{"categories":4380},[],{"categories":4382},[91],{"categories":4384},[],{"categories":4386},[237],{"categories":4388},[143],{"categories":4390},[91,138],{"categories":4392},[143],{"categories":4394},[91],{"categories":4396},[],{"categories":4398},[133],{"categories":4400},[160],{"categories":4402},[138],{"categories":4404},[91],{"categories":4406},[157],{"categories":4408},[91],{"categories":4410},[91],{"categories":4412},[143],{"categories":4414},[91],{"categories":4416},[91],{"categories":4418},[91],{"categories":4420},[182],{"categories":4422},[1318],{"categories":4424},[143],{"categories":4426},[91],{"categories":4428},[],{"categories":4430},[],{"categories":4432},[91],{"categories":4434},[143],{"categories":4436},[91],{"categories":4438},[91],{"categories":4440},[309],{"categories":4442},[],{"categories":4444},[91],{"categories":4446},[143],{"categories":4448},[171],{"categories":4450},[143],{"categories":4452},[91],{"categories":4454},[496],{"categories":4456},[],{"categories":4458},[438],{"categories":4460},[91],{"categories":4462},[143],{"categories":4464},[91],{"categories":4466},[91],{"categories":4468},[91],{"categories":4470},[268],{"categories":4472},[91],{"categories":4474},[143],{"categories":4476},[91],{"categories":4478},[160],{"categories":4480},[146],{"categories":4482},[143],{"categories":4484},[91],{"categories":4486},[496],{"categories":4488},[91],{"categories":4490},[309],{"categories":4492},[138],{"categories":4494},[],{"categories":4496},[91],{"categories":4498},[91],{"categories":4500},[268],{"categories":4502},[237],{"categories":4504},[91],{"categories":4506},[91],{"categories":4508},[91],{"categories":4510},[],{"categories":4512},[268],{"categories":4514},[182],{"categories":4516},[91],{"categories":4518},[91],{"categories":4520},[91],{"categories":4522},[611],{"categories":4524},[133],{"categories":4526},[91],{"categories":4528},[146],{"categories":4530},[91],{"categories":4532},[91],{"categories":4534},[],{"categories":4536},[],{"categories":4538},[237],{"categories":4540},[91],{"categories":4542},[91],{"categories":4544},[160],{"categories":4546},[268],{"categories":4548},[143],{"categories":4550},[91],{"categories":4552},[91],{"categories":4554},[268],{"categories":4556},[138],{"categories":4558},[182],{"categories":4560},[91],{"categories":4562},[],{"categories":4564},[91],{"categories":4566},[91],{"categories":4568},[],{"categories":4570},[91],{"categories":4572},[91],{"categories":4574},[638],{"categories":4576},[91],{"categories":4578},[91],{"categories":4580},[143],{"categories":4582},[157],{"categories":4584},[496],{"categories":4586},[91],{"categories":4588},[138],{"categories":4590},[91],{"categories":4592},[91],{"categories":4594},[],{"categories":4596},[91,157],{"categories":4598},[182],{"categories":4600},[143],{"categories":4602},[157],{"categories":4604},[143],{"categories":4606},[977],{"categories":4608},[157],{"categories":4610},[157],{"categories":4612},[143],{"categories":4614},[91],{"categories":4616},[133],{"categories":4618},[91],{"categories":4620},[],{"categories":4622},[],{"categories":4624},[143],{"categories":4626},[91],{"categories":4628},[157],{"categories":4630},[143],{"categories":4632},[91],{"categories":4634},[133],{"categories":4636},[157],{"categories":4638},[157],{"categories":4640},[91],{"categories":4642},[268],{"categories":4644},[91],{"categories":4646},[91],{"categories":4648},[157],{"categories":4650},[91],{"categories":4652},[],{"categories":4654},[91],{"categories":4656},[91],{"categories":4658},[237,91],{"categories":4660},[309],{"categories":4662},[133],{"categories":4664},[91],{"categories":4666},[],{"categories":4668},[91],{"categories":4670},[91],{"categories":4672},[138],{"categories":4674},[91],{"categories":4676},[138],{"categories":4678},[91],{"categories":4680},[91],{"categories":4682},[415],{"categories":4684},[91],{"categories":4686},[138],{"categories":4688},[157],{"categories":4690},[160],{"categories":4692},[143],{"categories":4694},[91],{"categories":4696},[157],{"categories":4698},[91],{"categories":4700},[91],{"categories":4702},[182],{"categories":4704},[268],{"categories":4706},[237],{"categories":4708},[91],{"categories":4710},[91],{"categories":4712},[146],{"categories":4714},[91],{"categories":4716},[91],{"categories":4718},[133],{"categories":4720},[91],{"categories":4722},[143],{"categories":4724},[143],{"categories":4726},[157],{"categories":4728},[91],{"categories":4730},[182],{"categories":4732},[157],{"categories":4734},[157],{"categories":4736},[91],{"categories":4738},[91],{"categories":4740},[],{"categories":4742},[],{"categories":4744},[160],{"categories":4746},[91],{"categories":4748},[157],{"categories":4750},[91],{"categories":4752},[237],{"categories":4754},[496],{"categories":4756},[438],{"categories":4758},[415],{"categories":4760},[91],{"categories":4762},[91],{"categories":4764},[157],{"categories":4766},[91],{"categories":4768},[160],{"categories":4770},[91],{"categories":4772},[91],{"categories":4774},[91],{"categories":4776},[91],{"categories":4778},[91],{"categories":4780},[91],{"categories":4782},[91],{"categories":4784},[143],{"categories":4786},[133],{"categories":4788},[143],{"categories":4790},[91,138],{"categories":4792},[],{"categories":4794},[237],{"categories":4796},[],{"categories":4798},[146],{"categories":4800},[91],{"categories":4802},[182],{"categories":4804},[133],{"categories":4806},[91],{"categories":4808},[133],{"categories":4810},[143],{"categories":4812},[160],{"categories":4814},[143],{"categories":4816},[138],{"categories":4818},[146],{"categories":4820},[91],{"categories":4822},[143],{"categories":4824},[91],{"categories":4826},[91],{"categories":4828},[91],{"categories":4830},[138],{"categories":4832},[143],{"categories":4834},[157],{"categories":4836},[268],{"categories":4838},[91],{"categories":4840},[91],{"categories":4842},[],{"categories":4844},[182],{"categories":4846},[91],{"categories":4848},[91],{"categories":4850},[91],{"categories":4852},[91],{"categories":4854},[91],{"categories":4856},[91],{"categories":4858},[157],{"categories":4860},[182],{"categories":4862},[157],{"categories":4864},[157],{"categories":4866},[91],{"categories":4868},[91],{"categories":4870},[91],{"categories":4872},[91],{"categories":4874},[438],{"categories":4876},[91],{"categories":4878},[143],{"categories":4880},[143],{"categories":4882},[182],{"categories":4884},[91],{"categories":4886},[91],{"categories":4888},[91],{"categories":4890},[143],{"categories":4892},[91],{"categories":4894},[91],{"categories":4896},[91],{"categories":4898},[3377],{"categories":4900},[4901],"Clinical AI",{"categories":4903},[237],{"categories":4905},[91],{"categories":4907},[91],{"categories":4909},[91],{"categories":4911},[91],{"categories":4913},[309],{"categories":4915},[2696],{"categories":4917},[91],{"categories":4919},[146],{"categories":4921},[237],{"categories":4923},[91],{"categories":4925},[143],{"categories":4927},[91],{"categories":4929},[91],{"categories":4931},[182],{"categories":4933},[91],{"categories":4935},[143],{"categories":4937},[157],{"categories":4939},[268],{"categories":4941},[91],{"categories":4943},[91],{"categories":4945},[138],{"categories":4947},[91],{"categories":4949},[91],{"categories":4951},[565],{"categories":4953},[91],{"categories":4955},[],{"categories":4957},[143],{"categories":4959},[91],{"categories":4961},[157],{"categories":4963},[133],{"categories":4965},[91],{"categories":4967},[],{"categories":4969},[],{"categories":4971},[91],{"categories":4973},[],{"categories":4975},[138],{"categories":4977},[91],{"categories":4979},[91],{"categories":4981},[143],{"categories":4983},[91],{"categories":4985},[182],{"categories":4987},[182],{"categories":4989},[182],{"categories":4991},[182],{"categories":4993},[],{"categories":4995},[133],{"categories":4997},[143],{"categories":4999},[182],{"categories":5001},[91],{"categories":5003},[638],{"categories":5005},[146],{"categories":5007},[143],{"categories":5009},[91],{"categories":5011},[133],{"categories":5013},[91],{"categories":5015},[143],{"categories":5017},[91],{"categories":5019},[91],{"categories":5021},[91],{"categories":5023},[91],{"categories":5025},[91,143],{"categories":5027},[143],{"categories":5029},[309],{"categories":5031},[182],{"categories":5033},[143],{"categories":5035},[182],{"categories":5037},[143],{"categories":5039},[91],{"categories":5041},[],{"categories":5043},[182],{"categories":5045},[268],{"categories":5047},[133],{"categories":5049},[91],{"categories":5051},[91],{"categories":5053},[],{"categories":5055},[157],{"categories":5057},[],{"categories":5059},[133],{"categories":5061},[143],{"categories":5063},[182],{"categories":5065},[91],{"categories":5067},[182],{"categories":5069},[133],{"categories":5071},[182],{"categories":5073},[182],{"categories":5075},[],{"categories":5077},[138],{"categories":5079},[143],{"categories":5081},[182],{"categories":5083},[182],{"categories":5085},[182],{"categories":5087},[182],{"categories":5089},[182],{"categories":5091},[182],{"categories":5093},[182],{"categories":5095},[182],{"categories":5097},[182],{"categories":5099},[182],{"categories":5101},[160],{"categories":5103},[133],{"categories":5105},[91],{"categories":5107},[91],{"categories":5109},[143],{"categories":5111},[143],{"categories":5113},[],{"categories":5115},[91],{"categories":5117},[91,133],{"categories":5119},[],{"categories":5121},[143],{"categories":5123},[91],{"categories":5125},[182],{"categories":5127},[143],{"categories":5129},[143],{"categories":5131},[977],{"categories":5133},[91],{"categories":5135},[91],{"categories":5137},[91],{"categories":5139},[91],{"categories":5141},[146],{"categories":5143},[91],{"categories":5145},[91],{"categories":5147},[415],{"categories":5149},[91],{"categories":5151},[91],{"categories":5153},[143],{"categories":5155},[91],{"categories":5157},[91],{"categories":5159},[91],{"categories":5161},[138],{"categories":5163},[146],{"categories":5165},[143],{"categories":5167},[143],{"categories":5169},[],{"categories":5171},[143],{"categories":5173},[237],{"categories":5175},[182],{"categories":5177},[91],{"categories":5179},[],{"categories":5181},[146],{"categories":5183},[],{"categories":5185},[157],{"categories":5187},[91],{"categories":5189},[143],{"categories":5191},[237],{"categories":5193},[91],{"categories":5195},[91],{"categories":5197},[],{"categories":5199},[91],{"categories":5201},[91],{"categories":5203},[],{"categories":5205},[268],{"categories":5207},[91],{"categories":5209},[143],{"categories":5211},[],{"categories":5213},[],{"categories":5215},[182],{"categories":5217},[133],{"categories":5219},[91],{"categories":5221},[91],{"categories":5223},[138],{"categories":5225},[91],{"categories":5227},[91],{"categories":5229},[143],{"categories":5231},[91],{"categories":5233},[138],{"categories":5235},[138],{"categories":5237},[237],{"categories":5239},[],{"categories":5241},[91],{"categories":5243},[182],{"categories":5245},[],{"categories":5247},[91],{"categories":5249},[91],{"categories":5251},[237],{"categories":5253},[91],{"categories":5255},[91],{"categories":5257},[268],{"categories":5259},[91],{"categories":5261},[309],{"categories":5263},[],{"categories":5265},[143],{"categories":5267},[91],{"categories":5269},[268],{"categories":5271},[157],{"categories":5273},[],{"categories":5275},[91],{"categories":5277},[],{"categories":5279},[143],{"categories":5281},[237],{"categories":5283},[157],{"categories":5285},[],{"categories":5287},[3377],{"categories":5289},[138],{"categories":5291},[133],{"categories":5293},[91],{"categories":5295},[160],{"categories":5297},[143],{"categories":5299},[237],{"categories":5301},[91],{"categories":5303},[91],{"categories":5305},[157],{"categories":5307},[],{"categories":5309},[],{"categories":5311},[91],{"categories":5313},[133],{"categories":5315},[91],{"categories":5317},[268],{"categories":5319},[],{"categories":5321},[143],{"categories":5323},[143],{"categories":5325},[91],{"categories":5327},[143],{"categories":5329},[91],{"categories":5331},[182],{"categories":5333},[91],{"categories":5335},[157],{"categories":5337},[91],{"categories":5339},[143],{"categories":5341},[146],{"categories":5343},[91],{"categories":5345},[91],{"categories":5347},[91],{"categories":5349},[91],{"categories":5351},[143],{"categories":5353},[91],{"categories":5355},[146],{"categories":5357},[268],{"categories":5359},[182],{"categories":5361},[],{"categories":5363},[268],{"categories":5365},[91],{"categories":5367},[],{"categories":5369},[157],{"categories":5371},[143],{"categories":5373},[],{"categories":5375},[91],{"categories":5377},[91],{"categories":5379},[91],{"categories":5381},[91],{"categories":5383},[91],{"categories":5385},[143],{"categories":5387},[138],{"categories":5389},[133],{"categories":5391},[91],{"categories":5393},[91],{"categories":5395},[143],{"categories":5397},[91],{"categories":5399},[237],{"categories":5401},[157],{"categories":5403},[157],{"categories":5405},[91],{"categories":5407},[160],{"categories":5409},[143],{"categories":5411},[91],{"categories":5413},[91],{"categories":5415},[143],{"categories":5417},[91],{"categories":5419},[91],{"categories":5421},[143],{"categories":5423},[138],{"categories":5425},[91],{"categories":5427},[237],{"categories":5429},[157],{"categories":5431},[143],{"categories":5433},[91],{"categories":5435},[146],{"categories":5437},[91],{"categories":5439},[146],{"categories":5441},[143],{"categories":5443},[91],{"categories":5445},[91],{"categories":5447},[182],{"categories":5449},[91],{"categories":5451},[],{"categories":5453},[133],{"categories":5455},[91],{"categories":5457},[91],{"categories":5459},[91],{"categories":5461},[157],{"categories":5463},[157],{"categories":5465},[91],{"categories":5467},[157],{"categories":5469},[91],{"categories":5471},[143],{"categories":5473},[91],{"categories":5475},[91],{"categories":5477},[91],{"categories":5479},[91],{"categories":5481},[91],{"categories":5483},[],{"categories":5485},[91],{"categories":5487},[237],{"categories":5489},[143],{"categories":5491},[138],{"categories":5493},[182],{"categories":5495},[91],{"categories":5497},[143],{"categories":5499},[91],{"categories":5501},[143],{"categories":5503},[91],{"categories":5505},[91],{"categories":5507},[237],{"categories":5509},[143],{"categories":5511},[91],{"categories":5513},[268],{"categories":5515},[138],{"categories":5517},[91],{"categories":5519},[160],{"categories":5521},[91],{"categories":5523},[91],{"categories":5525},[182],{"categories":5527},[91],{"categories":5529},[91],{"categories":5531},[91],{"categories":5533},[91],{"categories":5535},[143],{"categories":5537},[309],{"categories":5539},[91],{"categories":5541},[157],{"categories":5543},[143],{"categories":5545},[160],{"categories":5547},[],{"categories":5549},[143],{"categories":5551},[157],{"categories":5553},[91],{"categories":5555},[91],{"categories":5557},[91],{"categories":5559},[2520],{"categories":5561},[91],{"categories":5563},[237],{"categories":5565},[344],{"categories":5567},[91],{"categories":5569},[91],{"categories":5571},[91],{"categories":5573},[91],{"categories":5575},[91],{"categories":5577},[133],{"categories":5579},[143],{"categories":5581},[91],{"categories":5583},[91],{"categories":5585},[157],{"categories":5587},[138],{"categories":5589},[91],{"categories":5591},[157],{"categories":5593},[91],{"categories":5595},[],{"categories":5597},[143],{"categories":5599},[143],{"categories":5601},[91],{"categories":5603},[91],{"categories":5605},[91],{"categories":5607},[160],{"categories":5609},[],{"categories":5611},[182],{"categories":5613},[],{"categories":5615},[182],{"categories":5617},[91],{"categories":5619},[91],{"categories":5621},[91],{"categories":5623},[143],{"categories":5625},[91],{"categories":5627},[143],{"categories":5629},[143],{"categories":5631},[],{"categories":5633},[91],{"categories":5635},[182],{"categories":5637},[91],{"categories":5639},[],{"categories":5641},[91],{"categories":5643},[91],{"categories":5645},[],{"categories":5647},[91],{"categories":5649},[91],{"categories":5651},[237],{"categories":5653},[157],{"categories":5655},[143],{"categories":5657},[91],{"categories":5659},[91],{"categories":5661},[91],{"categories":5663},[91],{"categories":5665},[268],{"categories":5667},[91],{"categories":5669},[91],{"categories":5671},[91],{"categories":5673},[133],{"categories":5675},[91],{"categories":5677},[91],{"categories":5679},[],{"categories":5681},[91],{"categories":5683},[91],{"categories":5685},[91],{"categories":5687},[],{"categories":5689},[133],{"categories":5691},[91],{"categories":5693},[91],{"categories":5695},[91],{"categories":5697},[182],{"categories":5699},[91],{"categories":5701},[157],{"categories":5703},[146],{"categories":5705},[143],{"categories":5707},[496],{"categories":5709},[91],{"categories":5711},[91],{"categories":5713},[91],{"categories":5715},[157],{"categories":5717},[182],{"categories":5719},[237],{"categories":5721},[91],{"categories":5723},[91],{"categories":5725},[91],{"categories":5727},[91],{"categories":5729},[91],{"categories":5731},[91],{"categories":5733},[182],{"categories":5735},[91],{"categories":5737},[237],{"categories":5739},[91],{"categories":5741},[91],{"categories":5743},[182],{"categories":5745},[237],{"categories":5747},[91],{"categories":5749},[182],{"categories":5751},[91],{"categories":5753},[143],{"categories":5755},[143],{"categories":5757},[143],{"categories":5759},[157],{"categories":5761},[182],{"categories":5763},[143],{"categories":5765},[143],{"categories":5767},[91],{"categories":5769},[157],{"categories":5771},[237],{"categories":5773},[91],{"categories":5775},[91],{"categories":5777},[143],{"categories":5779},[91],{"categories":5781},[],{"categories":5783},[143],{"categories":5785},[],{"categories":5787},[91],{"categories":5789},[91],{"categories":5791},[],{"categories":5793},[],{"categories":5795},[143],{"categories":5797},[138],{"categories":5799},[143],{"categories":5801},[5802],"Liability & Ethics",{"categories":5804},[91],{"categories":5806},[91],{"categories":5808},[91],{"categories":5810},[143],{"categories":5812},[133],{"categories":5814},[143],{"categories":5816},[138],{"categories":5818},[268],{"categories":5820},[91],{"categories":5822},[143],{"categories":5824},[91],{"categories":5826},[91],{"categories":5828},[91],{"categories":5830},[],{"categories":5832},[611],{"categories":5834},[143],{"categories":5836},[],{"categories":5838},[91],{"categories":5840},[133],{"categories":5842},[143],{"categories":5844},[91],{"categories":5846},[],{"categories":5848},[143],{"categories":5850},[91],{"categories":5852},[91],{"categories":5854},[157],{"categories":5856},[91],{"categories":5858},[182],{"categories":5860},[91],{"categories":5862},[91],{"categories":5864},[146],{"categories":5866},[91],{"categories":5868},[143],{"categories":5870},[91],{"categories":5872},[91],{"categories":5874},[91],{"categories":5876},[182],{"categories":5878},[143],{"categories":5880},[157],{"categories":5882},[237],{"categories":5884},[133],{"categories":5886},[91],{"categories":5888},[91],{"categories":5890},[91],{"categories":5892},[],{"categories":5894},[143],{"categories":5896},[143],{"categories":5898},[143],{"categories":5900},[496],{"categories":5902},[237],{"categories":5904},[143],{"categories":5906},[309],{"categories":5908},[157],{"categories":5910},[182],{"categories":5912},[91],{"categories":5914},[237],{"categories":5916},[91],{"categories":5918},[133],{"categories":5920},[],{"categories":5922},[143],{"categories":5924},[91],{"categories":5926},[91],{"categories":5928},[91],{"categories":5930},[91],{"categories":5932},[143],{"categories":5934},[91],{"categories":5936},[91],{"categories":5938},[237],{"categories":5940},[143],{"categories":5942},[],{"categories":5944},[143],{"categories":5946},[146],{"categories":5948},[91],{"categories":5950},[182],{"categories":5952},[143],{"categories":5954},[138],{"categories":5956},[],{"categories":5958},[91],{"categories":5960},[91],{"categories":5962},[146],{"categories":5964},[91],{"categories":5966},[143],{"categories":5968},[182],{"categories":5970},[133],{"categories":5972},[309],{"categories":5974},[91],{"categories":5976},[91],{"categories":5978},[91],{"categories":5980},[182],{"categories":5982},[138],{"categories":5984},[91],{"categories":5986},[237],{"categories":5988},[182],{"categories":5990},[309],{"categories":5992},[91],{"categories":5994},[143],{"categories":5996},[],{"categories":5998},[565],{"categories":6000},[],{"categories":6002},[91],{"categories":6004},[309],{"categories":6006},[91],{"categories":6008},[160],{"categories":6010},[91],{"categories":6012},[143],{"categories":6014},[143],{"categories":6016},[6017],"Design News & Tools",{"categories":6019},[91],{"categories":6021},[91],{"categories":6023},[182],{"categories":6025},[91],{"categories":6027},[91],{"categories":6029},[91],{"categories":6031},[133],{"categories":6033},[143],{"categories":6035},[91],{"categories":6037},[237],{"categories":6039},[143],{"categories":6041},[143],{"categories":6043},[237],{"categories":6045},[91],{"categories":6047},[91],{"categories":6049},[91],{"categories":6051},[496],{"categories":6053},[143],{"categories":6055},[91],{"categories":6057},[91],{"categories":6059},[91],{"categories":6061},[496],{"categories":6063},[91],{"categories":6065},[268],{"categories":6067},[91],{"categories":6069},[143],{"categories":6071},[],{"categories":6073},[91],{"categories":6075},[91],{"categories":6077},[91],{"categories":6079},[182],{"categories":6081},[91],{"categories":6083},[133],{"categories":6085},[],{"categories":6087},[91],{"categories":6089},[91],{"categories":6091},[91],{"categories":6093},[157],{"categories":6095},[638],{"categories":6097},[157],{"categories":6099},[237],{"categories":6101},[91],{"categories":6103},[91,143],{"categories":6105},[268,138],{"categories":6107},[157],{"categories":6109},[91],{"categories":6111},[91],{"categories":6113},[91],{"categories":6115},[91],{"categories":6117},[],{"categories":6119},[157],{"categories":6121},[143],{"categories":6123},[91],{"categories":6125},[91],{"categories":6127},[],{"categories":6129},[91],{"categories":6131},[157],{"categories":6133},[91],{"categories":6135},[157],{"categories":6137},[91],{"categories":6139},[],{"categories":6141},[143],{"categories":6143},[91],{"categories":6145},[138],{"categories":6147},[91],{"categories":6149},[182],{"categories":6151},[91],{"categories":6153},[],{"categories":6155},[91],{"categories":6157},[143],{"categories":6159},[91],{"categories":6161},[],{"categories":6163},[237],{"categories":6165},[91],{"categories":6167},[91],{"categories":6169},[143],{"categories":6171},[91],{"categories":6173},[91],{"categories":6175},[91],{"categories":6177},[133],{"categories":6179},[91],{"categories":6181},[143],{"categories":6183},[91],{"categories":6185},[],{"categories":6187},[91],{"categories":6189},[309],{"categories":6191},[268],{"categories":6193},[138],{"categories":6195},[138],{"categories":6197},[91],{"categories":6199},[133],{"categories":6201},[133],{"categories":6203},[91],{"categories":6205},[143],{"categories":6207},[91],{"categories":6209},[91],{"categories":6211},[91],{"categories":6213},[91],{"categories":6215},[157],{"categories":6217},[91],{"categories":6219},[133],{"categories":6221},[91],{"categories":6223},[91],{"categories":6225},[143],{"categories":6227},[91],{"categories":6229},[268],{"categories":6231},[91],{"categories":6233},[182],{"categories":6235},[91],{"categories":6237},[91],{"categories":6239},[143],{"categories":6241},[146],{"categories":6243},[91],{"categories":6245},[143],{"categories":6247},[91],{"categories":6249},[143],{"categories":6251},[],{"categories":6253},[157],{"categories":6255},[],{"categories":6257},[157],{"categories":6259},[143],{"categories":6261},[133],{"categories":6263},[91],{"categories":6265},[],{"categories":6267},[160],{"categories":6269},[309],{"categories":6271},[91],{"categories":6273},[157],{"categories":6275},[91],{"categories":6277},[],{"categories":6279},[182],{"categories":6281},[143],{"categories":6283},[157],{"categories":6285},[237],{"categories":6287},[138],{"categories":6289},[91],{"categories":6291},[91],{"categories":6293},[143],{"categories":6295},[157],{"categories":6297},[143],{"categories":6299},[182],{"categories":6301},[91],{"categories":6303},[146],{"categories":6305},[133],{"categories":6307},[146],{"categories":6309},[182],{"categories":6311},[91],{"categories":6313},[91],{"categories":6315},[157],{"categories":6317},[91],{"categories":6319},[237],{"categories":6321},[138],{"categories":6323},[91],{"categories":6325},[91],{"categories":6327},[91],{"categories":6329},[91],{"categories":6331},[91],{"categories":6333},[91],{"categories":6335},[143],{"categories":6337},[91],{"categories":6339},[91],{"categories":6341},[143],{"categories":6343},[91],{"categories":6345},[91],{"categories":6347},[133],{"categories":6349},[91],{"categories":6351},[143],{"categories":6353},[143],{"categories":6355},[237],{"categories":6357},[143],{"categories":6359},[91],{"categories":6361},[143],{"categories":6363},[91],{"categories":6365},[133],{"categories":6367},[143],{"categories":6369},[237],{"categories":6371},[],{"categories":6373},[91],{"categories":6375},[160],{"categories":6377},[496],{"categories":6379},[91],{"categories":6381},[143],{"categories":6383},[91],{"categories":6385},[91],{"categories":6387},[157],{"categories":6389},[91],{"categories":6391},[],{"categories":6393},[91],{"categories":6395},[143],{"categories":6397},[91],{"categories":6399},[268],{"categories":6401},[237],{"categories":6403},[91],{"categories":6405},[157],{"categories":6407},[91],{"categories":6409},[182],{"categories":6411},[143],{"categories":6413},[91],{"categories":6415},[268],{"categories":6417},[143],{"categories":6419},[138],{"categories":6421},[138],{"categories":6423},[91],{"categories":6425},[91],{"categories":6427},[91],{"categories":6429},[91],{"categories":6431},[91],{"categories":6433},[91],{"categories":6435},[133],{"categories":6437},[91],{"categories":6439},[],{"categories":6441},[91],{"categories":6443},[91],{"categories":6445},[143],{"categories":6447},[91],{"categories":6449},[143],{"categories":6451},[91],{"categories":6453},[91],{"categories":6455},[91],{"categories":6457},[91],{"categories":6459},[91],{"categories":6461},[91],{"categories":6463},[157],{"categories":6465},[],{"categories":6467},[133],{"categories":6469},[91],{"categories":6471},[91],{"categories":6473},[143],{"categories":6475},[143],{"categories":6477},[],{"categories":6479},[157],{"categories":6481},[157],{"categories":6483},[91],{"categories":6485},[268],{"categories":6487},[138],{"categories":6489},[237],{"categories":6491},[91],{"categories":6493},[],{"categories":6495},[91],{"categories":6497},[143],{"categories":6499},[133],{"categories":6501},[91],{"categories":6503},[91],{"categories":6505},[157],{"categories":6507},[133],{"categories":6509},[91],{"categories":6511},[91],{"categories":6513},[182],{"categories":6515},[160],{"categories":6517},[91],{"categories":6519},[182],{"categories":6521},[143],{"categories":6523},[91],{"categories":6525},[91],{"categories":6527},[],{"categories":6529},[182],{"categories":6531},[143],{"categories":6533},[237],{"categories":6535},[160],{"categories":6537},[91],{"categories":6539},[91],{"categories":6541},[91],{"categories":6543},[],{"categories":6545},[143],{"categories":6547},[143],{"categories":6549},[143],{"categories":6551},[3377],{"categories":6553},[182],{"categories":6555},[91],{"categories":6557},[157],{"categories":6559},[91],{"categories":6561},[91],{"categories":6563},[91],{"categories":6565},[91],{"categories":6567},[91],{"categories":6569},[143],{"categories":6571},[91],{"categories":6573},[138],{"categories":6575},[91],{"categories":6577},[133],{"categories":6579},[1936],{"categories":6581},[309],{"categories":6583},[133],{"categories":6585},[],{"categories":6587},[91],{"categories":6589},[],{"categories":6591},[91],{"categories":6593},[182],{"categories":6595},[143],{"categories":6597},[237],{"categories":6599},[91],{"categories":6601},[91],{"categories":6603},[91],{"categories":6605},[91],{"categories":6607},[91],{"categories":6609},[182],{"categories":6611},[],{"categories":6613},[143],{"categories":6615},[91],{"categories":6617},[143],{"categories":6619},[143],{"categories":6621},[],{"categories":6623},[91],{"categories":6625},[],{"categories":6627},[182],{"categories":6629},[133],{"categories":6631},[91],{"categories":6633},[237],{"categories":6635},[91],{"categories":6637},[143],{"categories":6639},[182],{"categories":6641},[91],{"categories":6643},[182],{"categories":6645},[],{"categories":6647},[182],{"categories":6649},[91],{"categories":6651},[133],{"categories":6653},[143],{"categories":6655},[496],{"categories":6657},[143],{"categories":6659},[91],{"categories":6661},[],{"categories":6663},[157],{"categories":6665},[143],{"categories":6667},[146],{"categories":6669},[143],{"categories":6671},[91],{"categories":6673},[133],{"categories":6675},[91],{"categories":6677},[91],{"categories":6679},[],{"categories":6681},[],{"categories":6683},[],{"categories":6685},[237],{"categories":6687},[91],{"categories":6689},[143],{"categories":6691},[91],{"categories":6693},[91],{"categories":6695},[],{"categories":6697},[],{"categories":6699},[],{"categories":6701},[91],{"categories":6703},[143],{"categories":6705},[237],{"categories":6707},[91],{"categories":6709},[],{"categories":6711},[143],{"categories":6713},[91],{"categories":6715},[91],{"categories":6717},[133],{"categories":6719},[],{"categories":6721},[],{"categories":6723},[91],{"categories":6725},[91],{"categories":6727},[143],{"categories":6729},[237],{"categories":6731},[91],{"categories":6733},[182],{"categories":6735},[],{"categories":6737},[91],{"categories":6739},[91],{"categories":6741},[268],{"categories":6743},[182],{"categories":6745},[268],{"categories":6747},[157],{"categories":6749},[160],{"categories":6751},[91],{"categories":6753},[91],{"categories":6755},[],{"categories":6757},[],{"categories":6759},[143],{"categories":6761},[],{"categories":6763},[91],{"categories":6765},[496],{"categories":6767},[91],{"categories":6769},[91],{"categories":6771},[91],{"categories":6773},[91],{"categories":6775},[],{"categories":6777},[143],{"categories":6779},[91],{"categories":6781},[91],{"categories":6783},[],{"categories":6785},[143],{"categories":6787},[143],{"categories":6789},[91],{"categories":6791},[182],{"categories":6793},[91],{"categories":6795},[268],{"categories":6797},[91],{"categories":6799},[143],{"categories":6801},[138],{"categories":6803},[146],{"categories":6805},[91],{"categories":6807},[91],{"categories":6809},[143],{"categories":6811},[160],{"categories":6813},[143],{"categories":6815},[143],{"categories":6817},[],{"categories":6819},[91],{"categories":6821},[143],{"categories":6823},[],{"categories":6825},[91],{"categories":6827},[],{"categories":6829},[182],{"categories":6831},[138],{"categories":6833},[],{"categories":6835},[91],{"categories":6837},[91],{"categories":6839},[91],{"categories":6841},[],{"categories":6843},[143],{"categories":6845},[237],{"categories":6847},[133],{"categories":6849},[91],{"categories":6851},[],{"categories":6853},[138],{"categories":6855},[268],{"categories":6857},[91],{"categories":6859},[157],{"categories":6861},[133],{"categories":6863},[160],{"categories":6865},[138],{"categories":6867},[157],{"categories":6869},[143],{"categories":6871},[157],{"categories":6873},[],{"categories":6875},[91],{"categories":6877},[146],{"categories":6879},[146],{"categories":6881},[91],{"categories":6883},[],{"categories":6885},[143],{"categories":6887},[143],{"categories":6889},[133],{"categories":6891},[237],{"categories":6893},[91],{"categories":6895},[133],{"categories":6897},[143],{"categories":6899},[309],{"categories":6901},[91],{"categories":6903},[91],{"categories":6905},[91],{"categories":6907},[91],{"categories":6909},[91],{"categories":6911},[133],{"categories":6913},[91],{"categories":6915},[157],{"categories":6917},[160],{"categories":6919},[143],{"categories":6921},[],{"categories":6923},[91],{"categories":6925},[91],{"categories":6927},[91],{"categories":6929},[157],{"categories":6931},[143],{"categories":6933},[182],{"categories":6935},[157],{"categories":6937},[91],{"categories":6939},[146],{"categories":6941},[],{"categories":6943},[237],{"categories":6945},[157],{"categories":6947},[182],{"categories":6949},[91],{"categories":6951},[133],{"categories":6953},[143],{"categories":6955},[91],{"categories":6957},[91],{"categories":6959},[143],{"categories":6961},[146],{"categories":6963},[91],{"categories":6965},[143],{"categories":6967},[91],{"categories":6969},[138],{"categories":6971},[91],{"categories":6973},[143],{"categories":6975},[143,309],{"categories":6977},[91],{"categories":6979},[91],{"categories":6981},[143],{"categories":6983},[157],{"categories":6985},[91],{"categories":6987},[91],{"categories":6989},[160],{"categories":6991},[143],{"categories":6993},[268],{"categories":6995},[143],{"categories":6997},[138],{"categories":6999},[],{"categories":7001},[143],{"categories":7003},[91],{"categories":7005},[138],{"categories":7007},[],{"categories":7009},[],{"categories":7011},[91],{"categories":7013},[157],{"categories":7015},[91],{"categories":7017},[91],{"categories":7019},[143],{"categories":7021},[91],{"categories":7023},[160],{"categories":7025},[268],{"categories":7027},[91],{"categories":7029},[91],{"categories":7031},[91],{"categories":7033},[91],{"categories":7035},[143],{"categories":7037},[],{"categories":7039},[143],{"categories":7041},[182],{"categories":7043},[91],{"categories":7045},[143],{"categories":7047},[143],{"categories":7049},[91],{"categories":7051},[],{"categories":7053},[182],{"categories":7055},[157],{"categories":7057},[3377],{"categories":7059},[133],{"categories":7061},[157],{"categories":7063},[91],{"categories":7065},[143],{"categories":7067},[91],{"categories":7069},[91],{"categories":7071},[268],{"categories":7073},[157],{"categories":7075},[160],{"categories":7077},[],{"categories":7079},[182],{"categories":7081},[91],{"categories":7083},[91],{"categories":7085},[],{"categories":7087},[143],{"categories":7089},[91],{"categories":7091},[91],{"categories":7093},[91],{"categories":7095},[91],{"categories":7097},[143],{"categories":7099},[91],{"categories":7101},[91],{"categories":7103},[91],{"categories":7105},[146],{"categories":7107},[91],{"categories":7109},[143],{"categories":7111},[91],{"categories":7113},[91],{"categories":7115},[91],{"categories":7117},[91],{"categories":7119},[91],{"categories":7121},[91],{"categories":7123},[91],{"categories":7125},[138],{"categories":7127},[],{"categories":7129},[146],{"categories":7131},[91],{"categories":7133},[182],{"categories":7135},[143],{"categories":7137},[91],{"categories":7139},[157],{"categories":7141},[],{"categories":7143},[157],{"categories":7145},[157],{"categories":7147},[143],{"categories":7149},[157],{"categories":7151},[91],{"categories":7153},[91],{"categories":7155},[91],{"categories":7157},[143],{"categories":7159},[157],{"categories":7161},[91],{"categories":7163},[91],{"categories":7165},[91],{"categories":7167},[143],{"categories":7169},[182],{"categories":7171},[91],{"categories":7173},[91],{"categories":7175},[91],{"categories":7177},[138],{"categories":7179},[91],{"categories":7181},[143],{"categories":7183},[237],{"categories":7185},[],{"categories":7187},[91],{"categories":7189},[91],{"categories":7191},[160],{"categories":7193},[91],{"categories":7195},[143],{"categories":7197},[91],{"categories":7199},[91],{"categories":7201},[],{"categories":7203},[91],{"categories":7205},[91],{"categories":7207},[182],{"categories":7209},[91],{"categories":7211},[91],{"categories":7213},[143],{"categories":7215},[268],{"categories":7217},[],{"categories":7219},[],{"categories":7221},[157],{"categories":7223},[91],{"categories":7225},[91],{"categories":7227},[182],{"categories":7229},[91],{"categories":7231},[157],{"categories":7233},[182],{"categories":7235},[91],{"categories":7237},[91],{"categories":7239},[268],{"categories":7241},[160],{"categories":7243},[91],{"categories":7245},[91],{"categories":7247},[133],{"categories":7249},[143],{"categories":7251},[91],{"categories":7253},[91],{"categories":7255},[143],{"categories":7257},[138],{"categories":7259},[143],{"categories":7261},[157],{"categories":7263},[91],{"categories":7265},[138],{"categories":7267},[],{"categories":7269},[91],{"categories":7271},[160],{"categories":7273},[91],{"categories":7275},[91],{"categories":7277},[],{"categories":7279},[182],{"categories":7281},[91],{"categories":7283},[143],{"categories":7285},[160],{"categories":7287},[91],{"categories":7289},[157],{"categories":7291},[157],{"categories":7293},[157],{"categories":7295},[91],{"categories":7297},[143],{"categories":7299},[143],{"categories":7301},[91],{"categories":7303},[143],{"categories":7305},[91],{"categories":7307},[91],{"categories":7309},[237],{"categories":7311},[160],{"categories":7313},[160],{"categories":7315},[],{"categories":7317},[182],{"categories":7319},[91],{"categories":7321},[91],{"categories":7323},[157],{"categories":7325},[],{"categories":7327},[182],{"categories":7329},[182],{"categories":7331},[182],{"categories":7333},[],{"categories":7335},[143],{"categories":7337},[91],{"categories":7339},[],{"categories":7341},[133],{"categories":7343},[138],{"categories":7345},[],{"categories":7347},[91],{"categories":7349},[91],{"categories":7351},[],{"categories":7353},[157],{"categories":7355},[],{"categories":7357},[],{"categories":7359},[],{"categories":7361},[],{"categories":7363},[91],{"categories":7365},[182],{"categories":7367},[],{"categories":7369},[],{"categories":7371},[91],{"categories":7373},[91],{"categories":7375},[91],{"categories":7377},[160],{"categories":7379},[91],{"categories":7381},[160],{"categories":7383},[],{"categories":7385},[160],{"categories":7387},[160],{"categories":7389},[309],{"categories":7391},[143],{"categories":7393},[157],{"categories":7395},[],{"categories":7397},[],{"categories":7399},[160],{"categories":7401},[157],{"categories":7403},[157],{"categories":7405},[157],{"categories":7407},[],{"categories":7409},[133],{"categories":7411},[157],{"categories":7413},[157],{"categories":7415},[133],{"categories":7417},[157],{"categories":7419},[138],{"categories":7421},[157],{"categories":7423},[157],{"categories":7425},[157],{"categories":7427},[160],{"categories":7429},[182],{"categories":7431},[182],{"categories":7433},[91],{"categories":7435},[157],{"categories":7437},[160],{"categories":7439},[309],{"categories":7441},[160],{"categories":7443},[160],{"categories":7445},[160],{"categories":7447},[],{"categories":7449},[138],{"categories":7451},[],{"categories":7453},[309],{"categories":7455},[157],{"categories":7457},[157],{"categories":7459},[157],{"categories":7461},[143],{"categories":7463},[182,138],{"categories":7465},[160],{"categories":7467},[],{"categories":7469},[],{"categories":7471},[160],{"categories":7473},[],{"categories":7475},[160],{"categories":7477},[182],{"categories":7479},[143],{"categories":7481},[],{"categories":7483},[157],{"categories":7485},[91],{"categories":7487},[237],{"categories":7489},[],{"categories":7491},[91],{"categories":7493},[],{"categories":7495},[182],{"categories":7497},[133],{"categories":7499},[160],{"categories":7501},[],{"categories":7503},[157],{"categories":7505},[182],[7507,7651,7713,7829],{"id":7508,"title":7509,"ai":7510,"body":7515,"categories":7626,"created_at":92,"date_modified":92,"description":84,"extension":93,"faq":92,"featured":94,"kicker_label":92,"meta":7627,"navigation":107,"path":7637,"published_at":7638,"question":92,"scraped_at":7639,"seo":7640,"sitemap":7641,"source_id":7642,"source_name":114,"source_type":115,"source_url":7643,"stem":7644,"tags":7645,"thumbnail_url":7646,"tldr":7647,"tweet":7648,"unknown_tags":7649,"__hash__":7650},"summaries\u002Fsummaries\u002F7998c4605b097c8f-designing-environments-for-long-horizon-ai-agents-summary.md","Designing Environments for Long-Horizon AI Agents",{"provider":7,"model":8,"input_tokens":7511,"output_tokens":7512,"processing_time_ms":7513,"cost_usd":7514},8632,927,4569,0.0035485,{"type":14,"value":7516,"toc":7620},[7517,7521,7524,7528,7531,7545,7548,7552,7555,7558,7584,7588],[17,7518,7520],{"id":7519},"redefining-long-horizon-performance","Redefining Long-Horizon Performance",[22,7522,7523],{},"Measuring \"long-horizon\" work as a scalar metric (e.g., 16-hour human-equivalent tasks) is inherently noisy and prone to misinterpretation. Relying on human-time benchmarks or token counts creates a false sense of progress because these metrics fail to account for task complexity, model-specific efficiencies, and the divergence between human and agent capabilities. A task that is tedious for a human (like manual Excel formatting) may be trivial for an agent, while a task that is simple for a human might be impossible for an agent due to context window limitations or poor state coherence.",[17,7525,7527],{"id":7526},"environment-complexity-and-state-dependency","Environment Complexity and State Dependency",[22,7529,7530],{},"Theta Software argues that the true measure of an agent's capability lies in its ability to navigate environment complexity. They distinguish between two types of complexity:",[63,7532,7533,7539],{},[36,7534,7535,7538],{},[39,7536,7537],{},"Paralyzable Complexity:"," Tasks where sub-agents can work independently (e.g., analyzing multiple files in a codebase). These are easier to scale but don't test the agent's ability to handle cascading dependencies.",[36,7540,7541,7544],{},[39,7542,7543],{},"Sequential Complexity:"," Tasks where early decisions influence later outcomes (e.g., debugging a deployment failure). Here, a single misread of a log file cascades through the entire trajectory.",[22,7546,7547],{},"Effective evaluation requires environments that mirror real-world ambiguity, forcing agents to explore artifacts rather than following a rigid path. When environments are open-ended, standardized evaluation becomes significantly harder, necessitating a shift from deterministic tests to nuanced, agentic verification.",[17,7549,7551],{"id":7550},"the-role-of-agentic-judges","The Role of Agentic Judges",[22,7553,7554],{},"As tasks move into \"software-fellow\" domains, deterministic verifiers (like unit tests) become brittle or impossible to write. The solution is to use judge models that evaluate the final state of the environment rather than just the agent's trajectory.",[22,7556,7557],{},"Key principles for designing these judges include:",[63,7559,7560,7566,7572,7578],{},[36,7561,7562,7565],{},[39,7563,7564],{},"Judges as Agents:"," The judge must have the same observability as the agent, accessing logs and databases to verify the actual outcome of an action (e.g., checking if a PR actually fixed a deployment).",[36,7567,7568,7571],{},[39,7569,7570],{},"Queryable Trajectories:"," Because long-horizon trajectories are too large for a single LLM context window, they must be stored in databases and enriched with metadata, allowing the judge to query specific phases or failure points.",[36,7573,7574,7577],{},[39,7575,7576],{},"Avoiding Reward Hacking:"," Judges must be designed to prevent agents from accessing privileged information or hidden test suites. This requires strict read-only permissions for the judge to ensure it observes the environment without mutating it.",[36,7579,7580,7583],{},[39,7581,7582],{},"Iterative QA:"," Rubrics must be carefully calibrated. If a rubric is too dense or complex for the current frontier of models, the judge will fail to apply it consistently, leading to wasted compute and poor learning signals.",[17,7585,7587],{"id":7586},"key-takeaways","Key Takeaways",[63,7589,7590,7596,7602,7608,7614],{},[36,7591,7592,7595],{},[39,7593,7594],{},"Stop measuring by time:"," Human-time estimates are noisy; focus on state-based outcomes and the agent's ability to handle sequential dependencies.",[36,7597,7598,7601],{},[39,7599,7600],{},"Design for state changes:"," A task is only \"long-horizon\" if early actions meaningfully impact the state of the environment for later steps.",[36,7603,7604,7607],{},[39,7605,7606],{},"Make trajectories queryable:"," Don't stuff entire logs into a context window. Use sub-agents to parse and enrich trajectory data so judges can find critical failure points.",[36,7609,7610,7613],{},[39,7611,7612],{},"Judges need environment access:"," A judge cannot verify a task by looking at the agent's output alone; it must be able to inspect the environment (logs, DBs, CI\u002FCD) to confirm success.",[36,7615,7616,7619],{},[39,7617,7618],{},"Prioritize learnability:"," If your reward signal is too sparse or your rubric is too complex for the model, you are wasting compute. Use partial credit or dynamic rubrics to guide learning.",{"title":84,"searchDepth":85,"depth":85,"links":7621},[7622,7623,7624,7625],{"id":7519,"depth":85,"text":7520},{"id":7526,"depth":85,"text":7527},{"id":7550,"depth":85,"text":7551},{"id":7586,"depth":85,"text":7587},[91],{"content_references":7628,"triage":7633},[7629],{"type":7630,"title":7631,"context":7632},"other","Meter Benchmark","mentioned",{"relevance":103,"novelty":104,"quality":104,"actionability":7634,"composite":7635,"reasoning":7636},3,4.15,"Category: AI & LLMs. The article discusses the design of environments for long-horizon AI agents, which is crucial for product builders looking to implement AI effectively. It provides insights into the complexities of evaluating AI performance beyond traditional metrics, addressing a specific pain point for developers and founders in understanding AI capabilities.","\u002Fsummaries\u002F7998c4605b097c8f-designing-environments-for-long-horizon-ai-agents-summary","2026-08-01 00:00:06","2026-08-01 03:12:01",{"title":7509,"description":84},{"loc":7637},"7998c4605b097c8f","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=2aS7aKoXn64","summaries\u002F7998c4605b097c8f-designing-environments-for-long-horizon-ai-agents-summary",[119,120,121,122],"https:\u002F\u002Fi.ytimg.com\u002Fvi\u002F2aS7aKoXn64\u002Fhqdefault.jpg","Long-horizon AI performance depends on environment and verifier design, not just benchmark scores. Success requires moving beyond token-based metrics to state-based verification and intelligent, agentic judges.","This presentation argues that current \"long-horizon\" benchmarks are often noisy or misleading because they rely on arbitrary time thresholds rather than environment design. The speakers emphasize that meaningful evaluation requires building environments where early decisions have cascading effects, and verifying success based on final state outcomes rather than intermediate judge scores.",[122],"S-ataK9Ht4Ik76vAp4m4v2o0pNql9Ce7_Mqsze5rCn4",{"id":7652,"title":7653,"ai":7654,"body":7659,"categories":7687,"created_at":92,"date_modified":92,"description":84,"extension":93,"faq":92,"featured":94,"kicker_label":92,"meta":7688,"navigation":107,"path":7699,"published_at":7700,"question":92,"scraped_at":7701,"seo":7702,"sitemap":7703,"source_id":7704,"source_name":114,"source_type":115,"source_url":7705,"stem":7706,"tags":7707,"thumbnail_url":7708,"tldr":7709,"tweet":7710,"unknown_tags":7711,"__hash__":7712},"summaries\u002Fsummaries\u002F1e1903c43a16a373-beyond-rlhf-moving-from-ai-assistance-to-reliable--summary.md","Beyond RLHF: Moving from AI Assistance to Reliable Automation",{"provider":7,"model":8,"input_tokens":7655,"output_tokens":7656,"processing_time_ms":7657,"cost_usd":7658},7463,597,3101,0.00276125,{"type":14,"value":7660,"toc":7682},[7661,7665,7668,7672,7675,7679],[17,7662,7664],{"id":7663},"the-assistance-trap","The Assistance Trap",[22,7666,7667],{},"Modern LLMs are built on the foundation of Reinforcement Learning from Human Feedback (RLHF), which optimizes models to please the human in the loop. While this makes for a compelling chat experience, it creates a fundamental liability for automation. By design, RLHF models prioritize engagement and human approval over objective truth. This leads to \"overpromising\"—a feature in a chatbot, but a failure mode in autonomous systems. When a model is optimized for preference, it learns to sound confident even when it is wrong, as the reward model is incentivized to favor human-pleasing output over factual accuracy.",[17,7669,7671],{"id":7670},"assistance-vs-automation","Assistance vs. Automation",[22,7673,7674],{},"There is a clear divide in the current AI landscape between \"assistance\" tasks and \"automation\" tasks. Assistance tasks (like coding assistants or chat interfaces) are designed to keep a human in the loop to catch mistakes. Automation, by contrast, requires systems that operate reliably in the background without human oversight. Current AI stacks are \"assistance-native,\" meaning they are poorly suited for high-stakes business decisions where the goal is to eliminate, rather than support, human intervention. The industry's current reliance on \"just-in-time\" software—where AI writes code that a human then manages—is a symptom of this limitation, rather than the end goal of intelligent software.",[17,7676,7678],{"id":7677},"redesigning-the-optimization-stack","Redesigning the Optimization Stack",[22,7680,7681],{},"To move beyond the current era, the field must shift its optimization objective. Relying on human preference is a detour; the next phase of AI development will focus on verifiable rewards. Drawing on the principle that the task matters more than the data, future systems will likely move toward Reinforcement Learning with Verifiable Rewards (RLVR) or similar approaches that prioritize calibrated, objective decision-making. The goal is to \"mainline\" the intelligence of pre-trained models into software that can execute tasks autonomously and reliably. This requires rethinking the entire stack—from the shape of the API to the reward signals—to ensure that models are optimized for correctness rather than human engagement.",{"title":84,"searchDepth":85,"depth":85,"links":7683},[7684,7685,7686],{"id":7663,"depth":85,"text":7664},{"id":7670,"depth":85,"text":7671},{"id":7677,"depth":85,"text":7678},[91],{"content_references":7689,"triage":7697},[7690,7694],{"type":7630,"title":7691,"author":7692,"context":7693},"The Bitter Lesson","Rich Sutton","cited",{"type":98,"title":7695,"url":7696,"context":7632},"TypeSafe AI","https:\u002F\u002Ftypesafe.ai\u002F",{"relevance":103,"novelty":104,"quality":104,"actionability":7634,"composite":7635,"reasoning":7698},"Category: AI & LLMs. The article discusses the limitations of current AI models optimized for human preference and proposes a shift towards verifiable rewards for true automation, addressing a key pain point for product builders. It provides insights into the future direction of AI development, which is relevant for those looking to build reliable AI-powered products.","\u002Fsummaries\u002F1e1903c43a16a373-beyond-rlhf-moving-from-ai-assistance-to-reliable-summary","2026-07-31 23:30:06","2026-08-01 03:12:06",{"title":7653,"description":84},{"loc":7699},"1e1903c43a16a373","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=cJ0EOzey--o","summaries\u002F1e1903c43a16a373-beyond-rlhf-moving-from-ai-assistance-to-reliable--summary",[119,120,121,122],"https:\u002F\u002Fi.ytimg.com\u002Fvi\u002FcJ0EOzey--o\u002Fhqdefault.jpg","Current AI is optimized for human preference, making it excellent at assistance but unreliable for autonomous tasks. The next era of AI requires shifting from human-in-the-loop approval to verifiable, objective rewards to achieve true automation.","This talk argues that current AI development is trapped in an \"assistance\" paradigm because RLHF explicitly optimizes for human approval rather than objective task completion. The speaker contends that true automation requires moving away from preference-based training toward reinforcement learning with verifiable rewards, noting that current agentic tools remain tethered to the same human-in-the-loop constraints.",[122],"a24xnwcpaKZs2x-tBbtMRd0rXdPiWlcMp2igQPoV9fY",{"id":7714,"title":7715,"ai":7716,"body":7721,"categories":7807,"created_at":92,"date_modified":92,"description":84,"extension":93,"faq":92,"featured":94,"kicker_label":92,"meta":7808,"navigation":107,"path":7815,"published_at":7816,"question":92,"scraped_at":7817,"seo":7818,"sitemap":7819,"source_id":7820,"source_name":114,"source_type":115,"source_url":7821,"stem":7822,"tags":7823,"thumbnail_url":7824,"tldr":7825,"tweet":7826,"unknown_tags":7827,"__hash__":7828},"summaries\u002Fsummaries\u002F917d01e9cb158763-scaling-ai-evals-via-cross-functional-ownership-summary.md","Scaling AI Evals via Cross-Functional Ownership",{"provider":7,"model":8,"input_tokens":7717,"output_tokens":7718,"processing_time_ms":7719,"cost_usd":7720},6952,681,3681,0.0027595,{"type":14,"value":7722,"toc":7801},[7723,7727,7730,7734,7737,7741,7744,7794,7798],[17,7724,7726],{"id":7725},"from-engineering-harness-to-cross-functional-workflow","From Engineering Harness to Cross-Functional Workflow",[22,7728,7729],{},"DoorDash’s GenAI platform team shifted evaluation from a technical bottleneck to a team sport. By treating evals as a continuous loop rather than a one-off engineering task, they enabled non-technical staff—strategy, operations, and product managers—to define quality standards. The platform team provides the infrastructure (telemetry, datasets, and judge APIs), while domain experts own the actual quality bar and rubric definitions. This organizational design is intentionally flexible; which team owns a specific judge prompt varies, reflecting an evolving understanding of how to best manage AI quality.",[17,7731,7733],{"id":7732},"the-api-first-workflow-first-strategy","The API-First, Workflow-First Strategy",[22,7735,7736],{},"To avoid becoming a bottleneck, the platform team stopped trying to build custom UIs for every internal use case. Instead, they focused on shipping stable, robust APIs. This allows product teams and operations staff to use coding agents to \"vibe code\" their own annotation UIs tailored to their specific needs (e.g., image review vs. menu grading). This workflow-first approach empowers operators to build tools that fit their existing processes, significantly reducing the friction of back-and-forth communication with the central engineering team.",[17,7738,7740],{"id":7739},"the-continuous-quality-loop","The Continuous Quality Loop",[22,7742,7743],{},"DoorDash operates on a repeatable eight-step cycle to maintain model quality:",[33,7745,7746,7752,7758,7764,7770,7776,7782,7788],{},[36,7747,7748,7751],{},[39,7749,7750],{},"Trace:"," Capture agent\u002FLLM sessions.",[36,7753,7754,7757],{},[39,7755,7756],{},"Sample:"," Select a manageable subset of traces for human review.",[36,7759,7760,7763],{},[39,7761,7762],{},"Annotate:"," Use domain-specific expertise to label data.",[36,7765,7766,7769],{},[39,7767,7768],{},"Review:"," Validate the annotations.",[36,7771,7772,7775],{},[39,7773,7774],{},"Golden Set:"," Promote high-quality data to a \"golden set\" for benchmarking.",[36,7777,7778,7781],{},[39,7779,7780],{},"Calibrate:"," Use the golden set to tune LLM-as-a-judge prompts.",[36,7783,7784,7787],{},[39,7785,7786],{},"Monitor:"," Track performance over time.",[36,7789,7790,7793],{},[39,7791,7792],{},"Repeat:"," Iterate based on new data.",[17,7795,7797],{"id":7796},"self-serve-calibration","Self-Serve Calibration",[22,7799,7800],{},"To remove engineering dependency, the team built a self-serve UI for judge prompt calibration. This interface allows non-engineers to run optimization loops (using libraries like DSPy) and compare original versus optimized prompts side-by-side. By visualizing the changes, product managers can build trust in the automated judges. This democratization of the evaluation process has led to a sharp reduction in per-annotation costs and increased the velocity at which teams can ship reliable AI features.",{"title":84,"searchDepth":85,"depth":85,"links":7802},[7803,7804,7805,7806],{"id":7725,"depth":85,"text":7726},{"id":7732,"depth":85,"text":7733},{"id":7739,"depth":85,"text":7740},{"id":7796,"depth":85,"text":7797},[143],{"content_references":7809,"triage":7813},[7810],{"type":98,"title":7811,"url":7812,"context":101},"DSPy","https:\u002F\u002Fgithub.com\u002Fstanfordnlp\u002Fdspy",{"relevance":103,"novelty":104,"quality":104,"actionability":104,"composite":105,"reasoning":7814},"Category: AI Automation. The article provides a detailed account of how DoorDash transformed their AI evaluation process into a cross-functional workflow, addressing a specific pain point of integrating non-engineers into AI quality management. It outlines a repeatable eight-step cycle for maintaining model quality, which offers actionable insights for product builders.","\u002Fsummaries\u002F917d01e9cb158763-scaling-ai-evals-via-cross-functional-ownership-summary","2026-08-28 15:00:03","2026-08-29 03:12:10",{"title":7715,"description":84},{"loc":7815},"917d01e9cb158763","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=bMjlRrWjdT0","summaries\u002F917d01e9cb158763-scaling-ai-evals-via-cross-functional-ownership-summary",[119,120,121,122],"https:\u002F\u002Fi.ytimg.com\u002Fvi\u002FbMjlRrWjdT0\u002Fhqdefault.jpg","DoorDash’s GenAI platform team scaled evaluations by moving from an engineering-only task to a cross-functional workflow, using stable APIs and 'vibe-coded' UIs to empower non-engineers to own quality.","This talk outlines DoorDash’s shift from treating AI evals as an engineering-only task to a cross-functional workflow. By exposing stable APIs rather than building custom UIs, their platform team enables non-technical operations staff to \"vibe code\" their own annotation interfaces, effectively decentralizing quality control across the organization.",[122],"xqCu8HEoSX3v0yXignH_LimmVCufv0TXVRH92u2p6Tc",{"id":7830,"title":7831,"ai":7832,"body":7837,"categories":7941,"created_at":92,"date_modified":92,"description":84,"extension":93,"faq":92,"featured":94,"kicker_label":92,"meta":7942,"navigation":107,"path":7949,"published_at":7950,"question":92,"scraped_at":7951,"seo":7952,"sitemap":7953,"source_id":7954,"source_name":114,"source_type":115,"source_url":7955,"stem":7956,"tags":7957,"thumbnail_url":7958,"tldr":7959,"tweet":7960,"unknown_tags":7961,"__hash__":7962},"summaries\u002Fsummaries\u002F985ac483e5e316e6-building-closed-loop-evals-for-multimodal-agents-a-summary.md","Building Closed-Loop Evals for Multimodal Agents at Scale",{"provider":7,"model":8,"input_tokens":7833,"output_tokens":7834,"processing_time_ms":7835,"cost_usd":7836},8031,767,3938,0.00315825,{"type":14,"value":7838,"toc":7935},[7839,7843,7846,7850,7853,7873,7877,7880,7908,7912,7915],[17,7840,7842],{"id":7841},"the-challenge-of-multimodal-agentic-evals","The Challenge of Multimodal Agentic Evals",[22,7844,7845],{},"Uber's food enhancement agent aims to improve the quality of photography for independent merchants. The core challenge is balancing creative enhancement with strict faithfulness to the original dish. The system must avoid \"AI-looking\" results, preserve merchant branding, and prevent marketplace homogenization. The team treats the agent as a spectrum: balancing the creativity of LLMs with rigid, rule-based safety guardrails.",[17,7847,7849],{"id":7848},"the-multi-stage-orchestration-flow","The Multi-Stage Orchestration Flow",[22,7851,7852],{},"The system operates through a series of specialized agents in a flat, JSON-logged structure, which allows for easy diagnosis by both technical and non-technical teams. The workflow consists of:",[33,7854,7855,7861,7867],{},[36,7856,7857,7860],{},[39,7858,7859],{},"Image Understanding & Routing:"," A multimodal agent describes the image and decides whether to enhance or skip it based on a rubric. This is evaluated using a confusion matrix (precision\u002Frecall) to ensure no poor-quality images are enhanced (wasting compute) and no high-quality images are degraded.",[36,7862,7863,7866],{},[39,7864,7865],{},"Iterative Enhancement:"," If routed for enhancement, the agent generates a specific prompt and edits the image. A QA agent then checks for plating, faithfulness, and color. If it fails, the feedback is fed back into the generation loop for up to K iterations.",[36,7868,7869,7872],{},[39,7870,7871],{},"Post-Processing QA:"," A final \"Swiss cheese\" gate provides holistic policy and quality checks before publishing, acting as a redundant safety layer.",[17,7874,7876],{"id":7875},"closed-loop-self-correction-autotuning","Closed-Loop Self-Correction & Autotuning",[22,7878,7879],{},"To prevent model drift and handle edge cases, the team implemented a self-learning system that operates without human intervention:",[63,7881,7882,7888,7902],{},[36,7883,7884,7887],{},[39,7885,7886],{},"Diagnosis Agent:"," An \"umbrella\" agent analyzes production mismatches (comparing agent output against human-labeled golden datasets) to localize failures.",[36,7889,7890,7893,7894,7897,7898,7901],{},[39,7891,7892],{},"Autotuning Pipeline:"," Once a failure is localized, a two-part sub-agent process triggers: a ",[39,7895,7896],{},"Reflect Agent"," identifies systemic issues and noise, and a ",[39,7899,7900],{},"Synthesize Agent"," updates the specific agent's configuration.",[36,7903,7904,7907],{},[39,7905,7906],{},"Continuous Benchmarking:"," New configurations are benchmarked against the golden dataset. If they pass, they are automatically pushed to the production config store.",[17,7909,7911],{"id":7910},"managing-reward-hacking-and-faithfulness","Managing Reward Hacking and Faithfulness",[22,7913,7914],{},"Reward hacking occurs when agents over-optimize for specific metrics at the expense of reality (e.g., replacing a unique bowl with a generic one to satisfy a \"cleanliness\" metric). The team mitigates this by:",[63,7916,7917,7923,7929],{},[36,7918,7919,7922],{},[39,7920,7921],{},"Pairwise Comparison:"," Using human-defined policies to assess if an edit is actually \"better\" rather than just \"different.\"",[36,7924,7925,7928],{},[39,7926,7927],{},"Internal Dogfooding:"," Incorporating thumbs-up\u002Fdown feedback from internal teams and merchants into the diagnosis loop.",[36,7930,7931,7934],{},[39,7932,7933],{},"Segmented Analysis:"," Tracking conversion metrics across different geographies, device types, and dish types to identify where the agent is succeeding or failing in specific marketplace segments.",{"title":84,"searchDepth":85,"depth":85,"links":7936},[7937,7938,7939,7940],{"id":7841,"depth":85,"text":7842},{"id":7848,"depth":85,"text":7849},{"id":7875,"depth":85,"text":7876},{"id":7910,"depth":85,"text":7911},[143],{"content_references":7943,"triage":7947},[7944],{"type":98,"title":7945,"url":7946,"context":7632},"Arise","https:\u002F\u002Farise.com\u002F",{"relevance":103,"novelty":104,"quality":104,"actionability":104,"composite":105,"reasoning":7948},"Category: AI & LLMs. The article provides a detailed overview of a practical application of multimodal agents in a real-world scenario, addressing specific challenges and solutions in AI-powered product development. It outlines a closed-loop evaluation system that is actionable for developers looking to implement similar strategies in their own projects.","\u002Fsummaries\u002F985ac483e5e316e6-building-closed-loop-evals-for-multimodal-agents-a-summary","2026-07-24 22:00:25","2026-07-25 03:12:43",{"title":7831,"description":84},{"loc":7949},"985ac483e5e316e6","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=31GUkCBD-Uc","summaries\u002F985ac483e5e316e6-building-closed-loop-evals-for-multimodal-agents-a-summary",[119,120,121,122],"https:\u002F\u002Fi.ytimg.com\u002Fvi\u002F31GUkCBD-Uc\u002Fhqdefault.jpg","Uber's food photography enhancement agent uses a multi-stage, closed-loop evaluation system that combines offline human-labeled benchmarks with automated self-correction and production feedback loops to maintain quality and faithfulness at scale.","This talk outlines how Uber built an automated pipeline to clean up low-quality food photos for Uber Eats, focusing on the \"eval\" infrastructure needed to prevent AI from hallucinating or homogenizing merchant branding. It is a practical look at using LLM-based routing and multi-step agentic loops, with a specific emphasis on managing cost, drift, and human-in-the-loop alignment.",[122],"hkOfbFen_NpOZYaS_VHGmtsJ1XGnWadEwdjQnYWFoT0"]