[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"summary-985ac483e5e316e6-building-closed-loop-evals-for-multimodal-agents-a-summary":3,"summaries-facets-categories":164,"summary-related-985ac483e5e316e6-building-closed-loop-evals-for-multimodal-agents-a-summary":5974},{"id":4,"title":5,"ai":6,"body":13,"categories":126,"created_at":128,"date_modified":128,"description":119,"extension":129,"faq":128,"featured":130,"kicker_label":128,"meta":131,"navigation":143,"path":144,"published_at":145,"question":128,"scraped_at":146,"seo":147,"sitemap":148,"source_id":149,"source_name":150,"source_type":151,"source_url":152,"stem":153,"tags":154,"thumbnail_url":159,"tldr":160,"tweet":161,"unknown_tags":162,"__hash__":163},"summaries\u002Fsummaries\u002F985ac483e5e316e6-building-closed-loop-evals-for-multimodal-agents-a-summary.md","Building Closed-Loop Evals for Multimodal Agents at Scale",{"provider":7,"model":8,"input_tokens":9,"output_tokens":10,"processing_time_ms":11,"cost_usd":12},"openrouter","google\u002Fgemini-3.1-flash-lite",8031,767,3938,0.00315825,{"type":14,"value":15,"toc":118},"minimark",[16,21,25,29,32,55,59,62,91,95,98],[17,18,20],"h2",{"id":19},"the-challenge-of-multimodal-agentic-evals","The Challenge of Multimodal Agentic Evals",[22,23,24],"p",{},"Uber's food enhancement agent aims to improve the quality of photography for independent merchants. The core challenge is balancing creative enhancement with strict faithfulness to the original dish. The system must avoid \"AI-looking\" results, preserve merchant branding, and prevent marketplace homogenization. The team treats the agent as a spectrum: balancing the creativity of LLMs with rigid, rule-based safety guardrails.",[17,26,28],{"id":27},"the-multi-stage-orchestration-flow","The Multi-Stage Orchestration Flow",[22,30,31],{},"The system operates through a series of specialized agents in a flat, JSON-logged structure, which allows for easy diagnosis by both technical and non-technical teams. The workflow consists of:",[33,34,35,43,49],"ol",{},[36,37,38,42],"li",{},[39,40,41],"strong",{},"Image Understanding & Routing:"," A multimodal agent describes the image and decides whether to enhance or skip it based on a rubric. This is evaluated using a confusion matrix (precision\u002Frecall) to ensure no poor-quality images are enhanced (wasting compute) and no high-quality images are degraded.",[36,44,45,48],{},[39,46,47],{},"Iterative Enhancement:"," If routed for enhancement, the agent generates a specific prompt and edits the image. A QA agent then checks for plating, faithfulness, and color. If it fails, the feedback is fed back into the generation loop for up to K iterations.",[36,50,51,54],{},[39,52,53],{},"Post-Processing QA:"," A final \"Swiss cheese\" gate provides holistic policy and quality checks before publishing, acting as a redundant safety layer.",[17,56,58],{"id":57},"closed-loop-self-correction-autotuning","Closed-Loop Self-Correction & Autotuning",[22,60,61],{},"To prevent model drift and handle edge cases, the team implemented a self-learning system that operates without human intervention:",[63,64,65,71,85],"ul",{},[36,66,67,70],{},[39,68,69],{},"Diagnosis Agent:"," An \"umbrella\" agent analyzes production mismatches (comparing agent output against human-labeled golden datasets) to localize failures.",[36,72,73,76,77,80,81,84],{},[39,74,75],{},"Autotuning Pipeline:"," Once a failure is localized, a two-part sub-agent process triggers: a ",[39,78,79],{},"Reflect Agent"," identifies systemic issues and noise, and a ",[39,82,83],{},"Synthesize Agent"," updates the specific agent's configuration.",[36,86,87,90],{},[39,88,89],{},"Continuous Benchmarking:"," New configurations are benchmarked against the golden dataset. If they pass, they are automatically pushed to the production config store.",[17,92,94],{"id":93},"managing-reward-hacking-and-faithfulness","Managing Reward Hacking and Faithfulness",[22,96,97],{},"Reward hacking occurs when agents over-optimize for specific metrics at the expense of reality (e.g., replacing a unique bowl with a generic one to satisfy a \"cleanliness\" metric). The team mitigates this by:",[63,99,100,106,112],{},[36,101,102,105],{},[39,103,104],{},"Pairwise Comparison:"," Using human-defined policies to assess if an edit is actually \"better\" rather than just \"different.\"",[36,107,108,111],{},[39,109,110],{},"Internal Dogfooding:"," Incorporating thumbs-up\u002Fdown feedback from internal teams and merchants into the diagnosis loop.",[36,113,114,117],{},[39,115,116],{},"Segmented Analysis:"," Tracking conversion metrics across different geographies, device types, and dish types to identify where the agent is succeeding or failing in specific marketplace segments.",{"title":119,"searchDepth":120,"depth":120,"links":121},"",2,[122,123,124,125],{"id":19,"depth":120,"text":20},{"id":27,"depth":120,"text":28},{"id":57,"depth":120,"text":58},{"id":93,"depth":120,"text":94},[127],"AI Automation",null,"md",false,{"content_references":132,"triage":138},[133],{"type":134,"title":135,"url":136,"context":137},"tool","Arise","https:\u002F\u002Farise.com\u002F","mentioned",{"relevance":139,"novelty":140,"quality":140,"actionability":140,"composite":141,"reasoning":142},5,4,4.35,"Category: AI & LLMs. The article provides a detailed overview of a practical application of multimodal agents in a real-world scenario, addressing specific challenges and solutions in AI-powered product development. It outlines a closed-loop evaluation system that is actionable for developers looking to implement similar strategies in their own projects.",true,"\u002Fsummaries\u002F985ac483e5e316e6-building-closed-loop-evals-for-multimodal-agents-a-summary","2026-07-24 22:00:25","2026-07-25 03:12:43",{"title":5,"description":119},{"loc":144},"985ac483e5e316e6","AI Engineer","video","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=31GUkCBD-Uc","summaries\u002F985ac483e5e316e6-building-closed-loop-evals-for-multimodal-agents-a-summary",[155,156,157,158],"agents","automation","product-strategy","ai-llms","https:\u002F\u002Fi.ytimg.com\u002Fvi\u002F31GUkCBD-Uc\u002Fhqdefault.jpg","Uber's food photography enhancement agent uses a multi-stage, closed-loop evaluation system that combines offline human-labeled benchmarks with automated self-correction and production feedback loops to maintain quality and faithfulness at scale.","This talk outlines how Uber built an automated pipeline to clean up low-quality food photos for Uber Eats, focusing on the \"eval\" infrastructure needed to prevent AI from hallucinating or homogenizing merchant branding. It is a practical look at using LLM-based routing and multi-step agentic loops, with a specific emphasis on managing cost, drift, and human-in-the-loop alignment.",[158],"hkOfbFen_NpOZYaS_VHGmtsJ1XGnWadEwdjQnYWFoT0",[165,168,171,174,176,179,181,183,185,188,190,192,194,196,199,201,203,205,207,210,212,214,216,218,220,222,224,226,228,230,232,234,236,238,240,242,244,246,248,251,254,256,258,260,262,264,266,268,270,272,274,276,279,281,283,285,287,289,291,293,295,297,299,301,303,305,307,309,311,314,316,318,320,322,324,326,328,330,332,334,336,338,341,343,345,347,349,351,353,355,357,359,361,363,365,367,369,371,373,375,377,379,381,383,385,387,389,391,393,395,397,400,402,404,406,408,410,412,414,416,418,421,423,425,427,429,431,433,435,437,439,441,443,445,448,450,452,454,456,458,460,462,465,467,469,471,473,475,477,479,481,483,485,487,489,491,493,495,497,499,501,503,505,507,509,511,513,516,518,520,523,525,527,529,531,533,535,537,539,541,543,545,547,549,552,554,556,558,560,562,564,566,568,570,572,575,577,579,581,583,585,587,589,591,593,595,597,599,601,603,605,607,609,611,613,615,617,619,621,623,625,627,629,631,633,635,637,639,641,643,645,647,649,651,653,655,657,659,661,663,665,667,669,671,673,675,677,679,681,683,685,687,689,691,693,695,697,699,701,703,705,707,709,711,713,715,717,719,721,723,725,727,729,731,733,735,737,739,741,743,745,747,749,751,753,755,757,759,761,763,765,767,769,771,773,775,777,779,781,783,785,787,789,791,793,795,797,799,801,803,805,807,809,811,813,815,818,820,822,824,826,829,831,833,835,837,839,841,843,845,847,850,852,854,856,858,860,862,864,866,868,870,872,874,876,878,880,882,884,886,888,890,892,894,896,898,900,902,904,906,908,910,912,914,916,918,920,922,924,926,928,930,932,934,936,938,940,942,944,946,948,950,952,954,956,958,960,962,964,966,968,970,972,974,976,978,980,982,984,986,988,990,992,994,996,998,1000,1002,1004,1006,1008,1010,1012,1014,1016,1018,1020,1022,1024,1026,1028,1030,1032,1034,1036,1038,1040,1042,1044,1046,1048,1050,1052,1054,1056,1058,1060,1062,1064,1066,1068,1070,1072,1074,1076,1078,1080,1082,1084,1086,1088,1090,1092,1094,1096,1098,1100,1102,1104,1106,1108,1111,1113,1115,1117,1119,1121,1123,1125,1127,1129,1131,1133,1135,1137,1139,1141,1143,1145,1147,1149,1151,1153,1155,1157,1159,1161,1163,1165,1167,1169,1171,1173,1175,1177,1179,1181,1183,1185,1187,1189,1191,1193,1195,1197,1199,1201,1203,1205,1207,1209,1211,1213,1215,1217,1219,1221,1223,1225,1227,1229,1231,1233,1235,1237,1239,1241,1243,1245,1247,1249,1251,1253,1255,1257,1259,1261,1263,1265,1267,1269,1272,1274,1276,1278,1280,1282,1284,1286,1288,1290,1292,1294,1296,1298,1300,1302,1304,1306,1308,1310,1312,1314,1316,1318,1320,1322,1324,1326,1328,1330,1332,1334,1336,1338,1340,1342,1344,1346,1348,1350,1352,1354,1356,1358,1360,1362,1364,1366,1368,1370,1372,1374,1376,1378,1380,1382,1384,1386,1388,1390,1392,1394,1397,1399,1401,1403,1405,1407,1409,1411,1413,1415,1417,1419,1421,1423,1425,1427,1429,1431,1433,1435,1437,1439,1441,1443,1445,1447,1449,1451,1453,1455,1457,1459,1461,1463,1465,1467,1469,1471,1473,1475,1477,1479,1481,1483,1485,1487,1489,1491,1493,1495,1497,1499,1501,1503,1505,1507,1509,1511,1513,1515,1517,1519,1521,1524,1526,1528,1530,1532,1534,1536,1538,1540,1542,1544,1546,1548,1550,1552,1554,1556,1558,1560,1562,1564,1566,1568,1570,1572,1575,1577,1579,1581,1583,1585,1587,1589,1591,1593,1595,1597,1599,1601,1603,1605,1607,1609,1611,1613,1615,1617,1619,1621,1623,1625,1627,1629,1631,1633,1635,1637,1639,1641,1643,1645,1647,1649,1651,1653,1655,1657,1659,1661,1663,1665,1667,1669,1671,1673,1675,1677,1679,1681,1683,1685,1687,1689,1691,1693,1695,1697,1699,1701,1703,1705,1707,1709,1711,1713,1715,1717,1719,1721,1723,1725,1727,1729,1731,1733,1735,1737,1739,1741,1743,1745,1747,1749,1751,1753,1755,1757,1759,1761,1763,1765,1767,1769,1771,1773,1775,1777,1779,1781,1783,1785,1787,1789,1791,1793,1795,1797,1799,1801,1803,1805,1807,1809,1811,1813,1815,1817,1819,1821,1823,1825,1827,1829,1831,1833,1835,1837,1839,1841,1843,1845,1847,1849,1851,1853,1855,1857,1859,1861,1863,1865,1867,1869,1871,1873,1875,1877,1879,1881,1883,1885,1887,1889,1891,1893,1895,1897,1899,1901,1903,1905,1907,1909,1911,1913,1915,1917,1919,1921,1923,1925,1927,1930,1932,1934,1936,1938,1940,1942,1944,1946,1948,1950,1952,1954,1956,1958,1960,1962,1964,1966,1968,1970,1972,1974,1976,1978,1980,1982,1984,1986,1988,1990,1992,1994,1996,1998,2000,2002,2004,2006,2009,2011,2013,2015,2017,2019,2021,2023,2025,2027,2029,2031,2033,2035,2037,2039,2041,2043,2045,2047,2049,2051,2053,2055,2057,2059,2061,2063,2065,2067,2069,2071,2073,2075,2077,2079,2081,2083,2085,2087,2089,2091,2093,2095,2097,2099,2101,2103,2105,2107,2110,2112,2114,2116,2118,2120,2122,2124,2126,2128,2130,2132,2134,2136,2138,2140,2142,2144,2147,2149,2151,2153,2155,2157,2159,2161,2163,2165,2167,2169,2171,2173,2175,2177,2179,2181,2183,2185,2187,2189,2191,2193,2195,2197,2199,2201,2203,2205,2207,2209,2211,2213,2215,2217,2219,2221,2223,2225,2227,2229,2231,2233,2235,2237,2239,2241,2243,2245,2247,2249,2251,2253,2255,2257,2259,2261,2263,2265,2267,2269,2271,2273,2275,2277,2279,2281,2283,2285,2287,2289,2291,2293,2295,2297,2299,2301,2303,2305,2307,2309,2311,2313,2315,2317,2319,2321,2323,2325,2327,2329,2331,2333,2335,2337,2339,2341,2343,2345,2347,2349,2351,2353,2355,2357,2359,2361,2363,2365,2367,2369,2371,2373,2375,2377,2379,2381,2383,2385,2387,2389,2391,2393,2395,2397,2399,2401,2403,2405,2407,2409,2411,2413,2415,2417,2419,2421,2423,2425,2427,2429,2431,2433,2435,2437,2439,2441,2443,2445,2447,2449,2451,2453,2455,2457,2459,2461,2463,2465,2467,2469,2471,2473,2475,2477,2479,2481,2483,2485,2487,2489,2491,2493,2495,2497,2499,2501,2503,2505,2507,2509,2511,2513,2515,2517,2519,2521,2523,2525,2527,2529,2531,2533,2535,2537,2539,2541,2543,2545,2547,2549,2551,2553,2555,2557,2559,2561,2563,2565,2567,2569,2571,2573,2575,2577,2579,2581,2583,2585,2587,2589,2591,2593,2595,2597,2599,2601,2603,2605,2607,2609,2611,2613,2615,2617,2619,2621,2623,2625,2627,2629,2631,2633,2635,2637,2639,2641,2643,2645,2647,2649,2651,2653,2655,2657,2659,2661,2663,2665,2667,2669,2671,2673,2675,2677,2679,2681,2683,2686,2688,2690,2692,2694,2696,2698,2700,2702,2704,2706,2708,2710,2712,2714,2716,2718,2720,2722,2724,2726,2728,2730,2732,2734,2736,2738,2740,2742,2744,2746,2748,2750,2752,2754,2756,2758,2760,2762,2764,2766,2768,2770,2772,2774,2776,2778,2780,2782,2785,2787,2789,2791,2793,2795,2797,2799,2801,2803,2805,2807,2809,2811,2813,2815,2817,2819,2821,2823,2825,2827,2829,2831,2833,2835,2837,2839,2841,2843,2845,2847,2849,2851,2853,2855,2857,2859,2861,2863,2865,2867,2869,2871,2873,2875,2877,2879,2881,2883,2885,2887,2889,2891,2893,2895,2897,2899,2901,2903,2905,2907,2909,2911,2913,2915,2917,2919,2921,2923,2925,2927,2929,2931,2933,2935,2937,2939,2941,2943,2945,2947,2949,2951,2953,2955,2957,2959,2961,2963,2965,2967,2969,2971,2973,2975,2977,2979,2981,2983,2985,2987,2989,2991,2993,2995,2997,2999,3001,3003,3005,3007,3009,3011,3013,3015,3017,3019,3021,3023,3025,3027,3029,3031,3033,3035,3037,3039,3041,3043,3045,3047,3049,3051,3053,3055,3057,3059,3061,3063,3065,3067,3069,3071,3073,3075,3077,3079,3081,3083,3085,3087,3089,3091,3093,3095,3097,3099,3101,3103,3105,3107,3109,3111,3113,3115,3117,3119,3121,3123,3125,3127,3129,3131,3133,3135,3137,3139,3141,3143,3145,3147,3149,3151,3153,3155,3157,3159,3161,3163,3165,3167,3169,3171,3173,3175,3177,3179,3181,3183,3185,3187,3189,3191,3193,3195,3197,3199,3201,3203,3205,3207,3209,3211,3213,3215,3217,3219,3221,3223,3225,3227,3229,3231,3233,3235,3237,3239,3241,3243,3245,3247,3249,3251,3253,3255,3257,3259,3261,3263,3265,3267,3269,3271,3273,3275,3277,3279,3281,3283,3285,3287,3289,3291,3293,3295,3297,3299,3301,3303,3305,3307,3309,3311,3313,3315,3317,3319,3321,3323,3325,3327,3329,3331,3333,3335,3337,3339,3341,3343,3345,3347,3349,3351,3353,3355,3357,3359,3361,3363,3365,3367,3369,3371,3373,3375,3377,3379,3381,3383,3385,3387,3389,3391,3393,3395,3397,3399,3401,3403,3405,3407,3409,3411,3413,3415,3417,3419,3421,3423,3425,3427,3429,3431,3433,3435,3437,3439,3441,3443,3445,3447,3449,3451,3453,3455,3457,3459,3461,3463,3465,3467,3469,3471,3473,3475,3477,3479,3481,3483,3485,3487,3489,3491,3493,3495,3497,3499,3501,3503,3505,3507,3509,3511,3513,3515,3517,3519,3521,3523,3525,3527,3529,3531,3533,3535,3537,3539,3541,3543,3545,3547,3549,3551,3553,3555,3557,3559,3561,3563,3565,3567,3569,3571,3573,3575,3577,3579,3581,3583,3585,3587,3589,3591,3593,3595,3597,3599,3601,3603,3605,3607,3609,3611,3613,3615,3617,3619,3621,3623,3625,3627,3629,3631,3633,3635,3637,3639,3641,3643,3645,3647,3649,3651,3653,3655,3657,3659,3661,3663,3665,3667,3669,3671,3673,3675,3677,3679,3681,3683,3685,3687,3689,3691,3693,3695,3697,3699,3701,3703,3705,3707,3709,3711,3713,3715,3717,3719,3721,3723,3725,3727,3729,3731,3733,3735,3737,3739,3741,3743,3745,3747,3749,3751,3753,3755,3757,3759,3761,3763,3765,3767,3769,3771,3773,3775,3777,3779,3781,3783,3785,3787,3789,3791,3793,3795,3797,3799,3801,3803,3805,3807,3809,3811,3813,3815,3817,3819,3821,3823,3825,3827,3829,3831,3833,3835,3837,3839,3841,3843,3845,3847,3849,3851,3853,3855,3857,3859,3861,3863,3865,3867,3869,3871,3874,3876,3878,3880,3882,3884,3886,3888,3890,3892,3894,3896,3898,3900,3902,3904,3906,3908,3910,3912,3914,3916,3918,3920,3922,3924,3926,3928,3930,3932,3934,3936,3938,3940,3942,3944,3946,3948,3950,3952,3954,3956,3958,3960,3962,3964,3966,3968,3970,3972,3974,3976,3978,3980,3982,3984,3986,3988,3990,3992,3994,3996,3998,4000,4002,4004,4006,4008,4010,4012,4014,4016,4018,4020,4022,4024,4026,4028,4030,4032,4034,4036,4038,4040,4042,4044,4046,4048,4050,4052,4054,4056,4058,4060,4062,4064,4066,4068,4070,4072,4074,4076,4078,4080,4082,4084,4086,4088,4090,4092,4094,4096,4098,4100,4102,4104,4106,4108,4110,4112,4114,4116,4118,4120,4122,4124,4126,4128,4130,4132,4134,4136,4138,4140,4142,4144,4146,4148,4150,4152,4154,4156,4158,4160,4162,4164,4166,4168,4170,4172,4174,4176,4178,4180,4182,4184,4186,4188,4190,4192,4194,4196,4198,4200,4202,4204,4206,4208,4210,4212,4214,4216,4218,4220,4222,4224,4226,4228,4230,4232,4234,4236,4238,4240,4242,4244,4246,4248,4250,4252,4254,4256,4258,4260,4262,4264,4266,4268,4270,4272,4274,4276,4278,4280,4282,4284,4286,4288,4290,4292,4294,4296,4298,4300,4302,4304,4306,4308,4310,4312,4314,4316,4318,4320,4322,4324,4326,4328,4330,4332,4334,4336,4338,4340,4342,4344,4346,4348,4350,4352,4354,4356,4358,4360,4362,4364,4366,4368,4370,4372,4374,4376,4378,4380,4382,4384,4386,4388,4390,4392,4394,4396,4398,4400,4402,4404,4406,4408,4410,4412,4414,4416,4418,4420,4422,4424,4426,4428,4430,4432,4434,4436,4438,4440,4442,4444,4446,4448,4450,4452,4454,4456,4458,4460,4462,4464,4466,4468,4470,4472,4474,4476,4478,4480,4482,4484,4486,4488,4490,4492,4494,4496,4498,4500,4502,4504,4506,4508,4510,4512,4514,4516,4518,4520,4522,4524,4526,4528,4530,4532,4534,4536,4538,4540,4542,4544,4546,4548,4550,4552,4554,4556,4558,4560,4562,4564,4566,4568,4570,4572,4574,4576,4578,4580,4582,4584,4586,4588,4590,4592,4594,4596,4598,4600,4603,4605,4607,4609,4611,4613,4615,4617,4619,4621,4623,4625,4627,4629,4631,4633,4635,4637,4639,4641,4643,4645,4647,4649,4651,4653,4655,4657,4659,4661,4663,4665,4667,4669,4671,4673,4675,4677,4679,4681,4683,4685,4687,4689,4691,4693,4695,4697,4699,4701,4703,4705,4707,4709,4711,4713,4715,4717,4719,4721,4723,4725,4727,4729,4731,4733,4735,4737,4739,4741,4743,4745,4747,4749,4751,4753,4755,4757,4759,4761,4763,4765,4768,4770,4772,4774,4776,4778,4780,4782,4784,4786,4788,4790,4792,4794,4796,4798,4800,4802,4804,4806,4808,4810,4812,4814,4816,4818,4820,4822,4824,4826,4828,4830,4832,4834,4836,4838,4840,4842,4844,4846,4848,4850,4852,4854,4856,4858,4860,4862,4864,4866,4868,4870,4872,4874,4876,4878,4880,4882,4884,4886,4888,4890,4892,4894,4896,4898,4900,4902,4904,4906,4908,4910,4912,4914,4916,4918,4920,4922,4924,4926,4928,4930,4932,4934,4936,4938,4940,4942,4944,4946,4948,4950,4952,4954,4956,4958,4960,4962,4964,4966,4968,4970,4972,4974,4976,4978,4980,4982,4984,4986,4988,4990,4992,4994,4996,4998,5000,5002,5004,5006,5008,5010,5012,5014,5016,5018,5020,5022,5024,5026,5028,5030,5032,5034,5036,5038,5040,5042,5044,5046,5048,5050,5052,5054,5056,5058,5060,5062,5064,5066,5068,5070,5072,5074,5076,5078,5080,5082,5084,5086,5088,5090,5092,5094,5096,5098,5100,5102,5104,5106,5108,5110,5112,5114,5116,5118,5120,5122,5124,5126,5128,5130,5132,5134,5136,5138,5140,5142,5144,5146,5148,5150,5152,5154,5156,5158,5160,5162,5164,5166,5168,5170,5172,5174,5176,5178,5180,5182,5184,5186,5188,5190,5192,5194,5196,5198,5200,5202,5204,5206,5208,5210,5212,5214,5216,5218,5220,5222,5224,5226,5228,5230,5232,5234,5236,5238,5240,5242,5244,5246,5248,5250,5252,5254,5256,5258,5260,5262,5264,5266,5268,5270,5272,5274,5276,5278,5280,5282,5284,5286,5288,5290,5292,5294,5296,5298,5300,5302,5304,5306,5308,5310,5312,5314,5316,5318,5320,5322,5324,5326,5328,5330,5332,5334,5336,5338,5340,5342,5344,5346,5348,5350,5352,5354,5356,5358,5360,5362,5364,5366,5368,5370,5372,5374,5376,5378,5380,5382,5384,5386,5388,5390,5392,5394,5396,5398,5400,5402,5404,5406,5408,5410,5412,5414,5416,5418,5420,5422,5424,5426,5428,5430,5432,5434,5436,5438,5440,5442,5444,5446,5448,5450,5452,5454,5456,5458,5460,5462,5464,5466,5468,5470,5472,5474,5476,5478,5480,5482,5484,5486,5488,5490,5492,5494,5496,5498,5500,5502,5504,5506,5508,5510,5512,5514,5516,5518,5520,5522,5524,5526,5528,5530,5532,5534,5536,5538,5540,5542,5544,5546,5548,5550,5552,5554,5556,5558,5560,5562,5564,5566,5568,5570,5572,5574,5576,5578,5580,5582,5584,5586,5588,5590,5592,5594,5596,5598,5600,5602,5604,5606,5608,5610,5612,5614,5616,5618,5620,5622,5624,5626,5628,5630,5632,5634,5636,5638,5640,5642,5644,5646,5648,5650,5652,5654,5656,5658,5660,5662,5664,5666,5668,5670,5672,5674,5676,5678,5680,5682,5684,5686,5688,5690,5692,5694,5696,5698,5700,5702,5704,5706,5708,5710,5712,5714,5716,5718,5720,5722,5724,5726,5728,5730,5732,5734,5736,5738,5740,5742,5744,5746,5748,5750,5752,5754,5756,5758,5760,5762,5764,5766,5768,5770,5772,5774,5776,5778,5780,5782,5784,5786,5788,5790,5792,5794,5796,5798,5800,5802,5804,5806,5808,5810,5812,5814,5816,5818,5820,5822,5824,5826,5828,5830,5832,5834,5836,5838,5840,5842,5844,5846,5848,5850,5852,5854,5856,5858,5860,5862,5864,5866,5868,5870,5872,5874,5876,5878,5880,5882,5884,5886,5888,5890,5892,5894,5896,5898,5900,5902,5904,5906,5908,5910,5912,5914,5916,5918,5920,5922,5924,5926,5928,5930,5932,5934,5936,5938,5940,5942,5944,5946,5948,5950,5952,5954,5956,5958,5960,5962,5964,5966,5968,5970,5972],{"categories":166},[167],"Developer Productivity",{"categories":169},[170],"Business & SaaS",{"categories":172},[173],"AI & LLMs",{"categories":175},[127],{"categories":177},[178],"Product Strategy",{"categories":180},[173],{"categories":182},[167],{"categories":184},[127],{"categories":186},[187],"Software Engineering",{"categories":189},[173],{"categories":191},[170],{"categories":193},[],{"categories":195},[173],{"categories":197},[198],"Inference & Serving",{"categories":200},[173],{"categories":202},[173],{"categories":204},[127],{"categories":206},[],{"categories":208},[209],"AI News & Trends",{"categories":211},[127],{"categories":213},[173],{"categories":215},[170],{"categories":217},[167],{"categories":219},[173],{"categories":221},[127],{"categories":223},[209],{"categories":225},[127],{"categories":227},[127],{"categories":229},[173],{"categories":231},[127],{"categories":233},[173],{"categories":235},[173],{"categories":237},[173],{"categories":239},[209],{"categories":241},[173],{"categories":243},[173],{"categories":245},[173],{"categories":247},[],{"categories":249},[250],"Design & Frontend",{"categories":252},[253],"Data Science & Visualization",{"categories":255},[209],{"categories":257},[173],{"categories":259},[173],{"categories":261},[173],{"categories":263},[],{"categories":265},[173],{"categories":267},[127],{"categories":269},[187],{"categories":271},[173],{"categories":273},[127],{"categories":275},[173],{"categories":277},[278],"Marketing & Growth",{"categories":280},[250],{"categories":282},[173],{"categories":284},[127],{"categories":286},[173],{"categories":288},[187],{"categories":290},[],{"categories":292},[],{"categories":294},[250],{"categories":296},[173],{"categories":298},[127],{"categories":300},[167],{"categories":302},[187],{"categories":304},[250],{"categories":306},[178],{"categories":308},[173],{"categories":310},[187],{"categories":312},[313],"DevOps & Cloud",{"categories":315},[127],{"categories":317},[178],{"categories":319},[209],{"categories":321},[173],{"categories":323},[],{"categories":325},[173],{"categories":327},[],{"categories":329},[127],{"categories":331},[187],{"categories":333},[],{"categories":335},[187],{"categories":337},[173],{"categories":339},[340],"Governance & Standards",{"categories":342},[170],{"categories":344},[],{"categories":346},[],{"categories":348},[173],{"categories":350},[173],{"categories":352},[127],{"categories":354},[173],{"categories":356},[173],{"categories":358},[127],{"categories":360},[173],{"categories":362},[173],{"categories":364},[173],{"categories":366},[],{"categories":368},[187],{"categories":370},[],{"categories":372},[],{"categories":374},[187],{"categories":376},[],{"categories":378},[187],{"categories":380},[173],{"categories":382},[173],{"categories":384},[278],{"categories":386},[173],{"categories":388},[250],{"categories":390},[250],{"categories":392},[173],{"categories":394},[187],{"categories":396},[127],{"categories":398},[399],"GovTech & Public-Sector Adoption",{"categories":401},[187],{"categories":403},[173],{"categories":405},[173],{"categories":407},[127],{"categories":409},[127],{"categories":411},[253],{"categories":413},[173],{"categories":415},[209],{"categories":417},[127],{"categories":419},[420],"Legal AI Tools",{"categories":422},[127],{"categories":424},[278],{"categories":426},[127],{"categories":428},[178],{"categories":430},[187],{"categories":432},[399],{"categories":434},[],{"categories":436},[127],{"categories":438},[],{"categories":440},[170],{"categories":442},[127],{"categories":444},[127],{"categories":446},[447],"RAG & Retrieval",{"categories":449},[170],{"categories":451},[173],{"categories":453},[187],{"categories":455},[313],{"categories":457},[250],{"categories":459},[173],{"categories":461},[],{"categories":463},[464],"Agents & Orchestration",{"categories":466},[187],{"categories":468},[173],{"categories":470},[],{"categories":472},[127],{"categories":474},[170],{"categories":476},[],{"categories":478},[173],{"categories":480},[],{"categories":482},[167],{"categories":484},[187],{"categories":486},[170],{"categories":488},[173],{"categories":490},[173],{"categories":492},[209],{"categories":494},[173],{"categories":496},[],{"categories":498},[173],{"categories":500},[],{"categories":502},[187],{"categories":504},[173],{"categories":506},[253],{"categories":508},[],{"categories":510},[173],{"categories":512},[250],{"categories":514},[515],"Models & Frontier Labs",{"categories":517},[],{"categories":519},[250],{"categories":521},[522],"Regulation & Governance of AI",{"categories":524},[127],{"categories":526},[],{"categories":528},[173],{"categories":530},[173],{"categories":532},[127],{"categories":534},[209],{"categories":536},[170],{"categories":538},[173],{"categories":540},[],{"categories":542},[187],{"categories":544},[127],{"categories":546},[173],{"categories":548},[178],{"categories":550},[551],"AI Policy & Regulation",{"categories":553},[],{"categories":555},[173],{"categories":557},[178],{"categories":559},[127],{"categories":561},[173],{"categories":563},[173],{"categories":565},[173],{"categories":567},[127],{"categories":569},[],{"categories":571},[253],{"categories":573},[574],"Evals & Reliability",{"categories":576},[173],{"categories":578},[],{"categories":580},[167],{"categories":582},[399],{"categories":584},[551],{"categories":586},[173],{"categories":588},[170],{"categories":590},[173],{"categories":592},[127],{"categories":594},[173],{"categories":596},[127],{"categories":598},[464],{"categories":600},[173],{"categories":602},[187],{"categories":604},[173],{"categories":606},[],{"categories":608},[],{"categories":610},[173],{"categories":612},[399],{"categories":614},[173],{"categories":616},[173],{"categories":618},[],{"categories":620},[250],{"categories":622},[],{"categories":624},[173],{"categories":626},[],{"categories":628},[127],{"categories":630},[173],{"categories":632},[250],{"categories":634},[],{"categories":636},[173],{"categories":638},[127],{"categories":640},[173],{"categories":642},[170],{"categories":644},[127],{"categories":646},[173],{"categories":648},[173],{"categories":650},[187],{"categories":652},[250],{"categories":654},[127],{"categories":656},[],{"categories":658},[187],{"categories":660},[127],{"categories":662},[],{"categories":664},[209],{"categories":666},[],{"categories":668},[173],{"categories":670},[173],{"categories":672},[173],{"categories":674},[170,278],{"categories":676},[],{"categories":678},[173],{"categories":680},[173],{"categories":682},[127],{"categories":684},[],{"categories":686},[],{"categories":688},[173],{"categories":690},[250],{"categories":692},[173],{"categories":694},[],{"categories":696},[173],{"categories":698},[313],{"categories":700},[],{"categories":702},[127],{"categories":704},[209],{"categories":706},[173],{"categories":708},[250],{"categories":710},[],{"categories":712},[209],{"categories":714},[173],{"categories":716},[198],{"categories":718},[173],{"categories":720},[127],{"categories":722},[209],{"categories":724},[515],{"categories":726},[173],{"categories":728},[278],{"categories":730},[],{"categories":732},[127],{"categories":734},[170],{"categories":736},[187],{"categories":738},[173],{"categories":740},[127],{"categories":742},[],{"categories":744},[173,313],{"categories":746},[173],{"categories":748},[173],{"categories":750},[173],{"categories":752},[127],{"categories":754},[173,187],{"categories":756},[253],{"categories":758},[173],{"categories":760},[173],{"categories":762},[187],{"categories":764},[127],{"categories":766},[551],{"categories":768},[278],{"categories":770},[173],{"categories":772},[127],{"categories":774},[173],{"categories":776},[173],{"categories":778},[127],{"categories":780},[],{"categories":782},[173],{"categories":784},[173],{"categories":786},[127],{"categories":788},[173],{"categories":790},[173,170],{"categories":792},[170],{"categories":794},[],{"categories":796},[250],{"categories":798},[250],{"categories":800},[173],{"categories":802},[],{"categories":804},[],{"categories":806},[209],{"categories":808},[],{"categories":810},[167],{"categories":812},[173],{"categories":814},[187],{"categories":816},[817],"Generative UI & Design-to-Code",{"categories":819},[173],{"categories":821},[173],{"categories":823},[250],{"categories":825},[173],{"categories":827},[828],"Algorithmic Accountability",{"categories":830},[127],{"categories":832},[187],{"categories":834},[209],{"categories":836},[250],{"categories":838},[],{"categories":840},[173],{"categories":842},[173],{"categories":844},[173],{"categories":846},[127],{"categories":848},[849],"MLOps & Infrastructure",{"categories":851},[173],{"categories":853},[173],{"categories":855},[173],{"categories":857},[173],{"categories":859},[173],{"categories":861},[209],{"categories":863},[167],{"categories":865},[173],{"categories":867},[127],{"categories":869},[313],{"categories":871},[170],{"categories":873},[173],{"categories":875},[250],{"categories":877},[173],{"categories":879},[127],{"categories":881},[],{"categories":883},[],{"categories":885},[198],{"categories":887},[250],{"categories":889},[209],{"categories":891},[253],{"categories":893},[],{"categories":895},[173],{"categories":897},[173],{"categories":899},[170],{"categories":901},[173],{"categories":903},[173],{"categories":905},[173],{"categories":907},[209],{"categories":909},[198],{"categories":911},[173],{"categories":913},[250],{"categories":915},[],{"categories":917},[127],{"categories":919},[187],{"categories":921},[],{"categories":923},[173],{"categories":925},[173],{"categories":927},[127],{"categories":929},[187],{"categories":931},[173],{"categories":933},[253],{"categories":935},[],{"categories":937},[173],{"categories":939},[],{"categories":941},[173],{"categories":943},[],{"categories":945},[178],{"categories":947},[170],{"categories":949},[127],{"categories":951},[127],{"categories":953},[],{"categories":955},[167],{"categories":957},[173],{"categories":959},[170],{"categories":961},[209],{"categories":963},[167],{"categories":965},[],{"categories":967},[173],{"categories":969},[],{"categories":971},[],{"categories":973},[209],{"categories":975},[209],{"categories":977},[],{"categories":979},[464],{"categories":981},[173],{"categories":983},[250],{"categories":985},[187],{"categories":987},[],{"categories":989},[420],{"categories":991},[170],{"categories":993},[],{"categories":995},[],{"categories":997},[167],{"categories":999},[253],{"categories":1001},[],{"categories":1003},[278],{"categories":1005},[127],{"categories":1007},[170],{"categories":1009},[127],{"categories":1011},[170],{"categories":1013},[187],{"categories":1015},[],{"categories":1017},[198],{"categories":1019},[178],{"categories":1021},[173],{"categories":1023},[250],{"categories":1025},[187],{"categories":1027},[170],{"categories":1029},[173],{"categories":1031},[127],{"categories":1033},[170],{"categories":1035},[173],{"categories":1037},[173],{"categories":1039},[173],{"categories":1041},[173],{"categories":1043},[],{"categories":1045},[],{"categories":1047},[187],{"categories":1049},[253],{"categories":1051},[178],{"categories":1053},[173],{"categories":1055},[127],{"categories":1057},[173],{"categories":1059},[],{"categories":1061},[209],{"categories":1063},[178],{"categories":1065},[173],{"categories":1067},[574],{"categories":1069},[313],{"categories":1071},[],{"categories":1073},[127],{"categories":1075},[],{"categories":1077},[167],{"categories":1079},[],{"categories":1081},[173],{"categories":1083},[173],{"categories":1085},[250],{"categories":1087},[278],{"categories":1089},[187],{"categories":1091},[127],{"categories":1093},[],{"categories":1095},[187],{"categories":1097},[173],{"categories":1099},[167],{"categories":1101},[],{"categories":1103},[170],{"categories":1105},[209],{"categories":1107},[173,313],{"categories":1109},[1110],"Design Systems for AI",{"categories":1112},[173],{"categories":1114},[209],{"categories":1116},[173],{"categories":1118},[173],{"categories":1120},[170],{"categories":1122},[173],{"categories":1124},[],{"categories":1126},[173],{"categories":1128},[173],{"categories":1130},[170],{"categories":1132},[173],{"categories":1134},[],{"categories":1136},[127],{"categories":1138},[187],{"categories":1140},[187],{"categories":1142},[250],{"categories":1144},[209],{"categories":1146},[253],{"categories":1148},[173],{"categories":1150},[167],{"categories":1152},[551],{"categories":1154},[173],{"categories":1156},[127],{"categories":1158},[173],{"categories":1160},[187],{"categories":1162},[187],{"categories":1164},[],{"categories":1166},[],{"categories":1168},[127],{"categories":1170},[178],{"categories":1172},[],{"categories":1174},[173],{"categories":1176},[],{"categories":1178},[250],{"categories":1180},[127],{"categories":1182},[187],{"categories":1184},[250],{"categories":1186},[173],{"categories":1188},[173],{"categories":1190},[250],{"categories":1192},[],{"categories":1194},[],{"categories":1196},[209],{"categories":1198},[127],{"categories":1200},[127],{"categories":1202},[173],{"categories":1204},[173],{"categories":1206},[173],{"categories":1208},[170],{"categories":1210},[173],{"categories":1212},[173],{"categories":1214},[],{"categories":1216},[187],{"categories":1218},[187],{"categories":1220},[173],{"categories":1222},[187],{"categories":1224},[170],{"categories":1226},[],{"categories":1228},[173],{"categories":1230},[173],{"categories":1232},[173],{"categories":1234},[173],{"categories":1236},[127],{"categories":1238},[167],{"categories":1240},[170],{"categories":1242},[209],{"categories":1244},[127],{"categories":1246},[198],{"categories":1248},[278],{"categories":1250},[173],{"categories":1252},[127],{"categories":1254},[],{"categories":1256},[250],{"categories":1258},[],{"categories":1260},[173],{"categories":1262},[173],{"categories":1264},[],{"categories":1266},[187],{"categories":1268},[170],{"categories":1270},[1271],"Visual & Generative Media",{"categories":1273},[127],{"categories":1275},[],{"categories":1277},[173],{"categories":1279},[173],{"categories":1281},[187],{"categories":1283},[313],{"categories":1285},[253],{"categories":1287},[551],{"categories":1289},[187],{"categories":1291},[278],{"categories":1293},[173],{"categories":1295},[250],{"categories":1297},[173],{"categories":1299},[173],{"categories":1301},[187],{"categories":1303},[127],{"categories":1305},[173],{"categories":1307},[],{"categories":1309},[],{"categories":1311},[127],{"categories":1313},[167],{"categories":1315},[127],{"categories":1317},[515],{"categories":1319},[173],{"categories":1321},[178],{"categories":1323},[173],{"categories":1325},[170],{"categories":1327},[],{"categories":1329},[173],{"categories":1331},[178],{"categories":1333},[173],{"categories":1335},[173],{"categories":1337},[173],{"categories":1339},[173],{"categories":1341},[173],{"categories":1343},[278],{"categories":1345},[173],{"categories":1347},[464],{"categories":1349},[173],{"categories":1351},[127],{"categories":1353},[173],{"categories":1355},[173],{"categories":1357},[173],{"categories":1359},[173],{"categories":1361},[250],{"categories":1363},[127],{"categories":1365},[],{"categories":1367},[127],{"categories":1369},[],{"categories":1371},[313],{"categories":1373},[187],{"categories":1375},[],{"categories":1377},[515],{"categories":1379},[173],{"categories":1381},[127],{"categories":1383},[173],{"categories":1385},[250,173],{"categories":1387},[167],{"categories":1389},[],{"categories":1391},[173],{"categories":1393},[167],{"categories":1395},[1396],"Medical Imaging & Radiology",{"categories":1398},[250],{"categories":1400},[127],{"categories":1402},[187],{"categories":1404},[],{"categories":1406},[173],{"categories":1408},[173],{"categories":1410},[173],{"categories":1412},[],{"categories":1414},[],{"categories":1416},[173],{"categories":1418},[464],{"categories":1420},[173],{"categories":1422},[167],{"categories":1424},[173],{"categories":1426},[173],{"categories":1428},[],{"categories":1430},[127],{"categories":1432},[173],{"categories":1434},[178],{"categories":1436},[187],{"categories":1438},[173],{"categories":1440},[464],{"categories":1442},[173],{"categories":1444},[127],{"categories":1446},[173],{"categories":1448},[250],{"categories":1450},[127],{"categories":1452},[313],{"categories":1454},[250],{"categories":1456},[170],{"categories":1458},[127],{"categories":1460},[173],{"categories":1462},[173],{"categories":1464},[173],{"categories":1466},[173],{"categories":1468},[173],{"categories":1470},[127],{"categories":1472},[187],{"categories":1474},[173],{"categories":1476},[178],{"categories":1478},[],{"categories":1480},[209],{"categories":1482},[],{"categories":1484},[178],{"categories":1486},[127],{"categories":1488},[1110],{"categories":1490},[1110],{"categories":1492},[250],{"categories":1494},[173],{"categories":1496},[173],{"categories":1498},[127],{"categories":1500},[187],{"categories":1502},[250],{"categories":1504},[127],{"categories":1506},[209],{"categories":1508},[],{"categories":1510},[173],{"categories":1512},[],{"categories":1514},[173],{"categories":1516},[173],{"categories":1518},[173],{"categories":1520},[127],{"categories":1522},[1523],"Contract Review & E-Discovery",{"categories":1525},[250],{"categories":1527},[173],{"categories":1529},[167],{"categories":1531},[209],{"categories":1533},[173],{"categories":1535},[173],{"categories":1537},[278],{"categories":1539},[187],{"categories":1541},[173],{"categories":1543},[173],{"categories":1545},[127],{"categories":1547},[127],{"categories":1549},[828],{"categories":1551},[127],{"categories":1553},[127],{"categories":1555},[173],{"categories":1557},[173],{"categories":1559},[127],{"categories":1561},[173],{"categories":1563},[464],{"categories":1565},[447],{"categories":1567},[173],{"categories":1569},[127],{"categories":1571},[173],{"categories":1573},[1574],"Law-Firm Practice & Adoption",{"categories":1576},[173],{"categories":1578},[127],{"categories":1580},[250],{"categories":1582},[173],{"categories":1584},[173],{"categories":1586},[],{"categories":1588},[],{"categories":1590},[187],{"categories":1592},[],{"categories":1594},[167],{"categories":1596},[313],{"categories":1598},[173],{"categories":1600},[],{"categories":1602},[167],{"categories":1604},[170],{"categories":1606},[173],{"categories":1608},[278],{"categories":1610},[],{"categories":1612},[170],{"categories":1614},[170],{"categories":1616},[],{"categories":1618},[173],{"categories":1620},[173],{"categories":1622},[187],{"categories":1624},[],{"categories":1626},[],{"categories":1628},[],{"categories":1630},[],{"categories":1632},[173],{"categories":1634},[127],{"categories":1636},[313],{"categories":1638},[173],{"categories":1640},[167],{"categories":1642},[187],{"categories":1644},[173],{"categories":1646},[173],{"categories":1648},[187],{"categories":1650},[178],{"categories":1652},[173],{"categories":1654},[849],{"categories":1656},[173],{"categories":1658},[278],{"categories":1660},[187],{"categories":1662},[170],{"categories":1664},[173],{"categories":1666},[173],{"categories":1668},[250],{"categories":1670},[173],{"categories":1672},[173],{"categories":1674},[173],{"categories":1676},[127],{"categories":1678},[173,167],{"categories":1680},[464],{"categories":1682},[173],{"categories":1684},[173],{"categories":1686},[187],{"categories":1688},[187],{"categories":1690},[250],{"categories":1692},[127],{"categories":1694},[187],{"categories":1696},[173],{"categories":1698},[173],{"categories":1700},[],{"categories":1702},[],{"categories":1704},[173],{"categories":1706},[],{"categories":1708},[173],{"categories":1710},[187],{"categories":1712},[253],{"categories":1714},[209],{"categories":1716},[250],{"categories":1718},[173],{"categories":1720},[187],{"categories":1722},[],{"categories":1724},[127],{"categories":1726},[173],{"categories":1728},[173],{"categories":1730},[173],{"categories":1732},[173],{"categories":1734},[],{"categories":1736},[127],{"categories":1738},[173],{"categories":1740},[173],{"categories":1742},[],{"categories":1744},[127],{"categories":1746},[173],{"categories":1748},[173],{"categories":1750},[170],{"categories":1752},[173],{"categories":1754},[],{"categories":1756},[167],{"categories":1758},[173],{"categories":1760},[250],{"categories":1762},[187],{"categories":1764},[173],{"categories":1766},[167],{"categories":1768},[173],{"categories":1770},[187],{"categories":1772},[278],{"categories":1774},[127],{"categories":1776},[127],{"categories":1778},[173,250],{"categories":1780},[173],{"categories":1782},[209],{"categories":1784},[173],{"categories":1786},[209],{"categories":1788},[127],{"categories":1790},[250],{"categories":1792},[],{"categories":1794},[187],{"categories":1796},[313],{"categories":1798},[250],{"categories":1800},[187],{"categories":1802},[173],{"categories":1804},[178],{"categories":1806},[173],{"categories":1808},[127],{"categories":1810},[],{"categories":1812},[],{"categories":1814},[173],{"categories":1816},[],{"categories":1818},[],{"categories":1820},[178],{"categories":1822},[187],{"categories":1824},[173],{"categories":1826},[127],{"categories":1828},[127],{"categories":1830},[170],{"categories":1832},[127],{"categories":1834},[313],{"categories":1836},[173],{"categories":1838},[173],{"categories":1840},[198],{"categories":1842},[173],{"categories":1844},[173],{"categories":1846},[127],{"categories":1848},[173],{"categories":1850},[173],{"categories":1852},[420],{"categories":1854},[828],{"categories":1856},[],{"categories":1858},[250],{"categories":1860},[1574],{"categories":1862},[187],{"categories":1864},[],{"categories":1866},[],{"categories":1868},[127],{"categories":1870},[],{"categories":1872},[],{"categories":1874},[278],{"categories":1876},[173],{"categories":1878},[278],{"categories":1880},[127],{"categories":1882},[173],{"categories":1884},[187],{"categories":1886},[],{"categories":1888},[173],{"categories":1890},[173],{"categories":1892},[187],{"categories":1894},[1523],{"categories":1896},[250],{"categories":1898},[250],{"categories":1900},[173],{"categories":1902},[127],{"categories":1904},[167],{"categories":1906},[173],{"categories":1908},[173],{"categories":1910},[173],{"categories":1912},[250],{"categories":1914},[250],{"categories":1916},[127],{"categories":1918},[127],{"categories":1920},[173],{"categories":1922},[],{"categories":1924},[173],{"categories":1926},[],{"categories":1928},[1929],"Interaction & Product Design",{"categories":1931},[173],{"categories":1933},[127],{"categories":1935},[340],{"categories":1937},[209],{"categories":1939},[187],{"categories":1941},[173],{"categories":1943},[173],{"categories":1945},[187],{"categories":1947},[167],{"categories":1949},[127],{"categories":1951},[173],{"categories":1953},[],{"categories":1955},[127],{"categories":1957},[127],{"categories":1959},[],{"categories":1961},[187],{"categories":1963},[173],{"categories":1965},[167],{"categories":1967},[1929],{"categories":1969},[173],{"categories":1971},[167],{"categories":1973},[167],{"categories":1975},[],{"categories":1977},[187],{"categories":1979},[],{"categories":1981},[127],{"categories":1983},[209],{"categories":1985},[173],{"categories":1987},[127],{"categories":1989},[173],{"categories":1991},[127],{"categories":1993},[173],{"categories":1995},[173],{"categories":1997},[209],{"categories":1999},[253],{"categories":2001},[173],{"categories":2003},[178],{"categories":2005},[187],{"categories":2007},[2008],"Coding Agents & Dev Productivity",{"categories":2010},[209],{"categories":2012},[250],{"categories":2014},[],{"categories":2016},[173],{"categories":2018},[828],{"categories":2020},[],{"categories":2022},[173],{"categories":2024},[173],{"categories":2026},[209],{"categories":2028},[],{"categories":2030},[],{"categories":2032},[173],{"categories":2034},[],{"categories":2036},[127],{"categories":2038},[173],{"categories":2040},[],{"categories":2042},[187],{"categories":2044},[187],{"categories":2046},[173],{"categories":2048},[253],{"categories":2050},[],{"categories":2052},[173],{"categories":2054},[173],{"categories":2056},[173],{"categories":2058},[253],{"categories":2060},[187],{"categories":2062},[],{"categories":2064},[],{"categories":2066},[173],{"categories":2068},[127],{"categories":2070},[127],{"categories":2072},[399],{"categories":2074},[187],{"categories":2076},[187],{"categories":2078},[127],{"categories":2080},[209],{"categories":2082},[209],{"categories":2084},[127],{"categories":2086},[127],{"categories":2088},[173],{"categories":2090},[167],{"categories":2092},[1929],{"categories":2094},[173,313],{"categories":2096},[],{"categories":2098},[250],{"categories":2100},[187],{"categories":2102},[167],{"categories":2104},[173],{"categories":2106},[127],{"categories":2108},[2109],"The Designer's Role & Craft",{"categories":2111},[250],{"categories":2113},[],{"categories":2115},[127],{"categories":2117},[173],{"categories":2119},[127],{"categories":2121},[127],{"categories":2123},[173],{"categories":2125},[278],{"categories":2127},[173],{"categories":2129},[187],{"categories":2131},[250],{"categories":2133},[173],{"categories":2135},[],{"categories":2137},[127],{"categories":2139},[250],{"categories":2141},[173],{"categories":2143},[173],{"categories":2145},[2146],"AI UX Patterns",{"categories":2148},[127],{"categories":2150},[127],{"categories":2152},[127],{"categories":2154},[127],{"categories":2156},[278],{"categories":2158},[253],{"categories":2160},[173],{"categories":2162},[127],{"categories":2164},[173],{"categories":2166},[1110],{"categories":2168},[],{"categories":2170},[278],{"categories":2172},[127],{"categories":2174},[209],{"categories":2176},[187],{"categories":2178},[173],{"categories":2180},[127],{"categories":2182},[],{"categories":2184},[],{"categories":2186},[173],{"categories":2188},[127],{"categories":2190},[173],{"categories":2192},[127],{"categories":2194},[399],{"categories":2196},[250],{"categories":2198},[209],{"categories":2200},[187],{"categories":2202},[173],{"categories":2204},[127],{"categories":2206},[127],{"categories":2208},[],{"categories":2210},[173],{"categories":2212},[],{"categories":2214},[],{"categories":2216},[173],{"categories":2218},[173],{"categories":2220},[127],{"categories":2222},[187],{"categories":2224},[],{"categories":2226},[],{"categories":2228},[253],{"categories":2230},[198],{"categories":2232},[173],{"categories":2234},[253],{"categories":2236},[209],{"categories":2238},[173],{"categories":2240},[173],{"categories":2242},[127],{"categories":2244},[173],{"categories":2246},[127],{"categories":2248},[173],{"categories":2250},[173],{"categories":2252},[127],{"categories":2254},[],{"categories":2256},[],{"categories":2258},[173],{"categories":2260},[313],{"categories":2262},[173],{"categories":2264},[],{"categories":2266},[],{"categories":2268},[250],{"categories":2270},[849],{"categories":2272},[127],{"categories":2274},[167],{"categories":2276},[2109],{"categories":2278},[],{"categories":2280},[],{"categories":2282},[173],{"categories":2284},[],{"categories":2286},[],{"categories":2288},[187],{"categories":2290},[209],{"categories":2292},[278],{"categories":2294},[170],{"categories":2296},[173],{"categories":2298},[173],{"categories":2300},[170],{"categories":2302},[],{"categories":2304},[250],{"categories":2306},[173],{"categories":2308},[173],{"categories":2310},[127],{"categories":2312},[170],{"categories":2314},[173],{"categories":2316},[173],{"categories":2318},[167],{"categories":2320},[173],{"categories":2322},[],{"categories":2324},[167],{"categories":2326},[173],{"categories":2328},[278],{"categories":2330},[127],{"categories":2332},[209],{"categories":2334},[173],{"categories":2336},[170],{"categories":2338},[173],{"categories":2340},[173],{"categories":2342},[173],{"categories":2344},[127],{"categories":2346},[],{"categories":2348},[173],{"categories":2350},[187],{"categories":2352},[167],{"categories":2354},[173],{"categories":2356},[173],{"categories":2358},[],{"categories":2360},[173],{"categories":2362},[464],{"categories":2364},[209],{"categories":2366},[173],{"categories":2368},[173],{"categories":2370},[],{"categories":2372},[170],{"categories":2374},[170],{"categories":2376},[173],{"categories":2378},[173],{"categories":2380},[178],{"categories":2382},[173],{"categories":2384},[173],{"categories":2386},[173],{"categories":2388},[187],{"categories":2390},[187],{"categories":2392},[173],{"categories":2394},[],{"categories":2396},[187],{"categories":2398},[173],{"categories":2400},[187],{"categories":2402},[551],{"categories":2404},[],{"categories":2406},[],{"categories":2408},[173],{"categories":2410},[209],{"categories":2412},[],{"categories":2414},[313],{"categories":2416},[173],{"categories":2418},[173],{"categories":2420},[250],{"categories":2422},[817],{"categories":2424},[],{"categories":2426},[173],{"categories":2428},[173],{"categories":2430},[173],{"categories":2432},[187],{"categories":2434},[173],{"categories":2436},[173],{"categories":2438},[173,313],{"categories":2440},[173],{"categories":2442},[173],{"categories":2444},[250],{"categories":2446},[127],{"categories":2448},[],{"categories":2450},[127],{"categories":2452},[127],{"categories":2454},[173],{"categories":2456},[173],{"categories":2458},[173],{"categories":2460},[253],{"categories":2462},[173],{"categories":2464},[2146],{"categories":2466},[167],{"categories":2468},[253],{"categories":2470},[167],{"categories":2472},[187],{"categories":2474},[250],{"categories":2476},[127],{"categories":2478},[173],{"categories":2480},[],{"categories":2482},[173],{"categories":2484},[173],{"categories":2486},[209],{"categories":2488},[173],{"categories":2490},[127],{"categories":2492},[173],{"categories":2494},[173],{"categories":2496},[170],{"categories":2498},[],{"categories":2500},[313],{"categories":2502},[173],{"categories":2504},[399],{"categories":2506},[250],{"categories":2508},[250],{"categories":2510},[187],{"categories":2512},[127],{"categories":2514},[173],{"categories":2516},[170],{"categories":2518},[209],{"categories":2520},[173],{"categories":2522},[250],{"categories":2524},[127],{"categories":2526},[173],{"categories":2528},[173],{"categories":2530},[515],{"categories":2532},[],{"categories":2534},[173],{"categories":2536},[173],{"categories":2538},[173],{"categories":2540},[],{"categories":2542},[],{"categories":2544},[173],{"categories":2546},[173],{"categories":2548},[173],{"categories":2550},[173],{"categories":2552},[187],{"categories":2554},[173],{"categories":2556},[173],{"categories":2558},[127],{"categories":2560},[173],{"categories":2562},[173],{"categories":2564},[173],{"categories":2566},[173],{"categories":2568},[173],{"categories":2570},[],{"categories":2572},[187],{"categories":2574},[253],{"categories":2576},[173],{"categories":2578},[127],{"categories":2580},[173],{"categories":2582},[],{"categories":2584},[],{"categories":2586},[173],{"categories":2588},[173],{"categories":2590},[173],{"categories":2592},[209],{"categories":2594},[],{"categories":2596},[173],{"categories":2598},[250],{"categories":2600},[173],{"categories":2602},[313],{"categories":2604},[1574],{"categories":2606},[209],{"categories":2608},[187],{"categories":2610},[187],{"categories":2612},[187],{"categories":2614},[209],{"categories":2616},[209],{"categories":2618},[313],{"categories":2620},[],{"categories":2622},[209],{"categories":2624},[173],{"categories":2626},[167],{"categories":2628},[187],{"categories":2630},[173],{"categories":2632},[209],{"categories":2634},[],{"categories":2636},[173],{"categories":2638},[187],{"categories":2640},[253],{"categories":2642},[173],{"categories":2644},[209],{"categories":2646},[173],{"categories":2648},[187],{"categories":2650},[127],{"categories":2652},[209],{"categories":2654},[127],{"categories":2656},[313],{"categories":2658},[127],{"categories":2660},[173],{"categories":2662},[173],{"categories":2664},[187],{"categories":2666},[173],{"categories":2668},[],{"categories":2670},[170],{"categories":2672},[187],{"categories":2674},[],{"categories":2676},[],{"categories":2678},[173],{"categories":2680},[127],{"categories":2682},[173],{"categories":2684},[2685],"Frameworks & Tooling",{"categories":2687},[173],{"categories":2689},[173],{"categories":2691},[187],{"categories":2693},[173],{"categories":2695},[173],{"categories":2697},[],{"categories":2699},[253],{"categories":2701},[253],{"categories":2703},[167],{"categories":2705},[127],{"categories":2707},[250],{"categories":2709},[],{"categories":2711},[1574],{"categories":2713},[173],{"categories":2715},[187],{"categories":2717},[173],{"categories":2719},[313],{"categories":2721},[313],{"categories":2723},[],{"categories":2725},[127],{"categories":2727},[209],{"categories":2729},[209],{"categories":2731},[173],{"categories":2733},[127],{"categories":2735},[],{"categories":2737},[250],{"categories":2739},[173],{"categories":2741},[173],{"categories":2743},[],{"categories":2745},[173],{"categories":2747},[173],{"categories":2749},[],{"categories":2751},[187],{"categories":2753},[173],{"categories":2755},[187],{"categories":2757},[313],{"categories":2759},[173],{"categories":2761},[187],{"categories":2763},[170],{"categories":2765},[173],{"categories":2767},[1574],{"categories":2769},[],{"categories":2771},[127],{"categories":2773},[167],{"categories":2775},[167],{"categories":2777},[],{"categories":2779},[127],{"categories":2781},[173],{"categories":2783},[2784],"AI Design Tooling",{"categories":2786},[250],{"categories":2788},[173],{"categories":2790},[173],{"categories":2792},[187],{"categories":2794},[250],{"categories":2796},[173],{"categories":2798},[187],{"categories":2800},[209],{"categories":2802},[178],{"categories":2804},[187],{"categories":2806},[127],{"categories":2808},[],{"categories":2810},[173],{"categories":2812},[173],{"categories":2814},[127],{"categories":2816},[173],{"categories":2818},[173],{"categories":2820},[173],{"categories":2822},[],{"categories":2824},[127],{"categories":2826},[2685],{"categories":2828},[173],{"categories":2830},[127],{"categories":2832},[127],{"categories":2834},[187],{"categories":2836},[187],{"categories":2838},[],{"categories":2840},[187],{"categories":2842},[173],{"categories":2844},[173],{"categories":2846},[127],{"categories":2848},[170],{"categories":2850},[173],{"categories":2852},[],{"categories":2854},[173],{"categories":2856},[173],{"categories":2858},[1929],{"categories":2860},[],{"categories":2862},[173],{"categories":2864},[173],{"categories":2866},[173],{"categories":2868},[],{"categories":2870},[173],{"categories":2872},[173],{"categories":2874},[173],{"categories":2876},[278],{"categories":2878},[209],{"categories":2880},[173],{"categories":2882},[173],{"categories":2884},[1574],{"categories":2886},[167],{"categories":2888},[173],{"categories":2890},[173],{"categories":2892},[253],{"categories":2894},[173],{"categories":2896},[209],{"categories":2898},[127],{"categories":2900},[],{"categories":2902},[173],{"categories":2904},[173],{"categories":2906},[250],{"categories":2908},[173],{"categories":2910},[278],{"categories":2912},[173],{"categories":2914},[127],{"categories":2916},[],{"categories":2918},[],{"categories":2920},[],{"categories":2922},[167],{"categories":2924},[209],{"categories":2926},[127],{"categories":2928},[173],{"categories":2930},[173],{"categories":2932},[173],{"categories":2934},[420],{"categories":2936},[250],{"categories":2938},[127],{"categories":2940},[173],{"categories":2942},[],{"categories":2944},[127],{"categories":2946},[127],{"categories":2948},[],{"categories":2950},[173],{"categories":2952},[127],{"categories":2954},[173],{"categories":2956},[],{"categories":2958},[173],{"categories":2960},[173],{"categories":2962},[209],{"categories":2964},[250],{"categories":2966},[127],{"categories":2968},[250],{"categories":2970},[127],{"categories":2972},[173],{"categories":2974},[170],{"categories":2976},[],{"categories":2978},[],{"categories":2980},[173],{"categories":2982},[173],{"categories":2984},[167],{"categories":2986},[127],{"categories":2988},[209],{"categories":2990},[],{"categories":2992},[250],{"categories":2994},[],{"categories":2996},[187],{"categories":2998},[173],{"categories":3000},[187],{"categories":3002},[250],{"categories":3004},[187],{"categories":3006},[173],{"categories":3008},[],{"categories":3010},[173],{"categories":3012},[173],{"categories":3014},[],{"categories":3016},[173],{"categories":3018},[278],{"categories":3020},[173],{"categories":3022},[313],{"categories":3024},[187],{"categories":3026},[],{"categories":3028},[127],{"categories":3030},[173],{"categories":3032},[167],{"categories":3034},[515],{"categories":3036},[127],{"categories":3038},[127],{"categories":3040},[173],{"categories":3042},[173],{"categories":3044},[],{"categories":3046},[173],{"categories":3048},[167],{"categories":3050},[173],{"categories":3052},[170],{"categories":3054},[187],{"categories":3056},[250],{"categories":3058},[],{"categories":3060},[],{"categories":3062},[],{"categories":3064},[127],{"categories":3066},[187],{"categories":3068},[250],{"categories":3070},[209],{"categories":3072},[173],{"categories":3074},[209],{"categories":3076},[127],{"categories":3078},[250],{"categories":3080},[173],{"categories":3082},[],{"categories":3084},[173],{"categories":3086},[198],{"categories":3088},[127],{"categories":3090},[250],{"categories":3092},[209],{"categories":3094},[170],{"categories":3096},[187],{"categories":3098},[173],{"categories":3100},[209],{"categories":3102},[278],{"categories":3104},[],{"categories":3106},[],{"categories":3108},[253],{"categories":3110},[464],{"categories":3112},[173],{"categories":3114},[127],{"categories":3116},[173,187],{"categories":3118},[209],{"categories":3120},[173],{"categories":3122},[173],{"categories":3124},[173],{"categories":3126},[173],{"categories":3128},[127],{"categories":3130},[173],{"categories":3132},[127],{"categories":3134},[173],{"categories":3136},[173],{"categories":3138},[],{"categories":3140},[173],{"categories":3142},[1110],{"categories":3144},[187],{"categories":3146},[250],{"categories":3148},[173],{"categories":3150},[173],{"categories":3152},[173],{"categories":3154},[253],{"categories":3156},[127],{"categories":3158},[278],{"categories":3160},[313],{"categories":3162},[],{"categories":3164},[173],{"categories":3166},[170],{"categories":3168},[127],{"categories":3170},[167],{"categories":3172},[127],{"categories":3174},[173],{"categories":3176},[127],{"categories":3178},[178],{"categories":3180},[187],{"categories":3182},[173],{"categories":3184},[173],{"categories":3186},[],{"categories":3188},[],{"categories":3190},[],{"categories":3192},[313],{"categories":3194},[173],{"categories":3196},[209],{"categories":3198},[173],{"categories":3200},[173],{"categories":3202},[173],{"categories":3204},[173],{"categories":3206},[],{"categories":3208},[253],{"categories":3210},[170],{"categories":3212},[127],{"categories":3214},[173],{"categories":3216},[],{"categories":3218},[173],{"categories":3220},[127],{"categories":3222},[173],{"categories":3224},[313],{"categories":3226},[],{"categories":3228},[250],{"categories":3230},[250],{"categories":3232},[],{"categories":3234},[187],{"categories":3236},[173],{"categories":3238},[250],{"categories":3240},[173],{"categories":3242},[170],{"categories":3244},[127],{"categories":3246},[173],{"categories":3248},[],{"categories":3250},[209],{"categories":3252},[173],{"categories":3254},[173],{"categories":3256},[173],{"categories":3258},[250],{"categories":3260},[127],{"categories":3262},[209],{"categories":3264},[],{"categories":3266},[127],{"categories":3268},[170],{"categories":3270},[127],{"categories":3272},[250],{"categories":3274},[173],{"categories":3276},[173],{"categories":3278},[173],{"categories":3280},[464],{"categories":3282},[173],{"categories":3284},[],{"categories":3286},[173],{"categories":3288},[173],{"categories":3290},[313],{"categories":3292},[209],{"categories":3294},[253],{"categories":3296},[551],{"categories":3298},[253],{"categories":3300},[],{"categories":3302},[],{"categories":3304},[],{"categories":3306},[127],{"categories":3308},[127],{"categories":3310},[187],{"categories":3312},[173],{"categories":3314},[447],{"categories":3316},[187],{"categories":3318},[173],{"categories":3320},[173],{"categories":3322},[173],{"categories":3324},[173],{"categories":3326},[127],{"categories":3328},[],{"categories":3330},[],{"categories":3332},[173],{"categories":3334},[],{"categories":3336},[173],{"categories":3338},[127],{"categories":3340},[250],{"categories":3342},[173],{"categories":3344},[173],{"categories":3346},[],{"categories":3348},[127],{"categories":3350},[178],{"categories":3352},[173],{"categories":3354},[250],{"categories":3356},[173],{"categories":3358},[127],{"categories":3360},[170],{"categories":3362},[173],{"categories":3364},[278],{"categories":3366},[127],{"categories":3368},[173],{"categories":3370},[817],{"categories":3372},[173],{"categories":3374},[127],{"categories":3376},[173],{"categories":3378},[187],{"categories":3380},[173],{"categories":3382},[515],{"categories":3384},[250],{"categories":3386},[],{"categories":3388},[209],{"categories":3390},[464],{"categories":3392},[127],{"categories":3394},[173],{"categories":3396},[],{"categories":3398},[209],{"categories":3400},[399],{"categories":3402},[127],{"categories":3404},[127],{"categories":3406},[173],{"categories":3408},[173],{"categories":3410},[127],{"categories":3412},[],{"categories":3414},[173],{"categories":3416},[170],{"categories":3418},[127],{"categories":3420},[],{"categories":3422},[187],{"categories":3424},[173],{"categories":3426},[173],{"categories":3428},[167],{"categories":3430},[209],{"categories":3432},[313],{"categories":3434},[198],{"categories":3436},[127],{"categories":3438},[127],{"categories":3440},[173],{"categories":3442},[127],{"categories":3444},[173],{"categories":3446},[167],{"categories":3448},[],{"categories":3450},[173],{"categories":3452},[173],{"categories":3454},[],{"categories":3456},[],{"categories":3458},[250],{"categories":3460},[127],{"categories":3462},[173,170],{"categories":3464},[127],{"categories":3466},[173],{"categories":3468},[],{"categories":3470},[167],{"categories":3472},[253],{"categories":3474},[170],{"categories":3476},[173],{"categories":3478},[187],{"categories":3480},[173],{"categories":3482},[127],{"categories":3484},[173],{"categories":3486},[173],{"categories":3488},[173],{"categories":3490},[209],{"categories":3492},[1110],{"categories":3494},[127],{"categories":3496},[173],{"categories":3498},[],{"categories":3500},[],{"categories":3502},[173],{"categories":3504},[127],{"categories":3506},[173],{"categories":3508},[313],{"categories":3510},[],{"categories":3512},[173],{"categories":3514},[127],{"categories":3516},[198],{"categories":3518},[127],{"categories":3520},[464],{"categories":3522},[],{"categories":3524},[420],{"categories":3526},[127],{"categories":3528},[173],{"categories":3530},[278],{"categories":3532},[173],{"categories":3534},[253],{"categories":3536},[127],{"categories":3538},[173],{"categories":3540},[464],{"categories":3542},[173],{"categories":3544},[313],{"categories":3546},[],{"categories":3548},[173],{"categories":3550},[278],{"categories":3552},[250],{"categories":3554},[173],{"categories":3556},[173],{"categories":3558},[173],{"categories":3560},[],{"categories":3562},[278],{"categories":3564},[209],{"categories":3566},[173],{"categories":3568},[173],{"categories":3570},[551],{"categories":3572},[167],{"categories":3574},[173],{"categories":3576},[],{"categories":3578},[],{"categories":3580},[250],{"categories":3582},[173],{"categories":3584},[253],{"categories":3586},[278],{"categories":3588},[127],{"categories":3590},[278],{"categories":3592},[209],{"categories":3594},[],{"categories":3596},[173],{"categories":3598},[173],{"categories":3600},[],{"categories":3602},[173],{"categories":3604},[173],{"categories":3606},[574],{"categories":3608},[173],{"categories":3610},[173],{"categories":3612},[127],{"categories":3614},[187],{"categories":3616},[464],{"categories":3618},[173],{"categories":3620},[173],{"categories":3622},[173],{"categories":3624},[],{"categories":3626},[173,187],{"categories":3628},[209],{"categories":3630},[127],{"categories":3632},[187],{"categories":3634},[127],{"categories":3636},[849],{"categories":3638},[187],{"categories":3640},[173],{"categories":3642},[167],{"categories":3644},[],{"categories":3646},[],{"categories":3648},[127],{"categories":3650},[173],{"categories":3652},[187],{"categories":3654},[167],{"categories":3656},[187],{"categories":3658},[187],{"categories":3660},[173],{"categories":3662},[278],{"categories":3664},[173],{"categories":3666},[187],{"categories":3668},[],{"categories":3670},[173],{"categories":3672},[250,173],{"categories":3674},[313],{"categories":3676},[167],{"categories":3678},[],{"categories":3680},[173],{"categories":3682},[173],{"categories":3684},[170],{"categories":3686},[170],{"categories":3688},[173],{"categories":3690},[173],{"categories":3692},[399],{"categories":3694},[173],{"categories":3696},[187],{"categories":3698},[253],{"categories":3700},[127],{"categories":3702},[187],{"categories":3704},[173],{"categories":3706},[173],{"categories":3708},[209],{"categories":3710},[278],{"categories":3712},[250],{"categories":3714},[173],{"categories":3716},[173],{"categories":3718},[173],{"categories":3720},[173],{"categories":3722},[167],{"categories":3724},[173],{"categories":3726},[127],{"categories":3728},[127],{"categories":3730},[187],{"categories":3732},[209],{"categories":3734},[187],{"categories":3736},[187],{"categories":3738},[],{"categories":3740},[],{"categories":3742},[253],{"categories":3744},[173],{"categories":3746},[187],{"categories":3748},[173],{"categories":3750},[250],{"categories":3752},[464],{"categories":3754},[420],{"categories":3756},[399],{"categories":3758},[173],{"categories":3760},[173],{"categories":3762},[173],{"categories":3764},[253],{"categories":3766},[173],{"categories":3768},[173],{"categories":3770},[173],{"categories":3772},[173],{"categories":3774},[173],{"categories":3776},[173],{"categories":3778},[127],{"categories":3780},[167],{"categories":3782},[127],{"categories":3784},[173,170],{"categories":3786},[],{"categories":3788},[250],{"categories":3790},[],{"categories":3792},[178],{"categories":3794},[173],{"categories":3796},[209],{"categories":3798},[167],{"categories":3800},[167],{"categories":3802},[127],{"categories":3804},[127],{"categories":3806},[127],{"categories":3808},[173],{"categories":3810},[173],{"categories":3812},[170],{"categories":3814},[187],{"categories":3816},[278],{"categories":3818},[173],{"categories":3820},[],{"categories":3822},[209],{"categories":3824},[173],{"categories":3826},[173],{"categories":3828},[173],{"categories":3830},[173],{"categories":3832},[173],{"categories":3834},[187],{"categories":3836},[209],{"categories":3838},[187],{"categories":3840},[187],{"categories":3842},[173],{"categories":3844},[173],{"categories":3846},[173],{"categories":3848},[420],{"categories":3850},[173],{"categories":3852},[127],{"categories":3854},[209],{"categories":3856},[173],{"categories":3858},[173],{"categories":3860},[173],{"categories":3862},[127],{"categories":3864},[173],{"categories":3866},[173],{"categories":3868},[173],{"categories":3870},[2685],{"categories":3872},[3873],"Clinical AI",{"categories":3875},[250],{"categories":3877},[173],{"categories":3879},[173],{"categories":3881},[173],{"categories":3883},[313],{"categories":3885},[2146],{"categories":3887},[173],{"categories":3889},[178],{"categories":3891},[173],{"categories":3893},[127],{"categories":3895},[173],{"categories":3897},[173],{"categories":3899},[209],{"categories":3901},[173],{"categories":3903},[127],{"categories":3905},[187],{"categories":3907},[278],{"categories":3909},[173],{"categories":3911},[173],{"categories":3913},[170],{"categories":3915},[173],{"categories":3917},[173],{"categories":3919},[515],{"categories":3921},[173],{"categories":3923},[],{"categories":3925},[173],{"categories":3927},[187],{"categories":3929},[167],{"categories":3931},[173],{"categories":3933},[],{"categories":3935},[],{"categories":3937},[173],{"categories":3939},[],{"categories":3941},[170],{"categories":3943},[173],{"categories":3945},[127],{"categories":3947},[209],{"categories":3949},[209],{"categories":3951},[209],{"categories":3953},[209],{"categories":3955},[],{"categories":3957},[167],{"categories":3959},[127],{"categories":3961},[209],{"categories":3963},[173],{"categories":3965},[574],{"categories":3967},[178],{"categories":3969},[173],{"categories":3971},[167],{"categories":3973},[127],{"categories":3975},[173],{"categories":3977},[173],{"categories":3979},[173,127],{"categories":3981},[127],{"categories":3983},[313],{"categories":3985},[209],{"categories":3987},[127],{"categories":3989},[209],{"categories":3991},[127],{"categories":3993},[173],{"categories":3995},[],{"categories":3997},[209],{"categories":3999},[278],{"categories":4001},[167],{"categories":4003},[173],{"categories":4005},[173],{"categories":4007},[],{"categories":4009},[187],{"categories":4011},[],{"categories":4013},[167],{"categories":4015},[127],{"categories":4017},[209],{"categories":4019},[173],{"categories":4021},[209],{"categories":4023},[167],{"categories":4025},[209],{"categories":4027},[209],{"categories":4029},[],{"categories":4031},[170],{"categories":4033},[127],{"categories":4035},[209],{"categories":4037},[209],{"categories":4039},[209],{"categories":4041},[209],{"categories":4043},[209],{"categories":4045},[209],{"categories":4047},[209],{"categories":4049},[209],{"categories":4051},[209],{"categories":4053},[209],{"categories":4055},[253],{"categories":4057},[167],{"categories":4059},[173],{"categories":4061},[173],{"categories":4063},[127],{"categories":4065},[127],{"categories":4067},[],{"categories":4069},[173,167],{"categories":4071},[],{"categories":4073},[127],{"categories":4075},[173],{"categories":4077},[209],{"categories":4079},[127],{"categories":4081},[849],{"categories":4083},[173],{"categories":4085},[173],{"categories":4087},[173],{"categories":4089},[173],{"categories":4091},[173],{"categories":4093},[399],{"categories":4095},[173],{"categories":4097},[127],{"categories":4099},[170],{"categories":4101},[127],{"categories":4103},[127],{"categories":4105},[],{"categories":4107},[127],{"categories":4109},[250],{"categories":4111},[209],{"categories":4113},[173],{"categories":4115},[],{"categories":4117},[178],{"categories":4119},[],{"categories":4121},[187],{"categories":4123},[127],{"categories":4125},[250],{"categories":4127},[173],{"categories":4129},[],{"categories":4131},[173],{"categories":4133},[],{"categories":4135},[278],{"categories":4137},[173],{"categories":4139},[],{"categories":4141},[],{"categories":4143},[209],{"categories":4145},[167],{"categories":4147},[173],{"categories":4149},[173],{"categories":4151},[170],{"categories":4153},[173],{"categories":4155},[173],{"categories":4157},[173],{"categories":4159},[170],{"categories":4161},[250],{"categories":4163},[],{"categories":4165},[173],{"categories":4167},[209],{"categories":4169},[],{"categories":4171},[173],{"categories":4173},[173],{"categories":4175},[250],{"categories":4177},[173],{"categories":4179},[278],{"categories":4181},[173],{"categories":4183},[313],{"categories":4185},[],{"categories":4187},[127],{"categories":4189},[278],{"categories":4191},[187],{"categories":4193},[],{"categories":4195},[173],{"categories":4197},[],{"categories":4199},[127],{"categories":4201},[250],{"categories":4203},[187],{"categories":4205},[],{"categories":4207},[2685],{"categories":4209},[170],{"categories":4211},[167],{"categories":4213},[173],{"categories":4215},[253],{"categories":4217},[127],{"categories":4219},[250],{"categories":4221},[187],{"categories":4223},[],{"categories":4225},[],{"categories":4227},[173],{"categories":4229},[167],{"categories":4231},[173],{"categories":4233},[278],{"categories":4235},[],{"categories":4237},[127],{"categories":4239},[127],{"categories":4241},[127],{"categories":4243},[173],{"categories":4245},[209],{"categories":4247},[187],{"categories":4249},[173],{"categories":4251},[127],{"categories":4253},[178],{"categories":4255},[173],{"categories":4257},[173],{"categories":4259},[127],{"categories":4261},[173],{"categories":4263},[178],{"categories":4265},[278],{"categories":4267},[209],{"categories":4269},[],{"categories":4271},[278],{"categories":4273},[],{"categories":4275},[187],{"categories":4277},[127],{"categories":4279},[],{"categories":4281},[173],{"categories":4283},[173],{"categories":4285},[173],{"categories":4287},[173],{"categories":4289},[127],{"categories":4291},[170],{"categories":4293},[167],{"categories":4295},[173],{"categories":4297},[250],{"categories":4299},[187],{"categories":4301},[187],{"categories":4303},[173],{"categories":4305},[253],{"categories":4307},[127],{"categories":4309},[173],{"categories":4311},[173],{"categories":4313},[127],{"categories":4315},[173],{"categories":4317},[170],{"categories":4319},[250],{"categories":4321},[187],{"categories":4323},[127],{"categories":4325},[173],{"categories":4327},[178],{"categories":4329},[173],{"categories":4331},[127],{"categories":4333},[173],{"categories":4335},[209],{"categories":4337},[],{"categories":4339},[167],{"categories":4341},[173],{"categories":4343},[173],{"categories":4345},[173],{"categories":4347},[187],{"categories":4349},[187],{"categories":4351},[173],{"categories":4353},[187],{"categories":4355},[173],{"categories":4357},[127],{"categories":4359},[173],{"categories":4361},[173],{"categories":4363},[173],{"categories":4365},[173],{"categories":4367},[],{"categories":4369},[173],{"categories":4371},[250],{"categories":4373},[170],{"categories":4375},[209],{"categories":4377},[127],{"categories":4379},[173],{"categories":4381},[173],{"categories":4383},[250],{"categories":4385},[127],{"categories":4387},[173],{"categories":4389},[278],{"categories":4391},[173],{"categories":4393},[253],{"categories":4395},[173],{"categories":4397},[173],{"categories":4399},[209],{"categories":4401},[173],{"categories":4403},[173],{"categories":4405},[173],{"categories":4407},[127],{"categories":4409},[313],{"categories":4411},[173],{"categories":4413},[187],{"categories":4415},[127],{"categories":4417},[253],{"categories":4419},[],{"categories":4421},[127],{"categories":4423},[187],{"categories":4425},[173],{"categories":4427},[2008],{"categories":4429},[250],{"categories":4431},[340],{"categories":4433},[173],{"categories":4435},[173],{"categories":4437},[167],{"categories":4439},[187],{"categories":4441},[170],{"categories":4443},[187],{"categories":4445},[173],{"categories":4447},[],{"categories":4449},[127],{"categories":4451},[127],{"categories":4453},[173],{"categories":4455},[173],{"categories":4457},[253],{"categories":4459},[],{"categories":4461},[209],{"categories":4463},[],{"categories":4465},[209],{"categories":4467},[173],{"categories":4469},[173],{"categories":4471},[127],{"categories":4473},[173],{"categories":4475},[127],{"categories":4477},[127],{"categories":4479},[],{"categories":4481},[209],{"categories":4483},[173],{"categories":4485},[],{"categories":4487},[173],{"categories":4489},[173],{"categories":4491},[],{"categories":4493},[250],{"categories":4495},[187],{"categories":4497},[127],{"categories":4499},[173],{"categories":4501},[173],{"categories":4503},[278],{"categories":4505},[173],{"categories":4507},[173],{"categories":4509},[167],{"categories":4511},[],{"categories":4513},[173],{"categories":4515},[173],{"categories":4517},[],{"categories":4519},[167],{"categories":4521},[209],{"categories":4523},[187],{"categories":4525},[178],{"categories":4527},[464],{"categories":4529},[173],{"categories":4531},[173],{"categories":4533},[173],{"categories":4535},[187],{"categories":4537},[209],{"categories":4539},[250],{"categories":4541},[173],{"categories":4543},[173],{"categories":4545},[173],{"categories":4547},[209],{"categories":4549},[250],{"categories":4551},[173],{"categories":4553},[209],{"categories":4555},[250],{"categories":4557},[173],{"categories":4559},[209],{"categories":4561},[127],{"categories":4563},[127],{"categories":4565},[127],{"categories":4567},[187],{"categories":4569},[209],{"categories":4571},[127],{"categories":4573},[127],{"categories":4575},[173],{"categories":4577},[187],{"categories":4579},[250],{"categories":4581},[173],{"categories":4583},[],{"categories":4585},[127],{"categories":4587},[],{"categories":4589},[173],{"categories":4591},[],{"categories":4593},[],{"categories":4595},[127],{"categories":4597},[170],{"categories":4599},[127],{"categories":4601},[4602],"Liability & Ethics",{"categories":4604},[173],{"categories":4606},[127],{"categories":4608},[167],{"categories":4610},[127],{"categories":4612},[170],{"categories":4614},[278],{"categories":4616},[127],{"categories":4618},[],{"categories":4620},[551],{"categories":4622},[127],{"categories":4624},[],{"categories":4626},[167],{"categories":4628},[127],{"categories":4630},[],{"categories":4632},[127],{"categories":4634},[173],{"categories":4636},[173],{"categories":4638},[209],{"categories":4640},[173],{"categories":4642},[173],{"categories":4644},[127],{"categories":4646},[173],{"categories":4648},[173],{"categories":4650},[209],{"categories":4652},[127],{"categories":4654},[187],{"categories":4656},[250],{"categories":4658},[167],{"categories":4660},[173],{"categories":4662},[173],{"categories":4664},[],{"categories":4666},[127],{"categories":4668},[127],{"categories":4670},[464],{"categories":4672},[250],{"categories":4674},[313],{"categories":4676},[209],{"categories":4678},[173],{"categories":4680},[250],{"categories":4682},[173],{"categories":4684},[167],{"categories":4686},[],{"categories":4688},[127],{"categories":4690},[173],{"categories":4692},[173],{"categories":4694},[127],{"categories":4696},[173],{"categories":4698},[250],{"categories":4700},[],{"categories":4702},[127],{"categories":4704},[178],{"categories":4706},[209],{"categories":4708},[127],{"categories":4710},[170],{"categories":4712},[],{"categories":4714},[173],{"categories":4716},[178],{"categories":4718},[173],{"categories":4720},[127],{"categories":4722},[209],{"categories":4724},[167],{"categories":4726},[313],{"categories":4728},[173],{"categories":4730},[173],{"categories":4732},[173],{"categories":4734},[209],{"categories":4736},[170],{"categories":4738},[173],{"categories":4740},[250],{"categories":4742},[209],{"categories":4744},[313],{"categories":4746},[173],{"categories":4748},[127],{"categories":4750},[],{"categories":4752},[515],{"categories":4754},[],{"categories":4756},[173],{"categories":4758},[313],{"categories":4760},[253],{"categories":4762},[127],{"categories":4764},[127],{"categories":4766},[4767],"Design News & Tools",{"categories":4769},[173],{"categories":4771},[209],{"categories":4773},[173],{"categories":4775},[173],{"categories":4777},[167],{"categories":4779},[173],{"categories":4781},[250],{"categories":4783},[127],{"categories":4785},[127],{"categories":4787},[250],{"categories":4789},[173],{"categories":4791},[464],{"categories":4793},[173],{"categories":4795},[173],{"categories":4797},[464],{"categories":4799},[173],{"categories":4801},[278],{"categories":4803},[173],{"categories":4805},[127],{"categories":4807},[],{"categories":4809},[173],{"categories":4811},[173],{"categories":4813},[173],{"categories":4815},[209],{"categories":4817},[167],{"categories":4819},[],{"categories":4821},[173],{"categories":4823},[173],{"categories":4825},[187],{"categories":4827},[574],{"categories":4829},[187],{"categories":4831},[250],{"categories":4833},[173],{"categories":4835},[173,127],{"categories":4837},[278,170],{"categories":4839},[173],{"categories":4841},[173],{"categories":4843},[173],{"categories":4845},[],{"categories":4847},[127],{"categories":4849},[],{"categories":4851},[187],{"categories":4853},[173],{"categories":4855},[187],{"categories":4857},[],{"categories":4859},[127],{"categories":4861},[173],{"categories":4863},[209],{"categories":4865},[173],{"categories":4867},[],{"categories":4869},[127],{"categories":4871},[173],{"categories":4873},[],{"categories":4875},[250],{"categories":4877},[173],{"categories":4879},[127],{"categories":4881},[173],{"categories":4883},[173],{"categories":4885},[167],{"categories":4887},[127],{"categories":4889},[173],{"categories":4891},[],{"categories":4893},[313],{"categories":4895},[278],{"categories":4897},[170],{"categories":4899},[170],{"categories":4901},[173],{"categories":4903},[167],{"categories":4905},[167],{"categories":4907},[173],{"categories":4909},[127],{"categories":4911},[173],{"categories":4913},[173],{"categories":4915},[173],{"categories":4917},[187],{"categories":4919},[173],{"categories":4921},[167],{"categories":4923},[127],{"categories":4925},[173],{"categories":4927},[278],{"categories":4929},[173],{"categories":4931},[209],{"categories":4933},[173],{"categories":4935},[173],{"categories":4937},[127],{"categories":4939},[173],{"categories":4941},[],{"categories":4943},[187],{"categories":4945},[],{"categories":4947},[187],{"categories":4949},[127],{"categories":4951},[167],{"categories":4953},[],{"categories":4955},[253],{"categories":4957},[313],{"categories":4959},[173],{"categories":4961},[187],{"categories":4963},[173],{"categories":4965},[],{"categories":4967},[209],{"categories":4969},[127],{"categories":4971},[187],{"categories":4973},[250],{"categories":4975},[173],{"categories":4977},[173],{"categories":4979},[127],{"categories":4981},[187],{"categories":4983},[127],{"categories":4985},[209],{"categories":4987},[173],{"categories":4989},[167],{"categories":4991},[209],{"categories":4993},[187],{"categories":4995},[173],{"categories":4997},[250],{"categories":4999},[170],{"categories":5001},[173],{"categories":5003},[173],{"categories":5005},[173],{"categories":5007},[173],{"categories":5009},[173],{"categories":5011},[127],{"categories":5013},[173],{"categories":5015},[127],{"categories":5017},[173],{"categories":5019},[173],{"categories":5021},[167],{"categories":5023},[173],{"categories":5025},[127],{"categories":5027},[127],{"categories":5029},[250],{"categories":5031},[127],{"categories":5033},[127],{"categories":5035},[167],{"categories":5037},[127],{"categories":5039},[250],{"categories":5041},[],{"categories":5043},[173],{"categories":5045},[253],{"categories":5047},[464],{"categories":5049},[173],{"categories":5051},[173],{"categories":5053},[173],{"categories":5055},[187],{"categories":5057},[173],{"categories":5059},[],{"categories":5061},[127],{"categories":5063},[278],{"categories":5065},[173],{"categories":5067},[209],{"categories":5069},[127],{"categories":5071},[173],{"categories":5073},[278],{"categories":5075},[127],{"categories":5077},[170],{"categories":5079},[170],{"categories":5081},[173],{"categories":5083},[173],{"categories":5085},[173],{"categories":5087},[167],{"categories":5089},[],{"categories":5091},[173],{"categories":5093},[173],{"categories":5095},[127],{"categories":5097},[127],{"categories":5099},[173],{"categories":5101},[173],{"categories":5103},[173],{"categories":5105},[187],{"categories":5107},[],{"categories":5109},[167],{"categories":5111},[173],{"categories":5113},[173],{"categories":5115},[127],{"categories":5117},[127],{"categories":5119},[],{"categories":5121},[187],{"categories":5123},[187],{"categories":5125},[173],{"categories":5127},[278],{"categories":5129},[170],{"categories":5131},[250],{"categories":5133},[],{"categories":5135},[173],{"categories":5137},[127],{"categories":5139},[167],{"categories":5141},[173],{"categories":5143},[187],{"categories":5145},[167],{"categories":5147},[209],{"categories":5149},[253],{"categories":5151},[209],{"categories":5153},[127],{"categories":5155},[],{"categories":5157},[209],{"categories":5159},[127],{"categories":5161},[250],{"categories":5163},[253],{"categories":5165},[173],{"categories":5167},[],{"categories":5169},[127],{"categories":5171},[127],{"categories":5173},[2685],{"categories":5175},[209],{"categories":5177},[187],{"categories":5179},[173],{"categories":5181},[173],{"categories":5183},[173],{"categories":5185},[173],{"categories":5187},[170],{"categories":5189},[173],{"categories":5191},[167],{"categories":5193},[1574],{"categories":5195},[313],{"categories":5197},[167],{"categories":5199},[],{"categories":5201},[],{"categories":5203},[209],{"categories":5205},[127],{"categories":5207},[173],{"categories":5209},[209],{"categories":5211},[],{"categories":5213},[127],{"categories":5215},[127],{"categories":5217},[127],{"categories":5219},[],{"categories":5221},[173],{"categories":5223},[],{"categories":5225},[209],{"categories":5227},[167],{"categories":5229},[250],{"categories":5231},[173],{"categories":5233},[127],{"categories":5235},[209],{"categories":5237},[173],{"categories":5239},[209],{"categories":5241},[],{"categories":5243},[209],{"categories":5245},[167],{"categories":5247},[464],{"categories":5249},[127],{"categories":5251},[173],{"categories":5253},[],{"categories":5255},[187],{"categories":5257},[127],{"categories":5259},[178],{"categories":5261},[127],{"categories":5263},[167],{"categories":5265},[],{"categories":5267},[],{"categories":5269},[],{"categories":5271},[250],{"categories":5273},[127],{"categories":5275},[173],{"categories":5277},[173],{"categories":5279},[],{"categories":5281},[],{"categories":5283},[],{"categories":5285},[250],{"categories":5287},[173],{"categories":5289},[],{"categories":5291},[127],{"categories":5293},[173],{"categories":5295},[167],{"categories":5297},[],{"categories":5299},[],{"categories":5301},[250],{"categories":5303},[173],{"categories":5305},[209],{"categories":5307},[],{"categories":5309},[278],{"categories":5311},[209],{"categories":5313},[278],{"categories":5315},[253],{"categories":5317},[173],{"categories":5319},[173],{"categories":5321},[],{"categories":5323},[],{"categories":5325},[127],{"categories":5327},[],{"categories":5329},[173],{"categories":5331},[464],{"categories":5333},[173],{"categories":5335},[173],{"categories":5337},[173],{"categories":5339},[173],{"categories":5341},[],{"categories":5343},[127],{"categories":5345},[173],{"categories":5347},[173],{"categories":5349},[],{"categories":5351},[127],{"categories":5353},[173],{"categories":5355},[209],{"categories":5357},[173],{"categories":5359},[278],{"categories":5361},[170],{"categories":5363},[173],{"categories":5365},[173],{"categories":5367},[127],{"categories":5369},[253],{"categories":5371},[127],{"categories":5373},[127],{"categories":5375},[],{"categories":5377},[127],{"categories":5379},[],{"categories":5381},[173],{"categories":5383},[],{"categories":5385},[209],{"categories":5387},[170],{"categories":5389},[],{"categories":5391},[173],{"categories":5393},[],{"categories":5395},[250],{"categories":5397},[167],{"categories":5399},[],{"categories":5401},[170],{"categories":5403},[278],{"categories":5405},[173],{"categories":5407},[187],{"categories":5409},[167],{"categories":5411},[253],{"categories":5413},[170],{"categories":5415},[187],{"categories":5417},[127],{"categories":5419},[187],{"categories":5421},[],{"categories":5423},[173],{"categories":5425},[],{"categories":5427},[127],{"categories":5429},[167],{"categories":5431},[250],{"categories":5433},[173],{"categories":5435},[167],{"categories":5437},[127],{"categories":5439},[313],{"categories":5441},[173],{"categories":5443},[173],{"categories":5445},[173],{"categories":5447},[167],{"categories":5449},[253],{"categories":5451},[127],{"categories":5453},[],{"categories":5455},[173],{"categories":5457},[173],{"categories":5459},[187],{"categories":5461},[127],{"categories":5463},[209],{"categories":5465},[187],{"categories":5467},[173],{"categories":5469},[178],{"categories":5471},[],{"categories":5473},[250],{"categories":5475},[209],{"categories":5477},[167],{"categories":5479},[127],{"categories":5481},[173],{"categories":5483},[173],{"categories":5485},[127],{"categories":5487},[178],{"categories":5489},[173],{"categories":5491},[127],{"categories":5493},[173],{"categories":5495},[170],{"categories":5497},[127],{"categories":5499},[127,313],{"categories":5501},[173],{"categories":5503},[173],{"categories":5505},[127],{"categories":5507},[187],{"categories":5509},[173],{"categories":5511},[173],{"categories":5513},[253],{"categories":5515},[127],{"categories":5517},[278],{"categories":5519},[127],{"categories":5521},[170],{"categories":5523},[],{"categories":5525},[127],{"categories":5527},[173],{"categories":5529},[170],{"categories":5531},[],{"categories":5533},[],{"categories":5535},[187],{"categories":5537},[173],{"categories":5539},[173],{"categories":5541},[127],{"categories":5543},[253],{"categories":5545},[278],{"categories":5547},[173],{"categories":5549},[173],{"categories":5551},[127],{"categories":5553},[],{"categories":5555},[127],{"categories":5557},[209],{"categories":5559},[127],{"categories":5561},[],{"categories":5563},[209],{"categories":5565},[187],{"categories":5567},[2685],{"categories":5569},[167],{"categories":5571},[187],{"categories":5573},[173],{"categories":5575},[127],{"categories":5577},[173],{"categories":5579},[173],{"categories":5581},[278],{"categories":5583},[187],{"categories":5585},[],{"categories":5587},[209],{"categories":5589},[173],{"categories":5591},[],{"categories":5593},[127],{"categories":5595},[173],{"categories":5597},[173],{"categories":5599},[173],{"categories":5601},[173],{"categories":5603},[127],{"categories":5605},[173],{"categories":5607},[173],{"categories":5609},[178],{"categories":5611},[173],{"categories":5613},[127],{"categories":5615},[173],{"categories":5617},[173],{"categories":5619},[173],{"categories":5621},[173],{"categories":5623},[173],{"categories":5625},[173],{"categories":5627},[170],{"categories":5629},[],{"categories":5631},[178],{"categories":5633},[209],{"categories":5635},[127],{"categories":5637},[173],{"categories":5639},[187],{"categories":5641},[],{"categories":5643},[187],{"categories":5645},[187],{"categories":5647},[127],{"categories":5649},[187],{"categories":5651},[173],{"categories":5653},[173],{"categories":5655},[173],{"categories":5657},[187],{"categories":5659},[173],{"categories":5661},[173],{"categories":5663},[127],{"categories":5665},[209],{"categories":5667},[173],{"categories":5669},[173],{"categories":5671},[173],{"categories":5673},[170],{"categories":5675},[173],{"categories":5677},[127],{"categories":5679},[250],{"categories":5681},[],{"categories":5683},[173],{"categories":5685},[253],{"categories":5687},[127],{"categories":5689},[173],{"categories":5691},[173],{"categories":5693},[],{"categories":5695},[173],{"categories":5697},[173],{"categories":5699},[209],{"categories":5701},[173],{"categories":5703},[173],{"categories":5705},[127],{"categories":5707},[278],{"categories":5709},[],{"categories":5711},[],{"categories":5713},[187],{"categories":5715},[173],{"categories":5717},[209],{"categories":5719},[187],{"categories":5721},[209],{"categories":5723},[173],{"categories":5725},[278],{"categories":5727},[253],{"categories":5729},[173],{"categories":5731},[167],{"categories":5733},[127],{"categories":5735},[173],{"categories":5737},[127],{"categories":5739},[127],{"categories":5741},[173],{"categories":5743},[170],{"categories":5745},[],{"categories":5747},[253],{"categories":5749},[173],{"categories":5751},[],{"categories":5753},[209],{"categories":5755},[173],{"categories":5757},[253],{"categories":5759},[173],{"categories":5761},[187],{"categories":5763},[187],{"categories":5765},[187],{"categories":5767},[127],{"categories":5769},[127],{"categories":5771},[127],{"categories":5773},[173],{"categories":5775},[173],{"categories":5777},[250],{"categories":5779},[253],{"categories":5781},[253],{"categories":5783},[],{"categories":5785},[209],{"categories":5787},[173],{"categories":5789},[173],{"categories":5791},[187],{"categories":5793},[],{"categories":5795},[209],{"categories":5797},[209],{"categories":5799},[209],{"categories":5801},[],{"categories":5803},[127],{"categories":5805},[173],{"categories":5807},[],{"categories":5809},[167],{"categories":5811},[170],{"categories":5813},[],{"categories":5815},[173],{"categories":5817},[173],{"categories":5819},[],{"categories":5821},[187],{"categories":5823},[],{"categories":5825},[],{"categories":5827},[],{"categories":5829},[],{"categories":5831},[173],{"categories":5833},[209],{"categories":5835},[],{"categories":5837},[],{"categories":5839},[173],{"categories":5841},[173],{"categories":5843},[173],{"categories":5845},[253],{"categories":5847},[173],{"categories":5849},[253],{"categories":5851},[],{"categories":5853},[253],{"categories":5855},[253],{"categories":5857},[313],{"categories":5859},[127],{"categories":5861},[187],{"categories":5863},[],{"categories":5865},[],{"categories":5867},[253],{"categories":5869},[187],{"categories":5871},[187],{"categories":5873},[187],{"categories":5875},[],{"categories":5877},[167],{"categories":5879},[187],{"categories":5881},[187],{"categories":5883},[167],{"categories":5885},[187],{"categories":5887},[170],{"categories":5889},[187],{"categories":5891},[187],{"categories":5893},[187],{"categories":5895},[253],{"categories":5897},[209],{"categories":5899},[209],{"categories":5901},[173],{"categories":5903},[187],{"categories":5905},[253],{"categories":5907},[313],{"categories":5909},[253],{"categories":5911},[253],{"categories":5913},[253],{"categories":5915},[],{"categories":5917},[170],{"categories":5919},[],{"categories":5921},[313],{"categories":5923},[187],{"categories":5925},[187],{"categories":5927},[187],{"categories":5929},[127],{"categories":5931},[209,170],{"categories":5933},[253],{"categories":5935},[],{"categories":5937},[],{"categories":5939},[253],{"categories":5941},[],{"categories":5943},[253],{"categories":5945},[209],{"categories":5947},[127],{"categories":5949},[],{"categories":5951},[187],{"categories":5953},[173],{"categories":5955},[250],{"categories":5957},[],{"categories":5959},[173],{"categories":5961},[],{"categories":5963},[209],{"categories":5965},[167],{"categories":5967},[253],{"categories":5969},[],{"categories":5971},[187],{"categories":5973},[209],[5975,6032,6107,6229],{"id":5976,"title":5977,"ai":5978,"body":5983,"categories":6011,"created_at":128,"date_modified":128,"description":119,"extension":129,"faq":128,"featured":130,"kicker_label":128,"meta":6012,"navigation":143,"path":6018,"published_at":6019,"question":128,"scraped_at":6020,"seo":6021,"sitemap":6022,"source_id":6023,"source_name":6024,"source_type":6025,"source_url":6026,"stem":6027,"tags":6028,"thumbnail_url":128,"tldr":6029,"tweet":128,"unknown_tags":6030,"__hash__":6031},"summaries\u002Fsummaries\u002Feddeb4938620d7e4-mira-murati-returns-thinking-machines-lab-and-ai-g-summary.md","Mira Murati Returns: Thinking Machines Lab and AI Governance",{"provider":7,"model":8,"input_tokens":5979,"output_tokens":5980,"processing_time_ms":5981,"cost_usd":5982},9636,506,2895,0.003168,{"type":14,"value":5984,"toc":6006},[5985,5989,5992,5996,5999,6003],[17,5986,5988],{"id":5987},"the-shift-to-interaction-models","The Shift to 'Interaction Models'",[22,5990,5991],{},"Mira Murati, CEO of Thinking Machines Lab, has emerged from a 18-month stealth period to introduce a new technical paradigm: 'interaction models.' Unlike current AI products that rely on turn-based, prompt-response cycles, these models are designed to process continuous streams of audio, text, and video in 200-millisecond intervals. The goal is to capture the nuances of human communication—such as mid-thought corrections, interruptions, and pauses—to facilitate more natural, real-time collaboration between humans and AI.",[17,5993,5995],{"id":5994},"governance-and-industry-concentration","Governance and Industry Concentration",[22,5997,5998],{},"Reflecting on her tenure at OpenAI, particularly the 2023 leadership crisis, Murati emphasized that technical clarity does not equate to clarity of consequences. She expressed concern over the current industry trend where consequential decisions are concentrated in too few hands. Murati argues that the industry has focused too heavily on individual leadership character rather than structural governance. She advocates for stronger institutional checks to prevent well-intentioned organizations from drifting, noting that even 'good people' can make poor decisions in the absence of proper oversight.",[17,6000,6002],{"id":6001},"building-in-a-competitive-landscape","Building in a Competitive Landscape",[22,6004,6005],{},"Murati addressed the challenges of building a frontier AI lab amidst intense competition for talent and market attention. While acknowledging the volatility of her own organization, she downplayed the impact of high-profile researcher departures. She maintains that her focus remains on the product and the core thesis of human-AI collaboration rather than competitive posturing. Regarding the broader future of AI, she rejected the binary of inevitable utopia or dystopia, suggesting that the current period is the critical window for determining the trajectory of the technology. She warned that human oversight remains essential, stating that 'if humans take their hands off the wheel too soon, the future will look very different, and not better.'",{"title":119,"searchDepth":120,"depth":120,"links":6007},[6008,6009,6010],{"id":5987,"depth":120,"text":5988},{"id":5994,"depth":120,"text":5995},{"id":6001,"depth":120,"text":6002},[173],{"content_references":6013,"triage":6014},[],{"relevance":6015,"novelty":6015,"quality":140,"actionability":120,"composite":6016,"reasoning":6017},3,3.05,"Category: AI & LLMs. The article discusses a new technical paradigm called 'interaction models' which could be relevant for AI product builders, but it lacks specific actionable insights or frameworks that the audience can implement. While it presents some new perspectives on AI governance and collaboration, it does not provide concrete steps for product development.","\u002Fsummaries\u002Feddeb4938620d7e4-mira-murati-returns-thinking-machines-lab-and-ai-g-summary","2026-06-05 05:06:37","2026-06-06 16:12:11",{"title":5977,"description":119},{"loc":6018},"eddeb4938620d7e4","TechCrunch — AI","article","https:\u002F\u002Ftechcrunch.com\u002F2026\u002F06\u002F04\u002Fmira-murati-steps-back-into-the-spotlight-carefully\u002F","summaries\u002Feddeb4938620d7e4-mira-murati-returns-thinking-machines-lab-and-ai-g-summary",[155,157,158],"After 18 months of stealth, former OpenAI CTO Mira Murati is re-entering the public eye to introduce 'interaction models'—AI interfaces designed for real-time, continuous human collaboration.",[158],"tf4IISIK-esDbgUdOoPS8ghlfUWFWLijUdKxd06sdPw",{"id":6033,"title":6034,"ai":6035,"body":6041,"categories":6078,"created_at":128,"date_modified":128,"description":119,"extension":129,"faq":128,"featured":130,"kicker_label":128,"meta":6079,"navigation":143,"path":6094,"published_at":6095,"question":128,"scraped_at":6096,"seo":6097,"sitemap":6098,"source_id":6099,"source_name":6100,"source_type":6025,"source_url":6101,"stem":6102,"tags":6103,"thumbnail_url":128,"tldr":6104,"tweet":128,"unknown_tags":6105,"__hash__":6106},"summaries\u002Fsummaries\u002F8453bf1faf3a27ae-semantic-primitives-trump-computer-use-for-ai-agen-summary.md","Semantic Primitives Trump Computer Use for AI Agents",{"provider":7,"model":6036,"input_tokens":6037,"output_tokens":6038,"processing_time_ms":6039,"cost_usd":6040},"x-ai\u002Fgrok-4.1-fast",8361,1703,22506,0.00250105,{"type":14,"value":6042,"toc":6073},[6043,6047,6050,6053,6057,6060,6063,6067,6070],[17,6044,6046],{"id":6045},"three-layers-define-agent-power-access-meaning-authority","Three Layers Define Agent Power: Access, Meaning, Authority",[22,6048,6049],{},"Agents interact via access (computer use like browsers\u002Fdesktops to click buttons), but this is merely a 'universal adapter' for legacy human-built software—shallow and guess-prone for high-stakes tasks. True power lies in meaning: semantic work primitives that encode task context, like a calendar invite's ripple effects (notifications, conflicts, commitments) beyond 'click save,' or a 'buy' button's implications (fraud, fulfillment, disputes). Authority adds governance: permissions, reversibility, approvals (e.g., read vs. write, draft vs. send, sandbox vs. production). Without meaning, agents guess wrongly on refunds, deletions, or emails; humans intuitively grasp this, but software hides it behind forms. Control these layers to reduce supervision—trusted actions aren't binary but nuanced by semantics.",[22,6051,6052],{},"Practical fix: Follow the hierarchy of richest interfaces—APIs\u002Fconnectors first, then protocols\u002Ftyped objects, fallback to browser\u002Fdesktop. Plug in MCPs, plugins to ChatGPT\u002FClaude\u002FCodex for better results; this exposes structure over screenshots.",[17,6054,6056],{"id":6055},"coding-agents-succeed-first-due-to-rich-semantics","Coding Agents Succeed First Due to Rich Semantics",[22,6058,6059],{},"Coding agents arrived early not just because code is text, but because codebases offer dense semantics: modules, dependencies, tests, linters, git history provide feedback loops (run test, see error, revise). Tests aren't verification—they're meaning artifacts signaling the 'world' (e.g., staging vs. production). This lets agents self-correct without constant human input, unlike knowledge work (strategy docs lack tests; calendars hide politics\u002Frelationships; sales\u002Fprocurement rely on unwritten history). Coding is a 'wedge' for agent-native software: expose primitives like refunds, reschedules, meeting briefs directly, making non-coding work legible.",[22,6061,6062],{},"Outcome: Agent-native systems minimize human coordination; startups should map semantic gaps in MCPs\u002FAPIs to build moats—solve where prompts fail due to missing task understanding, avoiding errors like bad tones, wrong refunds, or inconvenient invites.",[17,6064,6066],{"id":6065},"platform-strategies-reveal-the-moat-fight","Platform Strategies Reveal the Moat Fight",[22,6068,6069],{},"Hyperscalers (Claude\u002FCodex) start from models\u002Fcode semantics, composing tools effectively but struggling with real-world purpose (e.g., calendar conflicts). Non-hyperscalers like Perplexity work backward: from search to browser (tabs assemble cross-app context: email\u002Fdocs\u002FSaaS) to computer\u002Ffiles for workflows (e.g., finance in Personal Computer), building durable 'work graphs' above apps with permissions\u002Fvalidation. Trap: Stay operator (just interfaces) vs. assembler of meaning.",[22,6071,6072],{},"Enterprise signals: Salesforce goes headless (exposes semantics), SAP blocks agents (guards meaning). Leaders err asking 'can it act?'—ask 'does the product know what the action means?' Demos distract; build for primitives where model + harness + legible work = autonomy. Commerce hint: Agentic transactions need semantic layers (discovery\u002Fcheckout\u002Finfra).",{"title":119,"searchDepth":120,"depth":120,"links":6074},[6075,6076,6077],{"id":6045,"depth":120,"text":6046},{"id":6055,"depth":120,"text":6056},{"id":6065,"depth":120,"text":6066},[],{"content_references":6080,"triage":6092},[6081,6086,6090],{"type":6082,"title":6083,"url":6084,"context":6085},"other","AI Work Primitives: Access vs Meaning","https:\u002F\u002Fnatesnewsletter.substack.com\u002Fp\u002Fai-work-primitives-access-vs-meaning?r=1z4sm5&utm_campaign=post&utm_medium=web&showWelcomeOnShare=true","recommended",{"type":6087,"title":6088,"url":6089,"context":137},"podcast","AI News & Strategy Daily with Nate B Jones","https:\u002F\u002Fpodcasts.apple.com\u002Fus\u002Fpodcast\u002Fai-news-strategy-daily-with-nate-b-jones\u002Fid1877109372",{"type":6087,"title":6088,"url":6091,"context":137},"https:\u002F\u002Fopen.spotify.com\u002Fshow\u002F0gkFdjd1wptEKJKLu9LbZ4",{"relevance":139,"novelty":140,"quality":140,"actionability":140,"composite":141,"reasoning":6093},"Category: AI & LLMs. The article provides a deep exploration of how AI agents can leverage semantic meaning to improve task execution, addressing a core pain point for product builders in understanding AI's practical applications. It offers a practical hierarchy for implementing AI agents, which can be directly applied to product development.","\u002Fsummaries\u002F8453bf1faf3a27ae-semantic-primitives-trump-computer-use-for-ai-agen-summary","2026-05-06 14:01:00","2026-05-06 16:08:46",{"title":6034,"description":119},{"loc":6094},"bf2cefe2ac8b0a90","AI News & Strategy Daily | Nate B Jones","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=b1fxYGPbHeo","summaries\u002F8453bf1faf3a27ae-semantic-primitives-trump-computer-use-for-ai-agen-summary",[155,157,158],"AI agents excel at real work by controlling semantic meaning of tasks (e.g., calendar invites, refunds), not just button-clicking access; three layers—access, meaning, authority—define the moat.",[158],"r5-yqqcKIf3MrUmso4xcxql6uv7PzULCE0jjNA35cIc",{"id":6108,"title":6109,"ai":6110,"body":6115,"categories":6202,"created_at":128,"date_modified":128,"description":119,"extension":129,"faq":128,"featured":130,"kicker_label":128,"meta":6203,"navigation":143,"path":6214,"published_at":6215,"question":128,"scraped_at":6216,"seo":6217,"sitemap":6218,"source_id":6219,"source_name":150,"source_type":151,"source_url":6220,"stem":6221,"tags":6222,"thumbnail_url":6224,"tldr":6225,"tweet":6226,"unknown_tags":6227,"__hash__":6228},"summaries\u002Fsummaries\u002F5af7edbff77c8366-building-private-agent-benchmarks-from-production--summary.md","Building Private Agent Benchmarks from Production Traces",{"provider":7,"model":8,"input_tokens":6111,"output_tokens":6112,"processing_time_ms":6113,"cost_usd":6114},7348,672,3122,0.002845,{"type":14,"value":6116,"toc":6197},[6117,6121,6128,6132,6135,6161,6165,6168,6194],[17,6118,6120],{"id":6119},"the-shift-from-traces-to-simulations","The Shift from Traces to Simulations",[22,6122,6123,6124,6127],{},"While production traces are useful for identifying failures, they are inherently non-repeatable due to shifting database states, tool versions, and API responses. To move from simple observation to rigorous engineering, teams must convert these traces into ",[39,6125,6126],{},"offline simulations",". This involves reconstructing the environment—including tools, APIs, and file systems—to create a sandbox where agent configurations can be tested against identical conditions. This allows for \"apples-to-apples\" comparisons of latency, cost, and success rates, rather than relying on generic public benchmarks like WebArena or SWE-bench.",[17,6129,6131],{"id":6130},"anatomy-of-a-private-benchmark","Anatomy of a Private Benchmark",[22,6133,6134],{},"A robust simulation task requires a \"mini-production\" environment that mimics the real world without requiring full production infrastructure. Key components include:",[63,6136,6137,6143,6149,6155],{},[36,6138,6139,6142],{},[39,6140,6141],{},"Environment:"," A containerized setup (Docker\u002FDocker Compose) containing the necessary APIs, databases, and MCP tools.",[36,6144,6145,6148],{},[39,6146,6147],{},"Simulated Users:"," Using an LLM with specific prompts to mimic human interaction, ensuring the agent operates in a realistic context.",[36,6150,6151,6154],{},[39,6152,6153],{},"Oracles:"," A pre-defined solution path used to verify that a task is actually solvable before testing the agent.",[36,6156,6157,6160],{},[39,6158,6159],{},"Verifiers:"," A multi-layered approach to evaluation. This includes deterministic checks for final outputs, LLM-as-a-judge for planning quality, and human subject matter experts to resolve discrepancies in complex edge cases.",[17,6162,6164],{"id":6163},"integrating-benchmarks-into-the-agent-ops-loop","Integrating Benchmarks into the Agent Ops Loop",[22,6166,6167],{},"Benchmarks should not be static; they must be treated as software and integrated into a CI\u002FCD pipeline. This creates a continuous feedback loop:",[33,6169,6170,6176,6182,6188],{},[36,6171,6172,6175],{},[39,6173,6174],{},"Observability:"," Capture production failures using tools like Arise.",[36,6177,6178,6181],{},[39,6179,6180],{},"Expansion:"," Convert these failures into new benchmark tasks.",[36,6183,6184,6187],{},[39,6185,6186],{},"Experimentation:"," Run the agent against the updated benchmark to test fixes.",[36,6189,6190,6193],{},[39,6191,6192],{},"Release Gate:"," Use the benchmark as a gatekeeper to prevent regressions before deploying new agent configurations.",[22,6195,6196],{},"This approach avoids the common anti-pattern of \"prompt hacking,\" where developers try to fix systemic issues by adding endless constraints to the system prompt. Instead, it allows engineers to identify whether a failure requires a change to the prompt, the tool harness, the skill set, or the structured output schema.",{"title":119,"searchDepth":120,"depth":120,"links":6198},[6199,6200,6201],{"id":6119,"depth":120,"text":6120},{"id":6130,"depth":120,"text":6131},{"id":6163,"depth":120,"text":6164},[127],{"content_references":6204,"triage":6212},[6205,6207,6209,6211],{"type":134,"title":6206,"context":137},"WebArena",{"type":134,"title":6208,"context":137},"SWE-bench",{"type":134,"title":6210,"context":137},"Terminal Bench",{"type":134,"title":135,"url":136,"context":137},{"relevance":139,"novelty":140,"quality":140,"actionability":140,"composite":141,"reasoning":6213},"Category: AI Automation. The article provides a detailed approach to building private benchmarks for AI agents, addressing the audience's need for practical applications in AI engineering. It outlines specific steps for creating simulations and integrating benchmarks into CI\u002FCD pipelines, which are actionable for developers and product builders.","\u002Fsummaries\u002F5af7edbff77c8366-building-private-agent-benchmarks-from-production-summary","2026-07-25 01:00:02","2026-07-25 03:12:33",{"title":6109,"description":119},{"loc":6214},"5af7edbff77c8366","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=Ib5t2RLtxvM","summaries\u002F5af7edbff77c8366-building-private-agent-benchmarks-from-production--summary",[155,156,157,6223],"software-engineering","https:\u002F\u002Fi.ytimg.com\u002Fvi\u002FIb5t2RLtxvM\u002Fhqdefault.jpg","To reliably ship AI agents, companies must move beyond public benchmarks and build private, simulation-based CI pipelines that replay production traces in controlled, repeatable environments.","This talk argues that public benchmarks are insufficient for production agents, advocating instead for building private, domain-specific benchmarks by replaying production traces in isolated, containerized environments. The speaker outlines a workflow for creating these \"simulations\" to gate releases, track regressions, and optimize for cost and latency.",[6223],"7j8dHxBIXGaCotdzewfJj7xYsbeyz_Ejzy0uKaGR_yc",{"id":6230,"title":6231,"ai":6232,"body":6237,"categories":6293,"created_at":128,"date_modified":128,"description":119,"extension":129,"faq":128,"featured":130,"kicker_label":128,"meta":6294,"navigation":143,"path":6301,"published_at":6302,"question":128,"scraped_at":6303,"seo":6304,"sitemap":6305,"source_id":6306,"source_name":150,"source_type":151,"source_url":6307,"stem":6308,"tags":6309,"thumbnail_url":6311,"tldr":6312,"tweet":6313,"unknown_tags":6314,"__hash__":6315},"summaries\u002Fsummaries\u002F3286147928f7524b-evaluating-ai-video-moving-from-absolute-scores-to-summary.md","Evaluating AI Video: Moving from Absolute Scores to Pairwise Comparison",{"provider":7,"model":8,"input_tokens":6233,"output_tokens":6234,"processing_time_ms":6235,"cost_usd":6236},8196,684,3806,0.003075,{"type":14,"value":6238,"toc":6287},[6239,6243,6246,6250,6253,6257,6260,6280,6284],[17,6240,6242],{"id":6241},"the-failure-of-absolute-scoring","The Failure of Absolute Scoring",[22,6244,6245],{},"Traditional metrics like CLIP score or LPIPS are insufficient for video because they evaluate individual frames or pixel-level drift rather than the holistic storytelling quality. Maor Bril notes that absolute scoring (e.g., 1-10 scales) is inherently subjective and prone to \"vibe-based\" bias, where a model might reward a visually glossy but temporally broken video (e.g., a character frozen for four seconds) with a high score. These metrics fail to capture temporal consistency, physics, pacing, and narrative coherence.",[17,6247,6249],{"id":6248},"pairwise-preference-as-a-solution","Pairwise Preference as a Solution",[22,6251,6252],{},"To move beyond the limitations of absolute scoring, the team at Character.ai shifted to a pairwise preference approach. Humans are significantly more consistent when asked to choose which of two videos tells a better story than when asked to assign an arbitrary score to one. By training a small Vision Language Model (VLM)—specifically Qwen3-VL—using Bradley-Terry loss on pairs of real and deliberately corrupted footage, they created a judge capable of identifying specific failure modes like extra limbs, hovering physics, and audio-visual desync.",[17,6254,6256],{"id":6255},"integrating-evals-into-the-generation-loop","Integrating Evals into the Generation Loop",[22,6258,6259],{},"To maintain quality at scale, evaluation must be moved \"left\" in the development pipeline. The team treats video generation as an agentic workflow where the judge acts as a regression gate in CI. This allows the system to:",[63,6261,6262,6268,6274],{},[36,6263,6264,6267],{},[39,6265,6266],{},"Catch drift early:"," By validating starting frames and short clips before they are combined into long-form content, the system reduces the cost of regeneration.",[36,6269,6270,6273],{},[39,6271,6272],{},"Self-verify:"," The agent can identify why a clip is \"slop\" (e.g., physics violation) and trigger a regeneration.",[36,6275,6276,6279],{},[39,6277,6278],{},"Optimize for speed:"," A smaller VLM was chosen over larger frontier models because the latency benefits for high-volume generation outweighed the marginal gains in accuracy from larger models.",[17,6281,6283],{"id":6282},"calibrating-against-human-taste","Calibrating Against Human Taste",[22,6285,6286],{},"To prevent the model from becoming a simple \"AI detector\" (which would overfit to artifacts rather than quality), the team uses consistent encoding and annotation methods across both human-generated and AI-generated training pairs. Human feedback is collected periodically through 10-15 minute annotation sessions, which are then used to calibrate the AI judge and refine the dataset for future iterations. This creates a feedback loop that evolves alongside user expectations.",{"title":119,"searchDepth":120,"depth":120,"links":6288},[6289,6290,6291,6292],{"id":6241,"depth":120,"text":6242},{"id":6248,"depth":120,"text":6249},{"id":6255,"depth":120,"text":6256},{"id":6282,"depth":120,"text":6283},[127],{"content_references":6295,"triage":6299},[6296],{"type":134,"title":6297,"url":6298,"context":6085},"JudgeJudy","https:\u002F\u002Fgithub.com\u002Fcharacter-ai\u002Fjudgejudy",{"relevance":139,"novelty":140,"quality":140,"actionability":140,"composite":141,"reasoning":6300},"Category: AI & LLMs. The article discusses a novel approach to evaluating AI-generated video content, addressing a specific pain point in AI video quality assessment. It provides actionable insights on integrating a pairwise preference model into the video generation workflow, which can directly benefit developers working on AI-powered video products.","\u002Fsummaries\u002F3286147928f7524b-evaluating-ai-video-moving-from-absolute-scores-to-summary","2026-07-25 00:00:02","2026-07-25 03:12:39",{"title":6231,"description":119},{"loc":6301},"3286147928f7524b","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=b_PmGocP4rc","summaries\u002F3286147928f7524b-evaluating-ai-video-moving-from-absolute-scores-to-summary",[155,6310,156,158],"machine-learning","https:\u002F\u002Fi.ytimg.com\u002Fvi\u002Fb_PmGocP4rc\u002Fhqdefault.jpg","To solve for temporal incoherence and 'vibe-based' evaluation failures in AI video, Character.ai replaced absolute scoring with a pairwise preference model trained on a small VLM, enabling automated quality gates in the generation loop.","This talk explains why traditional metrics like CLIP scores fail to evaluate AI-generated video, as they prioritize visual \"vibe\" over temporal consistency and narrative logic. The speaker details a shift toward using pairwise preference models—specifically a [Qwen3-VL](https:\u002F\u002Fgithub.com\u002Fcharacter-ai\u002Fjudgejudy) fine-tuned with Bradley-Terry loss—to act as a regression gate in CI, catching quality issues before they reach the end user.",[158],"1eCnfRPRi9RHAFZ41axFdIOYI83ixT18muUb5ui_GUQ"]