[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"summary-9401369bcaf57778-beyond-leaderboards-evaluating-real-world-ai-syste-summary":3,"summaries-facets-categories":183,"summary-related-9401369bcaf57778-beyond-leaderboards-evaluating-real-world-ai-syste-summary":7031},{"id":4,"title":5,"ai":6,"body":13,"categories":144,"created_at":146,"date_modified":146,"description":138,"extension":147,"faq":146,"featured":148,"kicker_label":146,"meta":149,"navigation":162,"path":163,"published_at":164,"question":146,"scraped_at":165,"seo":166,"sitemap":167,"source_id":168,"source_name":169,"source_type":170,"source_url":171,"stem":172,"tags":173,"thumbnail_url":178,"tldr":179,"tweet":180,"unknown_tags":181,"__hash__":182},"summaries\u002Fsummaries\u002F9401369bcaf57778-beyond-leaderboards-evaluating-real-world-ai-syste-summary.md","Beyond Leaderboards: Evaluating Real-World AI Systems",{"provider":7,"model":8,"input_tokens":9,"output_tokens":10,"processing_time_ms":11,"cost_usd":12},"openrouter","google\u002Fgemini-3.1-flash-lite",7008,709,3866,0.0028155,{"type":14,"value":15,"toc":137},"minimark",[16,21,38,42,45,87,91,94,101,134],[17,18,20],"h2",{"id":19},"the-optimization-triangle","The Optimization Triangle",[22,23,24,25,29,30,33,34,37],"p",{},"Building production-ready AI requires balancing three competing factors: ",[26,27,28],"strong",{},"accuracy",", ",[26,31,32],{},"performance (latency)",", and ",[26,35,36],{},"cost",". You can typically optimize for two, but the third will inevitably suffer. Leaderboard scores are insufficient because they measure isolated model performance, whereas production environments test the entire system under specific, often unpredictable, traffic patterns.",[17,39,41],{"id":40},"model-vs-system-evaluation","Model vs. System Evaluation",[22,43,44],{},"Effective evaluation requires a two-pronged approach:",[46,47,48,59],"ul",{},[49,50,51,54,55,58],"li",{},[26,52,53],{},"Model Evaluation:"," Measures reasoning and accuracy. Standardized benchmarks (e.g., MMLU) work for general knowledge, while execution-based benchmarks (e.g., SWE-bench) test coding capabilities by running actual tests. For open-ended tasks without a single \"correct\" answer, use ",[26,56,57],{},"LLM-as-a-judge"," patterns. This involves using a powerful model to critique outputs against a rubric, scaled by human-in-the-loop annotations to ensure the judge aligns with domain-expert standards.",[49,60,61,64,65,29,68,29,71,33,74,77,78,82,83,86],{},[26,62,63],{},"System Evaluation:"," Measures infrastructure performance. Key metrics include ",[26,66,67],{},"Time to First Token (TTFT)",[26,69,70],{},"inter-token latency",[26,72,73],{},"request latency",[26,75,76],{},"throughput",". Inference performance is split into two phases: ",[79,80,81],"em",{},"pre-fill"," (compute-heavy, processes the prompt) and ",[79,84,85],{},"decode"," (memory-heavy, generates tokens). Because these phases have different bottlenecks, you must benchmark using token distributions that mirror your actual application (e.g., chat vs. RAG vs. coding agents).",[17,88,90],{"id":89},"evaluating-agentic-workflows","Evaluating Agentic Workflows",[22,92,93],{},"Agents introduce complexity because they are chains of decisions rather than single model calls. Each step—intent recognition, tool selection, retrieval, and code execution—is a potential failure point.",[22,95,96,97,100],{},"To evaluate agents, use a ",[26,98,99],{},"layered pyramid approach",":",[102,103,104,110,116,122,128],"ol",{},[49,105,106,109],{},[26,107,108],{},"Base System:"," Can the infrastructure scale?",[49,111,112,115],{},[26,113,114],{},"Formatting:"," Is the output structured correctly for downstream consumption?",[49,117,118,121],{},[26,119,120],{},"Safety & Bias:"," Are guardrails preventing PII leaks or harmful content?",[49,123,124,127],{},[26,125,126],{},"Factual Accuracy:"," Is the model grounded in real-world data?",[49,129,130,133],{},[26,131,132],{},"Domain-Specific Logic:"," Does the agent solve the specific business problem?",[22,135,136],{},"Teams often fail by starting at the top of the pyramid. Instead, establish Service Level Objectives (SLOs) for your specific traffic patterns and identify the \"inflection point\" in your latency-throughput curve to determine your system's true capacity before it hits production.",{"title":138,"searchDepth":139,"depth":139,"links":140},"",2,[141,142,143],{"id":19,"depth":139,"text":20},{"id":40,"depth":139,"text":41},{"id":89,"depth":139,"text":90},[145],"AI & LLMs",null,"md",false,{"content_references":150,"triage":157},[151,155],{"type":152,"title":153,"context":154},"other","MMLU (Massive Multi-Task Language Understanding)","mentioned",{"type":152,"title":156,"context":154},"SWE-bench",{"relevance":158,"novelty":159,"quality":159,"actionability":159,"composite":160,"reasoning":161},5,4,4.35,"Category: AI & LLMs. The article provides a comprehensive framework for evaluating AI systems in production, addressing key pain points such as balancing accuracy, latency, and cost, which are crucial for product builders. It introduces actionable evaluation methods like the layered pyramid approach for agents, making it highly relevant and practical.",true,"\u002Fsummaries\u002F9401369bcaf57778-beyond-leaderboards-evaluating-real-world-ai-syste-summary","2026-08-27 11:00:22","2026-08-28 03:12:10",{"title":5,"description":138},{"loc":163},"9401369bcaf57778","IBM Technology","video","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=nVImVgKpoOY","summaries\u002F9401369bcaf57778-beyond-leaderboards-evaluating-real-world-ai-syste-summary",[174,175,176,177],"llm","ai-tools","agents","machine-learning","https:\u002F\u002Fi.ytimg.com\u002Fvi\u002FnVImVgKpoOY\u002Fhqdefault.jpg","Model benchmarks are just a starting point; production reliability requires balancing accuracy, latency, and cost through system-level evaluations and agentic chain testing.","This is a high-level conceptual overview of why public leaderboard scores often fail to predict production performance. The video categorizes evaluation into two buckets—model accuracy (using benchmarks like MMLU or LLM-as-a-judge) and system performance (latency and throughput)—and explains why you must tailor your testing to your specific workload's token distribution.",[],"2IoMXAUSJMhBMLsmATUJrAUP0XdUS-TMgs_zbRMi8VA",[184,186,189,191,194,196,199,202,204,206,208,210,213,215,217,219,221,224,226,228,230,232,235,238,240,242,244,246,248,250,252,254,256,258,260,262,264,266,268,270,272,274,276,278,280,282,284,287,289,291,293,295,297,299,301,303,305,307,309,311,313,316,318,320,322,324,326,328,330,332,334,336,338,340,342,344,346,348,350,352,354,357,359,361,363,365,367,369,371,373,375,377,379,381,383,386,388,390,392,394,396,398,400,402,404,406,408,410,412,414,416,418,420,422,424,426,428,430,432,434,436,438,440,442,444,446,449,451,453,455,457,459,461,463,465,467,469,472,474,476,478,480,482,484,486,488,490,492,494,496,498,500,502,505,507,509,511,513,515,517,519,521,523,525,528,530,532,534,536,538,540,542,544,546,548,550,552,554,556,558,560,562,564,566,568,570,572,574,576,578,580,582,585,587,589,592,594,596,598,600,602,604,606,608,610,612,614,616,618,620,622,624,626,628,631,633,635,637,639,641,643,645,647,649,651,653,656,658,660,662,664,666,668,670,672,674,676,678,680,682,684,686,688,690,692,694,696,698,700,702,704,706,708,710,712,714,716,718,720,722,724,726,728,730,732,734,736,738,740,742,744,746,748,750,752,754,756,758,760,762,764,766,768,770,772,774,776,778,780,782,784,786,788,790,792,794,796,798,800,802,804,806,808,810,812,814,816,818,820,822,824,826,828,830,832,834,836,838,840,842,844,846,848,850,852,854,856,858,860,862,864,866,868,870,872,874,876,878,880,882,884,886,888,890,892,894,896,898,900,902,904,906,908,910,912,914,916,918,920,922,924,926,928,930,932,934,936,938,940,943,945,947,949,951,954,956,958,960,962,964,966,968,970,972,974,976,978,981,983,985,987,989,991,993,995,997,999,1001,1003,1005,1007,1009,1011,1013,1015,1017,1019,1021,1023,1025,1027,1029,1031,1033,1035,1037,1039,1041,1043,1045,1047,1049,1051,1053,1055,1057,1059,1061,1063,1065,1067,1069,1071,1073,1075,1077,1079,1081,1083,1085,1087,1089,1091,1093,1095,1097,1099,1101,1103,1105,1107,1109,1111,1113,1115,1117,1119,1121,1123,1125,1127,1129,1131,1133,1135,1137,1139,1141,1143,1145,1147,1149,1151,1153,1155,1157,1159,1161,1163,1165,1167,1169,1171,1173,1175,1177,1179,1181,1183,1185,1187,1189,1191,1193,1195,1197,1199,1201,1203,1205,1207,1209,1211,1213,1215,1217,1219,1221,1223,1225,1227,1229,1231,1233,1235,1237,1239,1241,1243,1245,1247,1249,1251,1253,1255,1257,1259,1261,1263,1265,1267,1269,1271,1273,1275,1277,1279,1281,1283,1285,1287,1289,1291,1293,1295,1297,1299,1302,1304,1306,1308,1310,1312,1314,1316,1318,1320,1322,1324,1326,1328,1330,1332,1334,1336,1338,1340,1342,1344,1346,1348,1350,1352,1354,1356,1358,1360,1362,1364,1366,1368,1370,1372,1374,1376,1378,1380,1382,1384,1386,1388,1390,1392,1394,1396,1398,1400,1402,1404,1406,1408,1410,1412,1414,1416,1418,1420,1422,1424,1426,1428,1430,1432,1434,1436,1438,1440,1442,1444,1446,1448,1450,1452,1454,1456,1458,1460,1462,1464,1466,1468,1470,1472,1474,1476,1478,1480,1482,1484,1486,1488,1490,1492,1494,1496,1498,1501,1503,1505,1507,1509,1511,1513,1515,1517,1519,1521,1523,1525,1527,1529,1531,1533,1535,1537,1539,1541,1543,1545,1547,1549,1551,1553,1555,1557,1559,1561,1563,1565,1567,1569,1571,1573,1575,1577,1579,1581,1583,1585,1587,1589,1591,1593,1595,1597,1599,1601,1603,1605,1607,1609,1611,1613,1615,1617,1619,1621,1623,1625,1627,1629,1631,1633,1635,1637,1640,1642,1644,1646,1648,1650,1652,1654,1656,1658,1660,1662,1664,1666,1668,1670,1672,1674,1676,1678,1680,1682,1684,1686,1688,1690,1692,1694,1696,1698,1700,1702,1704,1706,1708,1710,1712,1714,1716,1718,1720,1722,1724,1726,1728,1730,1732,1734,1736,1738,1740,1742,1744,1746,1748,1750,1752,1754,1756,1758,1760,1762,1764,1766,1768,1770,1772,1774,1776,1778,1780,1782,1784,1786,1788,1790,1792,1794,1796,1799,1801,1803,1805,1807,1809,1811,1813,1815,1817,1819,1821,1823,1825,1827,1829,1831,1833,1835,1837,1839,1841,1843,1845,1847,1849,1851,1853,1855,1857,1859,1862,1864,1866,1868,1870,1872,1874,1876,1878,1880,1882,1884,1886,1888,1890,1892,1894,1896,1898,1900,1902,1904,1906,1908,1910,1912,1914,1916,1918,1920,1922,1924,1926,1928,1930,1932,1934,1936,1938,1940,1942,1944,1946,1948,1950,1952,1954,1956,1958,1960,1962,1964,1966,1968,1970,1972,1974,1976,1978,1980,1982,1984,1986,1988,1990,1992,1994,1996,1998,2000,2002,2004,2006,2008,2010,2012,2014,2016,2018,2020,2022,2024,2026,2028,2030,2032,2034,2036,2038,2040,2042,2044,2046,2048,2050,2052,2054,2056,2058,2060,2062,2064,2066,2068,2070,2072,2074,2076,2078,2080,2082,2084,2086,2088,2090,2092,2094,2096,2098,2100,2102,2104,2106,2108,2110,2112,2114,2116,2118,2120,2122,2124,2126,2128,2130,2132,2134,2136,2138,2140,2142,2144,2146,2148,2150,2152,2154,2156,2158,2160,2162,2164,2166,2168,2170,2172,2174,2176,2178,2180,2182,2184,2186,2188,2190,2192,2194,2196,2198,2200,2202,2204,2206,2208,2210,2212,2214,2216,2218,2220,2222,2224,2226,2228,2230,2232,2234,2236,2238,2240,2242,2244,2246,2248,2250,2252,2254,2256,2258,2260,2262,2264,2266,2268,2270,2272,2274,2276,2278,2280,2282,2284,2286,2288,2290,2292,2295,2297,2299,2301,2303,2305,2307,2309,2311,2313,2315,2317,2319,2321,2323,2325,2327,2329,2331,2333,2335,2337,2339,2341,2343,2345,2347,2349,2351,2353,2355,2357,2359,2361,2363,2365,2367,2369,2371,2373,2375,2377,2379,2381,2384,2386,2388,2390,2392,2394,2396,2398,2400,2402,2404,2406,2408,2410,2412,2414,2416,2418,2420,2422,2424,2426,2428,2430,2432,2434,2436,2438,2440,2442,2444,2446,2448,2450,2452,2454,2456,2458,2460,2462,2464,2466,2468,2470,2472,2474,2476,2478,2480,2482,2484,2486,2488,2490,2492,2494,2496,2498,2500,2503,2505,2507,2509,2511,2513,2515,2517,2519,2521,2523,2525,2527,2529,2531,2533,2535,2537,2539,2541,2543,2546,2548,2550,2552,2554,2556,2558,2560,2562,2564,2566,2568,2570,2572,2574,2576,2578,2580,2582,2584,2586,2588,2590,2592,2594,2596,2598,2600,2602,2604,2606,2608,2610,2612,2614,2616,2618,2620,2622,2624,2626,2628,2630,2632,2634,2636,2638,2640,2642,2644,2646,2648,2650,2652,2654,2656,2658,2660,2662,2664,2666,2668,2670,2672,2674,2676,2678,2680,2682,2684,2686,2688,2690,2692,2694,2696,2698,2700,2702,2704,2706,2708,2710,2712,2714,2716,2718,2720,2722,2724,2726,2728,2730,2732,2734,2736,2738,2740,2742,2744,2746,2748,2750,2752,2754,2756,2758,2760,2762,2764,2766,2768,2770,2772,2774,2776,2778,2780,2782,2784,2786,2788,2790,2792,2794,2796,2798,2800,2802,2804,2806,2808,2810,2812,2814,2816,2818,2820,2822,2824,2826,2828,2830,2832,2834,2836,2838,2840,2842,2844,2846,2848,2850,2852,2854,2856,2858,2860,2862,2864,2866,2868,2870,2872,2874,2876,2878,2880,2882,2884,2886,2888,2890,2892,2894,2896,2898,2900,2902,2904,2906,2908,2910,2912,2914,2916,2918,2920,2922,2924,2926,2928,2930,2932,2934,2936,2938,2940,2942,2944,2946,2948,2950,2952,2954,2956,2958,2960,2962,2964,2966,2968,2970,2972,2974,2976,2978,2980,2982,2984,2986,2988,2990,2992,2994,2996,2998,3000,3002,3004,3006,3008,3010,3012,3014,3016,3018,3020,3022,3024,3026,3028,3030,3032,3034,3036,3038,3040,3042,3044,3046,3048,3050,3052,3054,3056,3058,3060,3062,3064,3066,3068,3070,3072,3074,3076,3078,3080,3082,3084,3086,3088,3090,3092,3094,3096,3098,3100,3102,3104,3106,3108,3110,3112,3114,3116,3118,3120,3122,3124,3126,3128,3130,3132,3134,3136,3138,3140,3142,3144,3146,3148,3150,3152,3154,3156,3158,3160,3162,3164,3166,3168,3170,3172,3174,3176,3178,3180,3182,3184,3187,3189,3191,3193,3195,3197,3199,3201,3203,3205,3207,3209,3211,3213,3215,3217,3219,3221,3223,3225,3227,3229,3231,3233,3235,3237,3239,3241,3243,3245,3247,3249,3251,3253,3255,3257,3259,3261,3263,3265,3267,3269,3271,3273,3275,3277,3279,3281,3283,3285,3287,3289,3291,3293,3295,3297,3299,3301,3303,3305,3307,3310,3312,3314,3316,3318,3320,3322,3324,3326,3328,3330,3332,3334,3336,3338,3340,3342,3344,3346,3348,3350,3352,3354,3356,3358,3360,3362,3364,3366,3368,3370,3372,3374,3376,3378,3380,3382,3384,3386,3388,3390,3392,3394,3396,3398,3400,3402,3404,3406,3408,3410,3412,3414,3416,3418,3420,3422,3424,3426,3428,3430,3432,3434,3436,3438,3440,3442,3444,3446,3448,3450,3452,3454,3456,3458,3460,3462,3464,3466,3468,3470,3472,3474,3476,3478,3480,3482,3484,3486,3488,3490,3492,3494,3496,3498,3500,3502,3504,3506,3508,3510,3512,3514,3516,3518,3520,3522,3524,3526,3528,3530,3532,3534,3536,3538,3540,3542,3544,3546,3548,3550,3552,3554,3556,3558,3560,3562,3564,3566,3568,3570,3572,3574,3576,3578,3580,3582,3584,3586,3588,3590,3592,3594,3596,3598,3600,3602,3604,3606,3608,3610,3612,3614,3616,3618,3620,3622,3624,3626,3628,3630,3632,3634,3636,3638,3640,3642,3644,3646,3648,3650,3652,3654,3656,3658,3660,3662,3664,3666,3668,3670,3672,3674,3676,3678,3680,3682,3684,3686,3688,3690,3692,3694,3696,3698,3700,3702,3704,3706,3708,3710,3712,3714,3716,3718,3720,3722,3724,3726,3728,3730,3732,3734,3736,3738,3740,3742,3744,3746,3748,3750,3752,3754,3756,3758,3760,3762,3764,3766,3768,3770,3772,3774,3776,3778,3780,3782,3784,3786,3788,3790,3792,3794,3796,3798,3800,3802,3804,3806,3808,3810,3812,3814,3816,3818,3820,3822,3824,3826,3828,3830,3832,3834,3836,3838,3840,3842,3844,3846,3848,3850,3852,3854,3856,3858,3860,3862,3864,3866,3868,3870,3872,3874,3876,3878,3880,3882,3884,3886,3888,3890,3892,3894,3896,3898,3900,3902,3904,3906,3908,3910,3912,3914,3916,3918,3920,3922,3924,3926,3928,3930,3932,3934,3936,3938,3940,3942,3944,3946,3948,3950,3952,3954,3956,3958,3960,3962,3964,3966,3968,3970,3972,3974,3976,3978,3980,3982,3984,3986,3988,3990,3992,3994,3996,3998,4000,4002,4004,4006,4008,4010,4012,4014,4016,4018,4020,4022,4024,4026,4028,4030,4032,4034,4036,4038,4040,4042,4044,4046,4048,4050,4052,4054,4056,4058,4060,4062,4064,4066,4068,4070,4072,4074,4076,4078,4080,4082,4084,4086,4088,4090,4092,4094,4096,4098,4100,4102,4104,4106,4108,4110,4112,4114,4116,4118,4120,4122,4124,4126,4128,4130,4132,4134,4136,4138,4140,4142,4144,4146,4148,4150,4152,4154,4156,4158,4160,4162,4164,4166,4168,4170,4172,4174,4176,4178,4180,4182,4184,4186,4188,4190,4192,4194,4196,4198,4200,4202,4204,4206,4208,4210,4212,4214,4216,4218,4220,4222,4224,4226,4228,4230,4232,4234,4236,4238,4240,4242,4244,4246,4248,4250,4252,4254,4256,4258,4260,4262,4264,4266,4268,4270,4272,4274,4276,4278,4280,4282,4284,4286,4288,4290,4292,4294,4296,4298,4300,4302,4304,4306,4308,4310,4312,4314,4316,4318,4320,4322,4324,4326,4328,4330,4332,4334,4336,4338,4340,4342,4344,4346,4348,4350,4352,4354,4356,4358,4360,4362,4364,4366,4368,4370,4372,4374,4376,4378,4380,4382,4384,4386,4388,4390,4392,4394,4396,4398,4400,4402,4404,4406,4408,4410,4412,4414,4416,4418,4420,4422,4424,4426,4428,4430,4432,4434,4436,4438,4440,4442,4444,4446,4448,4450,4452,4454,4456,4458,4460,4462,4464,4466,4468,4470,4472,4474,4476,4478,4480,4482,4484,4486,4488,4490,4492,4494,4496,4498,4500,4502,4504,4506,4508,4510,4512,4514,4516,4518,4520,4522,4524,4526,4528,4530,4532,4534,4536,4538,4540,4542,4544,4546,4548,4550,4552,4554,4556,4558,4560,4562,4564,4566,4568,4570,4572,4574,4576,4578,4581,4583,4585,4587,4589,4591,4593,4595,4597,4599,4601,4603,4605,4607,4609,4611,4613,4615,4617,4619,4621,4623,4625,4627,4629,4631,4633,4635,4637,4639,4641,4643,4645,4647,4649,4651,4653,4655,4657,4659,4661,4663,4665,4667,4669,4671,4673,4675,4677,4679,4681,4683,4685,4687,4689,4691,4693,4695,4697,4699,4701,4703,4705,4707,4709,4711,4713,4715,4717,4719,4721,4723,4725,4727,4729,4731,4733,4735,4737,4739,4741,4743,4745,4747,4749,4751,4753,4755,4757,4759,4761,4763,4765,4767,4769,4771,4773,4775,4777,4779,4781,4783,4785,4787,4789,4791,4793,4795,4797,4799,4801,4803,4805,4807,4809,4811,4813,4815,4817,4819,4821,4823,4825,4827,4829,4831,4833,4835,4837,4839,4841,4843,4845,4847,4849,4851,4853,4855,4857,4859,4861,4863,4865,4867,4869,4871,4873,4875,4877,4879,4881,4883,4885,4887,4889,4891,4893,4895,4897,4899,4901,4903,4905,4907,4909,4911,4913,4915,4917,4919,4921,4923,4925,4927,4929,4931,4933,4935,4937,4939,4941,4943,4945,4947,4949,4951,4953,4955,4957,4959,4961,4963,4965,4967,4969,4971,4973,4975,4977,4979,4981,4983,4985,4987,4989,4991,4993,4995,4997,4999,5001,5003,5005,5007,5009,5011,5013,5015,5017,5019,5021,5023,5025,5027,5029,5031,5033,5035,5037,5039,5041,5043,5045,5047,5049,5051,5053,5055,5057,5059,5061,5063,5065,5067,5069,5071,5073,5075,5077,5079,5081,5083,5085,5087,5089,5091,5093,5095,5097,5099,5101,5103,5105,5107,5109,5111,5113,5115,5117,5119,5121,5123,5125,5127,5129,5131,5133,5135,5137,5139,5141,5143,5145,5147,5149,5151,5153,5155,5157,5159,5161,5163,5165,5167,5169,5171,5173,5175,5177,5179,5181,5183,5185,5187,5189,5191,5193,5195,5197,5199,5201,5203,5205,5207,5209,5211,5213,5215,5217,5219,5221,5223,5225,5227,5229,5231,5233,5235,5237,5239,5241,5243,5245,5247,5249,5251,5253,5255,5257,5259,5261,5263,5265,5267,5269,5271,5273,5275,5277,5279,5281,5283,5285,5287,5289,5291,5293,5295,5297,5299,5301,5303,5305,5307,5309,5311,5313,5315,5317,5319,5321,5323,5325,5327,5329,5331,5333,5335,5337,5339,5341,5343,5345,5347,5349,5351,5353,5355,5357,5359,5361,5363,5365,5367,5369,5371,5373,5375,5377,5379,5381,5383,5385,5387,5389,5391,5393,5395,5397,5399,5401,5403,5405,5407,5409,5411,5413,5415,5417,5419,5421,5423,5425,5427,5429,5431,5433,5435,5438,5440,5442,5444,5446,5448,5450,5452,5454,5456,5458,5460,5462,5464,5466,5468,5470,5472,5474,5476,5478,5480,5482,5484,5486,5488,5490,5492,5494,5496,5498,5500,5502,5504,5506,5508,5510,5512,5514,5516,5518,5520,5522,5524,5526,5528,5530,5532,5534,5536,5538,5540,5542,5544,5546,5548,5550,5552,5554,5556,5558,5560,5562,5564,5566,5568,5570,5572,5574,5576,5578,5580,5582,5584,5586,5588,5590,5592,5594,5596,5598,5600,5602,5604,5606,5608,5610,5612,5614,5616,5618,5620,5622,5624,5626,5628,5630,5632,5634,5636,5639,5641,5643,5645,5647,5649,5651,5653,5655,5657,5659,5661,5663,5665,5667,5669,5671,5673,5675,5677,5679,5681,5683,5685,5687,5689,5691,5693,5695,5697,5699,5701,5703,5705,5707,5709,5711,5713,5715,5717,5719,5721,5723,5725,5727,5729,5731,5733,5735,5737,5739,5741,5743,5745,5747,5749,5751,5753,5755,5757,5759,5761,5763,5765,5767,5769,5771,5773,5775,5777,5779,5781,5783,5785,5787,5789,5791,5793,5795,5797,5799,5801,5803,5805,5807,5809,5811,5813,5815,5817,5819,5821,5823,5825,5827,5829,5831,5833,5835,5837,5839,5841,5843,5845,5847,5849,5851,5853,5855,5857,5859,5861,5863,5865,5867,5869,5871,5873,5875,5877,5879,5881,5883,5885,5887,5889,5891,5893,5895,5897,5899,5901,5903,5905,5907,5909,5911,5913,5915,5917,5919,5921,5923,5925,5927,5929,5931,5933,5935,5937,5939,5941,5943,5945,5947,5949,5951,5953,5955,5957,5959,5961,5963,5965,5967,5969,5971,5973,5975,5977,5979,5981,5983,5985,5987,5989,5991,5993,5995,5997,5999,6001,6003,6005,6007,6009,6011,6013,6015,6017,6019,6021,6023,6025,6027,6029,6031,6033,6035,6037,6039,6041,6043,6045,6047,6049,6051,6053,6055,6057,6059,6061,6063,6065,6067,6069,6071,6073,6075,6077,6079,6081,6083,6085,6087,6089,6091,6093,6095,6097,6099,6101,6103,6105,6107,6109,6111,6113,6115,6117,6119,6121,6123,6125,6127,6129,6131,6133,6135,6137,6139,6141,6143,6145,6147,6149,6151,6153,6155,6157,6159,6161,6163,6165,6167,6169,6171,6173,6175,6177,6179,6181,6183,6185,6187,6189,6191,6193,6195,6197,6199,6201,6203,6205,6207,6209,6211,6213,6215,6217,6219,6221,6223,6225,6227,6229,6231,6233,6235,6237,6239,6241,6243,6245,6247,6249,6251,6253,6255,6257,6259,6261,6263,6265,6267,6269,6271,6273,6275,6277,6279,6281,6283,6285,6287,6289,6291,6293,6295,6297,6299,6301,6303,6305,6307,6309,6311,6313,6315,6317,6319,6321,6323,6325,6327,6329,6331,6333,6335,6337,6339,6341,6343,6345,6347,6349,6351,6353,6355,6357,6359,6361,6363,6365,6367,6369,6371,6373,6375,6377,6379,6381,6383,6385,6387,6389,6391,6393,6395,6397,6399,6401,6403,6405,6407,6409,6411,6413,6415,6417,6419,6421,6423,6425,6427,6429,6431,6433,6435,6437,6439,6441,6443,6445,6447,6449,6451,6453,6455,6457,6459,6461,6463,6465,6467,6469,6471,6473,6475,6477,6479,6481,6483,6485,6487,6489,6491,6493,6495,6497,6499,6501,6503,6505,6507,6509,6511,6513,6515,6517,6519,6521,6523,6525,6527,6529,6531,6533,6535,6537,6539,6541,6543,6545,6547,6549,6551,6553,6555,6557,6559,6561,6563,6565,6567,6569,6571,6573,6575,6577,6579,6581,6583,6585,6587,6589,6591,6593,6595,6597,6599,6601,6603,6605,6607,6609,6611,6613,6615,6617,6619,6621,6623,6625,6627,6629,6631,6633,6635,6637,6639,6641,6643,6645,6647,6649,6651,6653,6655,6657,6659,6661,6663,6665,6667,6669,6671,6673,6675,6677,6679,6681,6683,6685,6687,6689,6691,6693,6695,6697,6699,6701,6703,6705,6707,6709,6711,6713,6715,6717,6719,6721,6723,6725,6727,6729,6731,6733,6735,6737,6739,6741,6743,6745,6747,6749,6751,6753,6755,6757,6759,6761,6763,6765,6767,6769,6771,6773,6775,6777,6779,6781,6783,6785,6787,6789,6791,6793,6795,6797,6799,6801,6803,6805,6807,6809,6811,6813,6815,6817,6819,6821,6823,6825,6827,6829,6831,6833,6835,6837,6839,6841,6843,6845,6847,6849,6851,6853,6855,6857,6859,6861,6863,6865,6867,6869,6871,6873,6875,6877,6879,6881,6883,6885,6887,6889,6891,6893,6895,6897,6899,6901,6903,6905,6907,6909,6911,6913,6915,6917,6919,6921,6923,6925,6927,6929,6931,6933,6935,6937,6939,6941,6943,6945,6947,6949,6951,6953,6955,6957,6959,6961,6963,6965,6967,6969,6971,6973,6975,6977,6979,6981,6983,6985,6987,6989,6991,6993,6995,6997,6999,7001,7003,7005,7007,7009,7011,7013,7015,7017,7019,7021,7023,7025,7027,7029],{"categories":185},[145],{"categories":187},[188],"Developer Productivity",{"categories":190},[145],{"categories":192},[193],"Business & SaaS",{"categories":195},[145],{"categories":197},[198],"AI Automation",{"categories":200},[201],"Product Strategy",{"categories":203},[198],{"categories":205},[145],{"categories":207},[188],{"categories":209},[198],{"categories":211},[212],"Software Engineering",{"categories":214},[145],{"categories":216},[193],{"categories":218},[],{"categories":220},[145],{"categories":222},[223],"Inference & Serving",{"categories":225},[145],{"categories":227},[145],{"categories":229},[198],{"categories":231},[],{"categories":233},[234],"AI News & Trends",{"categories":236},[237],"Data Science & Visualization",{"categories":239},[198],{"categories":241},[145],{"categories":243},[145],{"categories":245},[193],{"categories":247},[188],{"categories":249},[145],{"categories":251},[198],{"categories":253},[234],{"categories":255},[145],{"categories":257},[198],{"categories":259},[198],{"categories":261},[145],{"categories":263},[145],{"categories":265},[198],{"categories":267},[145],{"categories":269},[145],{"categories":271},[145],{"categories":273},[198],{"categories":275},[234],{"categories":277},[145],{"categories":279},[145],{"categories":281},[145],{"categories":283},[],{"categories":285},[286],"Design & Frontend",{"categories":288},[237],{"categories":290},[234],{"categories":292},[145],{"categories":294},[145],{"categories":296},[145],{"categories":298},[],{"categories":300},[145],{"categories":302},[145],{"categories":304},[198],{"categories":306},[212],{"categories":308},[145],{"categories":310},[198],{"categories":312},[145],{"categories":314},[315],"Marketing & Growth",{"categories":317},[286],{"categories":319},[145],{"categories":321},[198],{"categories":323},[145],{"categories":325},[145],{"categories":327},[212],{"categories":329},[145],{"categories":331},[],{"categories":333},[],{"categories":335},[286],{"categories":337},[145],{"categories":339},[198],{"categories":341},[188],{"categories":343},[212],{"categories":345},[198],{"categories":347},[286],{"categories":349},[201],{"categories":351},[145],{"categories":353},[212],{"categories":355},[356],"DevOps & Cloud",{"categories":358},[198],{"categories":360},[201],{"categories":362},[234],{"categories":364},[145],{"categories":366},[],{"categories":368},[145],{"categories":370},[145],{"categories":372},[],{"categories":374},[198],{"categories":376},[212],{"categories":378},[],{"categories":380},[212],{"categories":382},[145],{"categories":384},[385],"Governance & Standards",{"categories":387},[193],{"categories":389},[],{"categories":391},[],{"categories":393},[145],{"categories":395},[145],{"categories":397},[198],{"categories":399},[145],{"categories":401},[145],{"categories":403},[198],{"categories":405},[145],{"categories":407},[145],{"categories":409},[145],{"categories":411},[],{"categories":413},[212],{"categories":415},[],{"categories":417},[],{"categories":419},[145],{"categories":421},[212],{"categories":423},[],{"categories":425},[212],{"categories":427},[145],{"categories":429},[145],{"categories":431},[315],{"categories":433},[145],{"categories":435},[145],{"categories":437},[286],{"categories":439},[286],{"categories":441},[145],{"categories":443},[212],{"categories":445},[198],{"categories":447},[448],"GovTech & Public-Sector Adoption",{"categories":450},[212],{"categories":452},[145],{"categories":454},[145],{"categories":456},[145],{"categories":458},[198],{"categories":460},[198],{"categories":462},[237],{"categories":464},[145],{"categories":466},[234],{"categories":468},[198],{"categories":470},[471],"Legal AI Tools",{"categories":473},[145],{"categories":475},[198],{"categories":477},[145],{"categories":479},[315],{"categories":481},[198],{"categories":483},[201],{"categories":485},[145],{"categories":487},[212],{"categories":489},[448],{"categories":491},[],{"categories":493},[198],{"categories":495},[],{"categories":497},[193],{"categories":499},[198],{"categories":501},[198],{"categories":503},[504],"RAG & Retrieval",{"categories":506},[193],{"categories":508},[145],{"categories":510},[212],{"categories":512},[212],{"categories":514},[356],{"categories":516},[286],{"categories":518},[198],{"categories":520},[145],{"categories":522},[145],{"categories":524},[],{"categories":526},[527],"Agents & Orchestration",{"categories":529},[212],{"categories":531},[145],{"categories":533},[],{"categories":535},[198],{"categories":537},[193],{"categories":539},[],{"categories":541},[145],{"categories":543},[],{"categories":545},[145],{"categories":547},[188],{"categories":549},[212],{"categories":551},[193],{"categories":553},[145],{"categories":555},[198],{"categories":557},[145],{"categories":559},[234],{"categories":561},[145],{"categories":563},[],{"categories":565},[145],{"categories":567},[],{"categories":569},[145],{"categories":571},[212],{"categories":573},[145],{"categories":575},[237],{"categories":577},[],{"categories":579},[145],{"categories":581},[286],{"categories":583},[584],"Models & Frontier Labs",{"categories":586},[],{"categories":588},[286],{"categories":590},[591],"Regulation & Governance of AI",{"categories":593},[201],{"categories":595},[198],{"categories":597},[],{"categories":599},[145],{"categories":601},[145],{"categories":603},[198],{"categories":605},[198],{"categories":607},[234],{"categories":609},[145],{"categories":611},[193],{"categories":613},[145],{"categories":615},[198],{"categories":617},[],{"categories":619},[212],{"categories":621},[198],{"categories":623},[145],{"categories":625},[201],{"categories":627},[145],{"categories":629},[630],"AI Policy & Regulation",{"categories":632},[],{"categories":634},[145],{"categories":636},[198],{"categories":638},[201],{"categories":640},[198],{"categories":642},[145],{"categories":644},[145],{"categories":646},[145],{"categories":648},[198],{"categories":650},[],{"categories":652},[237],{"categories":654},[655],"Evals & Reliability",{"categories":657},[145],{"categories":659},[145],{"categories":661},[],{"categories":663},[188],{"categories":665},[448],{"categories":667},[630],{"categories":669},[145],{"categories":671},[193],{"categories":673},[145],{"categories":675},[198],{"categories":677},[145],{"categories":679},[198],{"categories":681},[527],{"categories":683},[145],{"categories":685},[212],{"categories":687},[145],{"categories":689},[],{"categories":691},[286],{"categories":693},[],{"categories":695},[145],{"categories":697},[448],{"categories":699},[145],{"categories":701},[145],{"categories":703},[145],{"categories":705},[],{"categories":707},[145],{"categories":709},[286],{"categories":711},[212],{"categories":713},[],{"categories":715},[145],{"categories":717},[],{"categories":719},[198],{"categories":721},[145],{"categories":723},[286],{"categories":725},[],{"categories":727},[145],{"categories":729},[145],{"categories":731},[237],{"categories":733},[198],{"categories":735},[145],{"categories":737},[193],{"categories":739},[198],{"categories":741},[145],{"categories":743},[145],{"categories":745},[212],{"categories":747},[286],{"categories":749},[145],{"categories":751},[198],{"categories":753},[],{"categories":755},[212],{"categories":757},[198],{"categories":759},[237],{"categories":761},[],{"categories":763},[145],{"categories":765},[234],{"categories":767},[145],{"categories":769},[],{"categories":771},[145],{"categories":773},[145],{"categories":775},[145],{"categories":777},[193,315],{"categories":779},[],{"categories":781},[212],{"categories":783},[145],{"categories":785},[145],{"categories":787},[198],{"categories":789},[145],{"categories":791},[],{"categories":793},[],{"categories":795},[145],{"categories":797},[286],{"categories":799},[145],{"categories":801},[],{"categories":803},[145],{"categories":805},[356],{"categories":807},[],{"categories":809},[198],{"categories":811},[234],{"categories":813},[145],{"categories":815},[145],{"categories":817},[286],{"categories":819},[],{"categories":821},[234],{"categories":823},[145],{"categories":825},[223],{"categories":827},[145],{"categories":829},[145],{"categories":831},[198],{"categories":833},[234],{"categories":835},[584],{"categories":837},[145],{"categories":839},[315],{"categories":841},[],{"categories":843},[198],{"categories":845},[193],{"categories":847},[212],{"categories":849},[145],{"categories":851},[198],{"categories":853},[],{"categories":855},[145,356],{"categories":857},[145],{"categories":859},[145],{"categories":861},[145],{"categories":863},[198],{"categories":865},[145,212],{"categories":867},[237],{"categories":869},[145],{"categories":871},[145],{"categories":873},[145],{"categories":875},[212],{"categories":877},[145],{"categories":879},[198],{"categories":881},[198],{"categories":883},[630],{"categories":885},[315],{"categories":887},[145],{"categories":889},[198],{"categories":891},[145],{"categories":893},[145],{"categories":895},[198],{"categories":897},[],{"categories":899},[198],{"categories":901},[145],{"categories":903},[145],{"categories":905},[198],{"categories":907},[145],{"categories":909},[145,193],{"categories":911},[145],{"categories":913},[193],{"categories":915},[],{"categories":917},[286],{"categories":919},[286],{"categories":921},[145],{"categories":923},[],{"categories":925},[],{"categories":927},[145],{"categories":929},[234],{"categories":931},[],{"categories":933},[188],{"categories":935},[145],{"categories":937},[212],{"categories":939},[145],{"categories":941},[942],"Generative UI & Design-to-Code",{"categories":944},[145],{"categories":946},[145],{"categories":948},[286],{"categories":950},[145],{"categories":952},[953],"Algorithmic Accountability",{"categories":955},[198],{"categories":957},[212],{"categories":959},[234],{"categories":961},[286],{"categories":963},[145],{"categories":965},[],{"categories":967},[201],{"categories":969},[145],{"categories":971},[145],{"categories":973},[145],{"categories":975},[145],{"categories":977},[198],{"categories":979},[980],"MLOps & Infrastructure",{"categories":982},[145],{"categories":984},[145],{"categories":986},[145],{"categories":988},[145],{"categories":990},[145],{"categories":992},[212],{"categories":994},[234],{"categories":996},[145],{"categories":998},[201],{"categories":1000},[188],{"categories":1002},[145],{"categories":1004},[198],{"categories":1006},[356],{"categories":1008},[145],{"categories":1010},[193],{"categories":1012},[145],{"categories":1014},[286],{"categories":1016},[145],{"categories":1018},[145],{"categories":1020},[198],{"categories":1022},[],{"categories":1024},[],{"categories":1026},[145],{"categories":1028},[223],{"categories":1030},[286],{"categories":1032},[234],{"categories":1034},[237],{"categories":1036},[],{"categories":1038},[145],{"categories":1040},[145],{"categories":1042},[193],{"categories":1044},[198],{"categories":1046},[145],{"categories":1048},[145],{"categories":1050},[145],{"categories":1052},[145],{"categories":1054},[234],{"categories":1056},[223],{"categories":1058},[145],{"categories":1060},[286],{"categories":1062},[145],{"categories":1064},[],{"categories":1066},[198],{"categories":1068},[212],{"categories":1070},[],{"categories":1072},[145],{"categories":1074},[145],{"categories":1076},[198],{"categories":1078},[212],{"categories":1080},[145],{"categories":1082},[237],{"categories":1084},[286],{"categories":1086},[],{"categories":1088},[145],{"categories":1090},[],{"categories":1092},[145],{"categories":1094},[],{"categories":1096},[145],{"categories":1098},[145],{"categories":1100},[201],{"categories":1102},[193],{"categories":1104},[198],{"categories":1106},[198],{"categories":1108},[],{"categories":1110},[145],{"categories":1112},[188],{"categories":1114},[145],{"categories":1116},[145],{"categories":1118},[193],{"categories":1120},[234],{"categories":1122},[188],{"categories":1124},[],{"categories":1126},[145],{"categories":1128},[],{"categories":1130},[145],{"categories":1132},[],{"categories":1134},[234],{"categories":1136},[234],{"categories":1138},[],{"categories":1140},[527],{"categories":1142},[145],{"categories":1144},[286],{"categories":1146},[212],{"categories":1148},[],{"categories":1150},[471],{"categories":1152},[198],{"categories":1154},[193],{"categories":1156},[],{"categories":1158},[],{"categories":1160},[188],{"categories":1162},[237],{"categories":1164},[],{"categories":1166},[315],{"categories":1168},[198],{"categories":1170},[193],{"categories":1172},[198],{"categories":1174},[193],{"categories":1176},[145],{"categories":1178},[212],{"categories":1180},[],{"categories":1182},[223],{"categories":1184},[201],{"categories":1186},[145],{"categories":1188},[286],{"categories":1190},[212],{"categories":1192},[193],{"categories":1194},[145],{"categories":1196},[145],{"categories":1198},[198],{"categories":1200},[193],{"categories":1202},[145],{"categories":1204},[145],{"categories":1206},[145],{"categories":1208},[145],{"categories":1210},[145],{"categories":1212},[],{"categories":1214},[],{"categories":1216},[212],{"categories":1218},[237],{"categories":1220},[201],{"categories":1222},[145],{"categories":1224},[198],{"categories":1226},[212],{"categories":1228},[212],{"categories":1230},[145],{"categories":1232},[],{"categories":1234},[234],{"categories":1236},[201],{"categories":1238},[201],{"categories":1240},[212],{"categories":1242},[145],{"categories":1244},[655],{"categories":1246},[356],{"categories":1248},[],{"categories":1250},[198],{"categories":1252},[145],{"categories":1254},[],{"categories":1256},[188],{"categories":1258},[],{"categories":1260},[145],{"categories":1262},[145],{"categories":1264},[145],{"categories":1266},[286],{"categories":1268},[315],{"categories":1270},[145],{"categories":1272},[212],{"categories":1274},[145],{"categories":1276},[198],{"categories":1278},[],{"categories":1280},[212],{"categories":1282},[145],{"categories":1284},[188],{"categories":1286},[],{"categories":1288},[193],{"categories":1290},[145],{"categories":1292},[145],{"categories":1294},[234],{"categories":1296},[145,356],{"categories":1298},[145],{"categories":1300},[1301],"Design Systems for AI",{"categories":1303},[145],{"categories":1305},[145],{"categories":1307},[234],{"categories":1309},[145],{"categories":1311},[145],{"categories":1313},[145],{"categories":1315},[193],{"categories":1317},[145],{"categories":1319},[145],{"categories":1321},[145],{"categories":1323},[],{"categories":1325},[145],{"categories":1327},[145],{"categories":1329},[193],{"categories":1331},[145],{"categories":1333},[],{"categories":1335},[198],{"categories":1337},[212],{"categories":1339},[234],{"categories":1341},[212],{"categories":1343},[145],{"categories":1345},[286],{"categories":1347},[234],{"categories":1349},[237],{"categories":1351},[145],{"categories":1353},[145],{"categories":1355},[198],{"categories":1357},[188],{"categories":1359},[630],{"categories":1361},[145],{"categories":1363},[198],{"categories":1365},[145],{"categories":1367},[212],{"categories":1369},[212],{"categories":1371},[],{"categories":1373},[],{"categories":1375},[145],{"categories":1377},[198],{"categories":1379},[201],{"categories":1381},[],{"categories":1383},[193],{"categories":1385},[145],{"categories":1387},[],{"categories":1389},[286],{"categories":1391},[212],{"categories":1393},[198],{"categories":1395},[212],{"categories":1397},[286],{"categories":1399},[145],{"categories":1401},[145],{"categories":1403},[286],{"categories":1405},[],{"categories":1407},[],{"categories":1409},[234],{"categories":1411},[198],{"categories":1413},[198],{"categories":1415},[145],{"categories":1417},[145],{"categories":1419},[145],{"categories":1421},[145],{"categories":1423},[193],{"categories":1425},[145],{"categories":1427},[145],{"categories":1429},[],{"categories":1431},[212],{"categories":1433},[212],{"categories":1435},[145],{"categories":1437},[212],{"categories":1439},[193],{"categories":1441},[],{"categories":1443},[145],{"categories":1445},[145],{"categories":1447},[145],{"categories":1449},[145],{"categories":1451},[145],{"categories":1453},[198],{"categories":1455},[188],{"categories":1457},[193],{"categories":1459},[145],{"categories":1461},[198],{"categories":1463},[234],{"categories":1465},[198],{"categories":1467},[223],{"categories":1469},[315],{"categories":1471},[145],{"categories":1473},[198],{"categories":1475},[145],{"categories":1477},[145],{"categories":1479},[145],{"categories":1481},[],{"categories":1483},[286],{"categories":1485},[],{"categories":1487},[145],{"categories":1489},[145],{"categories":1491},[],{"categories":1493},[145],{"categories":1495},[212],{"categories":1497},[193],{"categories":1499},[1500],"Visual & Generative Media",{"categories":1502},[198],{"categories":1504},[],{"categories":1506},[145],{"categories":1508},[145],{"categories":1510},[212],{"categories":1512},[356],{"categories":1514},[145],{"categories":1516},[237],{"categories":1518},[630],{"categories":1520},[212],{"categories":1522},[315],{"categories":1524},[145],{"categories":1526},[286],{"categories":1528},[145],{"categories":1530},[145],{"categories":1532},[212],{"categories":1534},[198],{"categories":1536},[145],{"categories":1538},[],{"categories":1540},[],{"categories":1542},[198],{"categories":1544},[212],{"categories":1546},[188],{"categories":1548},[198],{"categories":1550},[584],{"categories":1552},[145],{"categories":1554},[201],{"categories":1556},[145],{"categories":1558},[193],{"categories":1560},[],{"categories":1562},[145],{"categories":1564},[201],{"categories":1566},[145],{"categories":1568},[145],{"categories":1570},[145],{"categories":1572},[201],{"categories":1574},[145],{"categories":1576},[145],{"categories":1578},[315],{"categories":1580},[145],{"categories":1582},[527],{"categories":1584},[145],{"categories":1586},[198],{"categories":1588},[145],{"categories":1590},[145],{"categories":1592},[145],{"categories":1594},[145],{"categories":1596},[286],{"categories":1598},[198],{"categories":1600},[],{"categories":1602},[198],{"categories":1604},[],{"categories":1606},[356],{"categories":1608},[212],{"categories":1610},[],{"categories":1612},[584],{"categories":1614},[145],{"categories":1616},[198],{"categories":1618},[198],{"categories":1620},[145],{"categories":1622},[286,145],{"categories":1624},[188],{"categories":1626},[145],{"categories":1628},[286],{"categories":1630},[],{"categories":1632},[145],{"categories":1634},[188],{"categories":1636},[145],{"categories":1638},[1639],"Medical Imaging & Radiology",{"categories":1641},[145],{"categories":1643},[145],{"categories":1645},[145],{"categories":1647},[286],{"categories":1649},[198],{"categories":1651},[212],{"categories":1653},[],{"categories":1655},[145],{"categories":1657},[145],{"categories":1659},[145],{"categories":1661},[],{"categories":1663},[],{"categories":1665},[145],{"categories":1667},[145],{"categories":1669},[527],{"categories":1671},[145],{"categories":1673},[188],{"categories":1675},[145],{"categories":1677},[145],{"categories":1679},[],{"categories":1681},[198],{"categories":1683},[145],{"categories":1685},[201],{"categories":1687},[212],{"categories":1689},[145],{"categories":1691},[198],{"categories":1693},[527],{"categories":1695},[145],{"categories":1697},[198],{"categories":1699},[145],{"categories":1701},[145],{"categories":1703},[145],{"categories":1705},[286],{"categories":1707},[198],{"categories":1709},[356],{"categories":1711},[286],{"categories":1713},[193],{"categories":1715},[198],{"categories":1717},[234],{"categories":1719},[145],{"categories":1721},[145],{"categories":1723},[201],{"categories":1725},[145],{"categories":1727},[145],{"categories":1729},[145],{"categories":1731},[145],{"categories":1733},[198],{"categories":1735},[145],{"categories":1737},[212],{"categories":1739},[212],{"categories":1741},[145],{"categories":1743},[201],{"categories":1745},[],{"categories":1747},[234],{"categories":1749},[],{"categories":1751},[201],{"categories":1753},[198],{"categories":1755},[145],{"categories":1757},[198],{"categories":1759},[1301],{"categories":1761},[1301],{"categories":1763},[286],{"categories":1765},[145],{"categories":1767},[145],{"categories":1769},[145],{"categories":1771},[198],{"categories":1773},[212],{"categories":1775},[286],{"categories":1777},[198],{"categories":1779},[234],{"categories":1781},[],{"categories":1783},[145],{"categories":1785},[],{"categories":1787},[145],{"categories":1789},[145],{"categories":1791},[145],{"categories":1793},[145],{"categories":1795},[198],{"categories":1797},[1798],"Contract Review & E-Discovery",{"categories":1800},[145],{"categories":1802},[286],{"categories":1804},[145],{"categories":1806},[188],{"categories":1808},[145],{"categories":1810},[234],{"categories":1812},[145],{"categories":1814},[145],{"categories":1816},[315],{"categories":1818},[212],{"categories":1820},[145],{"categories":1822},[145],{"categories":1824},[198],{"categories":1826},[198],{"categories":1828},[953],{"categories":1830},[145],{"categories":1832},[145],{"categories":1834},[198],{"categories":1836},[198],{"categories":1838},[145],{"categories":1840},[145],{"categories":1842},[145],{"categories":1844},[198],{"categories":1846},[145],{"categories":1848},[145],{"categories":1850},[527],{"categories":1852},[504],{"categories":1854},[145],{"categories":1856},[198],{"categories":1858},[145],{"categories":1860},[1861],"Law-Firm Practice & Adoption",{"categories":1863},[145],{"categories":1865},[198],{"categories":1867},[286],{"categories":1869},[145],{"categories":1871},[145],{"categories":1873},[145],{"categories":1875},[],{"categories":1877},[],{"categories":1879},[212],{"categories":1881},[145],{"categories":1883},[],{"categories":1885},[198],{"categories":1887},[188],{"categories":1889},[356],{"categories":1891},[145],{"categories":1893},[],{"categories":1895},[188],{"categories":1897},[193],{"categories":1899},[145],{"categories":1901},[315],{"categories":1903},[],{"categories":1905},[193],{"categories":1907},[198],{"categories":1909},[193],{"categories":1911},[],{"categories":1913},[145],{"categories":1915},[201],{"categories":1917},[145],{"categories":1919},[212],{"categories":1921},[],{"categories":1923},[],{"categories":1925},[],{"categories":1927},[],{"categories":1929},[145],{"categories":1931},[201],{"categories":1933},[198],{"categories":1935},[356],{"categories":1937},[145],{"categories":1939},[188],{"categories":1941},[212],{"categories":1943},[145],{"categories":1945},[145],{"categories":1947},[212],{"categories":1949},[201],{"categories":1951},[145],{"categories":1953},[145],{"categories":1955},[145],{"categories":1957},[980],{"categories":1959},[145],{"categories":1961},[212],{"categories":1963},[145],{"categories":1965},[315],{"categories":1967},[212],{"categories":1969},[193],{"categories":1971},[145],{"categories":1973},[145],{"categories":1975},[145],{"categories":1977},[286],{"categories":1979},[145],{"categories":1981},[145],{"categories":1983},[145],{"categories":1985},[145],{"categories":1987},[193],{"categories":1989},[198],{"categories":1991},[145,188],{"categories":1993},[527],{"categories":1995},[145],{"categories":1997},[145],{"categories":1999},[212],{"categories":2001},[212],{"categories":2003},[286],{"categories":2005},[198],{"categories":2007},[198],{"categories":2009},[212],{"categories":2011},[145],{"categories":2013},[145],{"categories":2015},[],{"categories":2017},[],{"categories":2019},[145],{"categories":2021},[145],{"categories":2023},[198],{"categories":2025},[],{"categories":2027},[145],{"categories":2029},[145],{"categories":2031},[212],{"categories":2033},[237],{"categories":2035},[234],{"categories":2037},[286],{"categories":2039},[145],{"categories":2041},[198],{"categories":2043},[145],{"categories":2045},[212],{"categories":2047},[],{"categories":2049},[198],{"categories":2051},[145],{"categories":2053},[145],{"categories":2055},[145],{"categories":2057},[145],{"categories":2059},[],{"categories":2061},[198],{"categories":2063},[145],{"categories":2065},[145],{"categories":2067},[145],{"categories":2069},[],{"categories":2071},[198],{"categories":2073},[145],{"categories":2075},[145],{"categories":2077},[193],{"categories":2079},[145],{"categories":2081},[145],{"categories":2083},[],{"categories":2085},[188],{"categories":2087},[145],{"categories":2089},[145],{"categories":2091},[145],{"categories":2093},[286],{"categories":2095},[145],{"categories":2097},[212],{"categories":2099},[145],{"categories":2101},[188],{"categories":2103},[145],{"categories":2105},[212],{"categories":2107},[315],{"categories":2109},[198],{"categories":2111},[198],{"categories":2113},[145],{"categories":2115},[145],{"categories":2117},[145,286],{"categories":2119},[145],{"categories":2121},[198],{"categories":2123},[234],{"categories":2125},[145],{"categories":2127},[234],{"categories":2129},[198],{"categories":2131},[286],{"categories":2133},[145],{"categories":2135},[],{"categories":2137},[212],{"categories":2139},[356],{"categories":2141},[286],{"categories":2143},[212],{"categories":2145},[145],{"categories":2147},[201],{"categories":2149},[145],{"categories":2151},[145],{"categories":2153},[198],{"categories":2155},[],{"categories":2157},[],{"categories":2159},[145],{"categories":2161},[],{"categories":2163},[],{"categories":2165},[201],{"categories":2167},[212],{"categories":2169},[145],{"categories":2171},[198],{"categories":2173},[198],{"categories":2175},[193],{"categories":2177},[198],{"categories":2179},[356],{"categories":2181},[145],{"categories":2183},[145],{"categories":2185},[145],{"categories":2187},[223],{"categories":2189},[145],{"categories":2191},[145],{"categories":2193},[145],{"categories":2195},[212],{"categories":2197},[198],{"categories":2199},[145],{"categories":2201},[145],{"categories":2203},[471],{"categories":2205},[953],{"categories":2207},[],{"categories":2209},[286],{"categories":2211},[1861],{"categories":2213},[212],{"categories":2215},[],{"categories":2217},[],{"categories":2219},[145],{"categories":2221},[198],{"categories":2223},[],{"categories":2225},[],{"categories":2227},[145],{"categories":2229},[315],{"categories":2231},[145],{"categories":2233},[315],{"categories":2235},[198],{"categories":2237},[145],{"categories":2239},[145],{"categories":2241},[212],{"categories":2243},[201],{"categories":2245},[],{"categories":2247},[145],{"categories":2249},[145],{"categories":2251},[212],{"categories":2253},[1798],{"categories":2255},[286],{"categories":2257},[286],{"categories":2259},[145],{"categories":2261},[198],{"categories":2263},[188],{"categories":2265},[145],{"categories":2267},[145],{"categories":2269},[145],{"categories":2271},[145],{"categories":2273},[286],{"categories":2275},[286],{"categories":2277},[198],{"categories":2279},[198],{"categories":2281},[198],{"categories":2283},[145],{"categories":2285},[145],{"categories":2287},[],{"categories":2289},[145],{"categories":2291},[],{"categories":2293},[2294],"Interaction & Product Design",{"categories":2296},[145],{"categories":2298},[198],{"categories":2300},[212],{"categories":2302},[385],{"categories":2304},[234],{"categories":2306},[212],{"categories":2308},[145],{"categories":2310},[145],{"categories":2312},[145],{"categories":2314},[212],{"categories":2316},[145],{"categories":2318},[188],{"categories":2320},[198],{"categories":2322},[145],{"categories":2324},[],{"categories":2326},[198],{"categories":2328},[198],{"categories":2330},[198],{"categories":2332},[],{"categories":2334},[212],{"categories":2336},[145],{"categories":2338},[188],{"categories":2340},[2294],{"categories":2342},[145],{"categories":2344},[188],{"categories":2346},[188],{"categories":2348},[],{"categories":2350},[198],{"categories":2352},[212],{"categories":2354},[],{"categories":2356},[198],{"categories":2358},[234],{"categories":2360},[145],{"categories":2362},[198],{"categories":2364},[145],{"categories":2366},[198],{"categories":2368},[145],{"categories":2370},[145],{"categories":2372},[234],{"categories":2374},[237],{"categories":2376},[145],{"categories":2378},[201],{"categories":2380},[212],{"categories":2382},[2383],"Coding Agents & Dev Productivity",{"categories":2385},[234],{"categories":2387},[286],{"categories":2389},[145],{"categories":2391},[145],{"categories":2393},[],{"categories":2395},[145],{"categories":2397},[953],{"categories":2399},[],{"categories":2401},[145],{"categories":2403},[145],{"categories":2405},[356],{"categories":2407},[145],{"categories":2409},[234],{"categories":2411},[],{"categories":2413},[],{"categories":2415},[145],{"categories":2417},[],{"categories":2419},[198],{"categories":2421},[145],{"categories":2423},[],{"categories":2425},[212],{"categories":2427},[212],{"categories":2429},[145],{"categories":2431},[237],{"categories":2433},[],{"categories":2435},[145],{"categories":2437},[145],{"categories":2439},[145],{"categories":2441},[237],{"categories":2443},[212],{"categories":2445},[198],{"categories":2447},[],{"categories":2449},[],{"categories":2451},[145],{"categories":2453},[145],{"categories":2455},[198],{"categories":2457},[198],{"categories":2459},[448],{"categories":2461},[212],{"categories":2463},[212],{"categories":2465},[198],{"categories":2467},[234],{"categories":2469},[234],{"categories":2471},[198],{"categories":2473},[198],{"categories":2475},[145],{"categories":2477},[188],{"categories":2479},[2294],{"categories":2481},[201],{"categories":2483},[145,356],{"categories":2485},[237],{"categories":2487},[],{"categories":2489},[286],{"categories":2491},[198],{"categories":2493},[212],{"categories":2495},[188],{"categories":2497},[145],{"categories":2499},[198],{"categories":2501},[2502],"The Designer's Role & Craft",{"categories":2504},[286],{"categories":2506},[],{"categories":2508},[198],{"categories":2510},[145],{"categories":2512},[198],{"categories":2514},[198],{"categories":2516},[145],{"categories":2518},[315],{"categories":2520},[145],{"categories":2522},[212],{"categories":2524},[145],{"categories":2526},[286],{"categories":2528},[145],{"categories":2530},[],{"categories":2532},[198],{"categories":2534},[286],{"categories":2536},[201],{"categories":2538},[145],{"categories":2540},[145],{"categories":2542},[145],{"categories":2544},[2545],"AI UX Patterns",{"categories":2547},[198],{"categories":2549},[198],{"categories":2551},[198],{"categories":2553},[198],{"categories":2555},[315],{"categories":2557},[237],{"categories":2559},[145],{"categories":2561},[198],{"categories":2563},[145],{"categories":2565},[1301],{"categories":2567},[],{"categories":2569},[315],{"categories":2571},[198],{"categories":2573},[234],{"categories":2575},[212],{"categories":2577},[145],{"categories":2579},[198],{"categories":2581},[],{"categories":2583},[],{"categories":2585},[145],{"categories":2587},[145],{"categories":2589},[198],{"categories":2591},[145],{"categories":2593},[198],{"categories":2595},[448],{"categories":2597},[286],{"categories":2599},[145],{"categories":2601},[234],{"categories":2603},[212],{"categories":2605},[145],{"categories":2607},[198],{"categories":2609},[198],{"categories":2611},[],{"categories":2613},[145],{"categories":2615},[],{"categories":2617},[145],{"categories":2619},[],{"categories":2621},[145],{"categories":2623},[145],{"categories":2625},[145],{"categories":2627},[198],{"categories":2629},[212],{"categories":2631},[],{"categories":2633},[],{"categories":2635},[237],{"categories":2637},[223],{"categories":2639},[145],{"categories":2641},[145],{"categories":2643},[145],{"categories":2645},[237],{"categories":2647},[145],{"categories":2649},[145],{"categories":2651},[234],{"categories":2653},[145],{"categories":2655},[145],{"categories":2657},[145],{"categories":2659},[198],{"categories":2661},[145],{"categories":2663},[198],{"categories":2665},[145],{"categories":2667},[145],{"categories":2669},[145],{"categories":2671},[198],{"categories":2673},[],{"categories":2675},[145],{"categories":2677},[],{"categories":2679},[145],{"categories":2681},[145],{"categories":2683},[356],{"categories":2685},[145],{"categories":2687},[],{"categories":2689},[],{"categories":2691},[286],{"categories":2693},[980],{"categories":2695},[198],{"categories":2697},[188],{"categories":2699},[2502],{"categories":2701},[],{"categories":2703},[],{"categories":2705},[145],{"categories":2707},[],{"categories":2709},[],{"categories":2711},[212],{"categories":2713},[234],{"categories":2715},[315],{"categories":2717},[198],{"categories":2719},[193],{"categories":2721},[145],{"categories":2723},[145],{"categories":2725},[193],{"categories":2727},[],{"categories":2729},[286],{"categories":2731},[201],{"categories":2733},[145],{"categories":2735},[145],{"categories":2737},[198],{"categories":2739},[193],{"categories":2741},[145],{"categories":2743},[145],{"categories":2745},[188],{"categories":2747},[145],{"categories":2749},[145],{"categories":2751},[],{"categories":2753},[188],{"categories":2755},[145],{"categories":2757},[315],{"categories":2759},[198],{"categories":2761},[234],{"categories":2763},[145],{"categories":2765},[212],{"categories":2767},[145],{"categories":2769},[145],{"categories":2771},[193],{"categories":2773},[145],{"categories":2775},[145],{"categories":2777},[145],{"categories":2779},[198],{"categories":2781},[145],{"categories":2783},[],{"categories":2785},[145],{"categories":2787},[212],{"categories":2789},[188],{"categories":2791},[145],{"categories":2793},[145],{"categories":2795},[145],{"categories":2797},[],{"categories":2799},[145],{"categories":2801},[527],{"categories":2803},[198],{"categories":2805},[193],{"categories":2807},[234],{"categories":2809},[145],{"categories":2811},[145],{"categories":2813},[],{"categories":2815},[193],{"categories":2817},[193],{"categories":2819},[145],{"categories":2821},[145],{"categories":2823},[201],{"categories":2825},[145],{"categories":2827},[145],{"categories":2829},[145],{"categories":2831},[145],{"categories":2833},[212],{"categories":2835},[212],{"categories":2837},[145],{"categories":2839},[],{"categories":2841},[212],{"categories":2843},[145],{"categories":2845},[212],{"categories":2847},[198],{"categories":2849},[630],{"categories":2851},[],{"categories":2853},[],{"categories":2855},[145],{"categories":2857},[234],{"categories":2859},[],{"categories":2861},[356],{"categories":2863},[145],{"categories":2865},[145],{"categories":2867},[145],{"categories":2869},[286],{"categories":2871},[942],{"categories":2873},[],{"categories":2875},[145],{"categories":2877},[145],{"categories":2879},[145],{"categories":2881},[212],{"categories":2883},[145],{"categories":2885},[145],{"categories":2887},[145,356],{"categories":2889},[145],{"categories":2891},[145],{"categories":2893},[286],{"categories":2895},[198],{"categories":2897},[],{"categories":2899},[198],{"categories":2901},[198],{"categories":2903},[145],{"categories":2905},[145],{"categories":2907},[145],{"categories":2909},[145],{"categories":2911},[237],{"categories":2913},[145],{"categories":2915},[2545],{"categories":2917},[188],{"categories":2919},[237],{"categories":2921},[188],{"categories":2923},[212],{"categories":2925},[286],{"categories":2927},[198],{"categories":2929},[145],{"categories":2931},[],{"categories":2933},[193],{"categories":2935},[145],{"categories":2937},[145],{"categories":2939},[234],{"categories":2941},[145],{"categories":2943},[145],{"categories":2945},[145],{"categories":2947},[198],{"categories":2949},[145],{"categories":2951},[145],{"categories":2953},[145],{"categories":2955},[193],{"categories":2957},[],{"categories":2959},[356],{"categories":2961},[145],{"categories":2963},[448],{"categories":2965},[286],{"categories":2967},[286],{"categories":2969},[212],{"categories":2971},[198],{"categories":2973},[145],{"categories":2975},[193],{"categories":2977},[234],{"categories":2979},[145],{"categories":2981},[145],{"categories":2983},[145],{"categories":2985},[286],{"categories":2987},[198],{"categories":2989},[198],{"categories":2991},[145],{"categories":2993},[145],{"categories":2995},[584],{"categories":2997},[198],{"categories":2999},[],{"categories":3001},[145],{"categories":3003},[145],{"categories":3005},[145],{"categories":3007},[],{"categories":3009},[],{"categories":3011},[145],{"categories":3013},[145],{"categories":3015},[198],{"categories":3017},[145],{"categories":3019},[145],{"categories":3021},[145],{"categories":3023},[212],{"categories":3025},[145],{"categories":3027},[145],{"categories":3029},[198],{"categories":3031},[145],{"categories":3033},[145],{"categories":3035},[145],{"categories":3037},[145],{"categories":3039},[145],{"categories":3041},[],{"categories":3043},[212],{"categories":3045},[237],{"categories":3047},[145],{"categories":3049},[198],{"categories":3051},[198],{"categories":3053},[145],{"categories":3055},[145],{"categories":3057},[],{"categories":3059},[],{"categories":3061},[145],{"categories":3063},[145],{"categories":3065},[145],{"categories":3067},[234],{"categories":3069},[237],{"categories":3071},[],{"categories":3073},[145],{"categories":3075},[286],{"categories":3077},[145],{"categories":3079},[356],{"categories":3081},[1861],{"categories":3083},[234],{"categories":3085},[212],{"categories":3087},[145],{"categories":3089},[212],{"categories":3091},[212],{"categories":3093},[145],{"categories":3095},[145],{"categories":3097},[212],{"categories":3099},[234],{"categories":3101},[234],{"categories":3103},[356],{"categories":3105},[198],{"categories":3107},[],{"categories":3109},[234],{"categories":3111},[145],{"categories":3113},[198],{"categories":3115},[188],{"categories":3117},[212],{"categories":3119},[145],{"categories":3121},[234],{"categories":3123},[],{"categories":3125},[145],{"categories":3127},[212],{"categories":3129},[212],{"categories":3131},[237],{"categories":3133},[145],{"categories":3135},[234],{"categories":3137},[145],{"categories":3139},[212],{"categories":3141},[198],{"categories":3143},[198],{"categories":3145},[234],{"categories":3147},[198],{"categories":3149},[356],{"categories":3151},[198],{"categories":3153},[145],{"categories":3155},[145],{"categories":3157},[145],{"categories":3159},[145],{"categories":3161},[212],{"categories":3163},[145],{"categories":3165},[],{"categories":3167},[198],{"categories":3169},[193],{"categories":3171},[212],{"categories":3173},[],{"categories":3175},[],{"categories":3177},[145],{"categories":3179},[198],{"categories":3181},[145],{"categories":3183},[145],{"categories":3185},[3186],"Frameworks & Tooling",{"categories":3188},[145],{"categories":3190},[145],{"categories":3192},[212],{"categories":3194},[145],{"categories":3196},[145],{"categories":3198},[],{"categories":3200},[237],{"categories":3202},[237],{"categories":3204},[188],{"categories":3206},[145],{"categories":3208},[198],{"categories":3210},[145],{"categories":3212},[286],{"categories":3214},[],{"categories":3216},[1861],{"categories":3218},[145],{"categories":3220},[212],{"categories":3222},[145],{"categories":3224},[356],{"categories":3226},[356],{"categories":3228},[],{"categories":3230},[198],{"categories":3232},[145],{"categories":3234},[145],{"categories":3236},[234],{"categories":3238},[198],{"categories":3240},[234],{"categories":3242},[145],{"categories":3244},[198],{"categories":3246},[],{"categories":3248},[286],{"categories":3250},[145],{"categories":3252},[145],{"categories":3254},[],{"categories":3256},[145],{"categories":3258},[198],{"categories":3260},[145],{"categories":3262},[145],{"categories":3264},[145],{"categories":3266},[],{"categories":3268},[212],{"categories":3270},[145],{"categories":3272},[212],{"categories":3274},[356],{"categories":3276},[145],{"categories":3278},[145],{"categories":3280},[212],{"categories":3282},[193],{"categories":3284},[145],{"categories":3286},[1861],{"categories":3288},[],{"categories":3290},[198],{"categories":3292},[188],{"categories":3294},[145],{"categories":3296},[188],{"categories":3298},[145],{"categories":3300},[],{"categories":3302},[198],{"categories":3304},[145],{"categories":3306},[145],{"categories":3308},[3309],"AI Design Tooling",{"categories":3311},[286],{"categories":3313},[145],{"categories":3315},[145],{"categories":3317},[212],{"categories":3319},[286],{"categories":3321},[145],{"categories":3323},[145],{"categories":3325},[212],{"categories":3327},[234],{"categories":3329},[201],{"categories":3331},[212],{"categories":3333},[145],{"categories":3335},[145],{"categories":3337},[145],{"categories":3339},[198],{"categories":3341},[145],{"categories":3343},[],{"categories":3345},[198],{"categories":3347},[145],{"categories":3349},[145],{"categories":3351},[198],{"categories":3353},[145],{"categories":3355},[145],{"categories":3357},[145],{"categories":3359},[198],{"categories":3361},[],{"categories":3363},[198],{"categories":3365},[3186],{"categories":3367},[145],{"categories":3369},[145],{"categories":3371},[198],{"categories":3373},[198],{"categories":3375},[212],{"categories":3377},[212],{"categories":3379},[145],{"categories":3381},[],{"categories":3383},[212],{"categories":3385},[145],{"categories":3387},[145],{"categories":3389},[198],{"categories":3391},[193],{"categories":3393},[145],{"categories":3395},[],{"categories":3397},[145],{"categories":3399},[145],{"categories":3401},[2294],{"categories":3403},[],{"categories":3405},[145],{"categories":3407},[145],{"categories":3409},[145],{"categories":3411},[145],{"categories":3413},[286],{"categories":3415},[145],{"categories":3417},[],{"categories":3419},[145],{"categories":3421},[145],{"categories":3423},[145],{"categories":3425},[145],{"categories":3427},[315],{"categories":3429},[234],{"categories":3431},[145],{"categories":3433},[145],{"categories":3435},[1861],{"categories":3437},[188],{"categories":3439},[145],{"categories":3441},[145],{"categories":3443},[237],{"categories":3445},[145],{"categories":3447},[145],{"categories":3449},[234],{"categories":3451},[198],{"categories":3453},[],{"categories":3455},[145],{"categories":3457},[145],{"categories":3459},[286],{"categories":3461},[145],{"categories":3463},[315],{"categories":3465},[198],{"categories":3467},[145],{"categories":3469},[198],{"categories":3471},[],{"categories":3473},[],{"categories":3475},[],{"categories":3477},[188],{"categories":3479},[234],{"categories":3481},[198],{"categories":3483},[145],{"categories":3485},[145],{"categories":3487},[145],{"categories":3489},[145],{"categories":3491},[471],{"categories":3493},[286],{"categories":3495},[198],{"categories":3497},[145],{"categories":3499},[],{"categories":3501},[198],{"categories":3503},[198],{"categories":3505},[],{"categories":3507},[145],{"categories":3509},[198],{"categories":3511},[145],{"categories":3513},[],{"categories":3515},[145],{"categories":3517},[145],{"categories":3519},[145],{"categories":3521},[234],{"categories":3523},[286],{"categories":3525},[198],{"categories":3527},[286],{"categories":3529},[198],{"categories":3531},[145],{"categories":3533},[193],{"categories":3535},[],{"categories":3537},[],{"categories":3539},[145],{"categories":3541},[145],{"categories":3543},[145],{"categories":3545},[188],{"categories":3547},[198],{"categories":3549},[234],{"categories":3551},[],{"categories":3553},[286],{"categories":3555},[],{"categories":3557},[212],{"categories":3559},[145],{"categories":3561},[212],{"categories":3563},[286],{"categories":3565},[212],{"categories":3567},[145],{"categories":3569},[],{"categories":3571},[145],{"categories":3573},[145],{"categories":3575},[],{"categories":3577},[145],{"categories":3579},[315],{"categories":3581},[145],{"categories":3583},[356],{"categories":3585},[212],{"categories":3587},[145],{"categories":3589},[],{"categories":3591},[198],{"categories":3593},[145],{"categories":3595},[188],{"categories":3597},[584],{"categories":3599},[145],{"categories":3601},[145],{"categories":3603},[198],{"categories":3605},[145],{"categories":3607},[198],{"categories":3609},[145],{"categories":3611},[145],{"categories":3613},[145],{"categories":3615},[145],{"categories":3617},[],{"categories":3619},[145],{"categories":3621},[188],{"categories":3623},[145],{"categories":3625},[193],{"categories":3627},[212],{"categories":3629},[286],{"categories":3631},[],{"categories":3633},[145],{"categories":3635},[],{"categories":3637},[145],{"categories":3639},[],{"categories":3641},[198],{"categories":3643},[145],{"categories":3645},[212],{"categories":3647},[286],{"categories":3649},[234],{"categories":3651},[145],{"categories":3653},[234],{"categories":3655},[198],{"categories":3657},[286],{"categories":3659},[145],{"categories":3661},[],{"categories":3663},[145],{"categories":3665},[223],{"categories":3667},[198],{"categories":3669},[145],{"categories":3671},[286],{"categories":3673},[234],{"categories":3675},[193],{"categories":3677},[212],{"categories":3679},[145],{"categories":3681},[145],{"categories":3683},[145],{"categories":3685},[145],{"categories":3687},[234],{"categories":3689},[315],{"categories":3691},[],{"categories":3693},[],{"categories":3695},[237],{"categories":3697},[527],{"categories":3699},[145],{"categories":3701},[198],{"categories":3703},[145,212],{"categories":3705},[234],{"categories":3707},[145],{"categories":3709},[145],{"categories":3711},[145],{"categories":3713},[145],{"categories":3715},[145],{"categories":3717},[145],{"categories":3719},[198],{"categories":3721},[145],{"categories":3723},[198],{"categories":3725},[145],{"categories":3727},[145],{"categories":3729},[145],{"categories":3731},[],{"categories":3733},[145],{"categories":3735},[1301],{"categories":3737},[212],{"categories":3739},[286],{"categories":3741},[145],{"categories":3743},[145],{"categories":3745},[145],{"categories":3747},[237],{"categories":3749},[198],{"categories":3751},[315],{"categories":3753},[356],{"categories":3755},[],{"categories":3757},[212],{"categories":3759},[145],{"categories":3761},[193],{"categories":3763},[198],{"categories":3765},[188],{"categories":3767},[198],{"categories":3769},[145],{"categories":3771},[198],{"categories":3773},[198],{"categories":3775},[201],{"categories":3777},[212],{"categories":3779},[145],{"categories":3781},[145],{"categories":3783},[],{"categories":3785},[],{"categories":3787},[],{"categories":3789},[356],{"categories":3791},[145],{"categories":3793},[234],{"categories":3795},[145],{"categories":3797},[145],{"categories":3799},[145],{"categories":3801},[145],{"categories":3803},[],{"categories":3805},[145],{"categories":3807},[237],{"categories":3809},[193],{"categories":3811},[198],{"categories":3813},[145],{"categories":3815},[],{"categories":3817},[145],{"categories":3819},[198],{"categories":3821},[145],{"categories":3823},[356],{"categories":3825},[],{"categories":3827},[286],{"categories":3829},[286],{"categories":3831},[145],{"categories":3833},[198],{"categories":3835},[],{"categories":3837},[212],{"categories":3839},[145],{"categories":3841},[286],{"categories":3843},[145],{"categories":3845},[193],{"categories":3847},[198],{"categories":3849},[145],{"categories":3851},[],{"categories":3853},[234],{"categories":3855},[145],{"categories":3857},[145],{"categories":3859},[145],{"categories":3861},[286],{"categories":3863},[198],{"categories":3865},[234],{"categories":3867},[],{"categories":3869},[198],{"categories":3871},[193],{"categories":3873},[198],{"categories":3875},[286],{"categories":3877},[145],{"categories":3879},[145],{"categories":3881},[145],{"categories":3883},[527],{"categories":3885},[145],{"categories":3887},[198],{"categories":3889},[],{"categories":3891},[145],{"categories":3893},[145],{"categories":3895},[356],{"categories":3897},[234],{"categories":3899},[237],{"categories":3901},[630],{"categories":3903},[237],{"categories":3905},[237],{"categories":3907},[145],{"categories":3909},[],{"categories":3911},[],{"categories":3913},[],{"categories":3915},[198],{"categories":3917},[198],{"categories":3919},[198],{"categories":3921},[212],{"categories":3923},[145],{"categories":3925},[504],{"categories":3927},[212],{"categories":3929},[145],{"categories":3931},[145],{"categories":3933},[145],{"categories":3935},[145],{"categories":3937},[145],{"categories":3939},[198],{"categories":3941},[145],{"categories":3943},[],{"categories":3945},[],{"categories":3947},[145],{"categories":3949},[],{"categories":3951},[145],{"categories":3953},[198],{"categories":3955},[286],{"categories":3957},[145],{"categories":3959},[145],{"categories":3961},[],{"categories":3963},[198],{"categories":3965},[145],{"categories":3967},[145],{"categories":3969},[201],{"categories":3971},[145],{"categories":3973},[286],{"categories":3975},[145],{"categories":3977},[198],{"categories":3979},[193],{"categories":3981},[145],{"categories":3983},[145],{"categories":3985},[315],{"categories":3987},[198],{"categories":3989},[145],{"categories":3991},[145],{"categories":3993},[942],{"categories":3995},[145],{"categories":3997},[198],{"categories":3999},[145],{"categories":4001},[212],{"categories":4003},[145],{"categories":4005},[584],{"categories":4007},[286],{"categories":4009},[],{"categories":4011},[145],{"categories":4013},[145],{"categories":4015},[234],{"categories":4017},[527],{"categories":4019},[198],{"categories":4021},[145],{"categories":4023},[],{"categories":4025},[234],{"categories":4027},[448],{"categories":4029},[198],{"categories":4031},[198],{"categories":4033},[198],{"categories":4035},[145],{"categories":4037},[145],{"categories":4039},[198],{"categories":4041},[],{"categories":4043},[193],{"categories":4045},[145],{"categories":4047},[193],{"categories":4049},[198],{"categories":4051},[],{"categories":4053},[212],{"categories":4055},[145],{"categories":4057},[145],{"categories":4059},[188],{"categories":4061},[234],{"categories":4063},[356],{"categories":4065},[223],{"categories":4067},[198],{"categories":4069},[198],{"categories":4071},[145],{"categories":4073},[145],{"categories":4075},[198],{"categories":4077},[145],{"categories":4079},[188],{"categories":4081},[],{"categories":4083},[198],{"categories":4085},[145],{"categories":4087},[145],{"categories":4089},[145],{"categories":4091},[198],{"categories":4093},[145],{"categories":4095},[],{"categories":4097},[145],{"categories":4099},[],{"categories":4101},[286],{"categories":4103},[198],{"categories":4105},[145,193],{"categories":4107},[198],{"categories":4109},[145],{"categories":4111},[],{"categories":4113},[188],{"categories":4115},[237],{"categories":4117},[193],{"categories":4119},[145],{"categories":4121},[212],{"categories":4123},[145],{"categories":4125},[145],{"categories":4127},[198],{"categories":4129},[145],{"categories":4131},[145],{"categories":4133},[145],{"categories":4135},[234],{"categories":4137},[1301],{"categories":4139},[198],{"categories":4141},[145],{"categories":4143},[],{"categories":4145},[],{"categories":4147},[145],{"categories":4149},[198],{"categories":4151},[145],{"categories":4153},[145],{"categories":4155},[356],{"categories":4157},[],{"categories":4159},[145],{"categories":4161},[198],{"categories":4163},[223],{"categories":4165},[198],{"categories":4167},[527],{"categories":4169},[],{"categories":4171},[471],{"categories":4173},[198],{"categories":4175},[145],{"categories":4177},[145],{"categories":4179},[315],{"categories":4181},[198],{"categories":4183},[145],{"categories":4185},[237],{"categories":4187},[201],{"categories":4189},[198],{"categories":4191},[145],{"categories":4193},[527],{"categories":4195},[145],{"categories":4197},[356],{"categories":4199},[193],{"categories":4201},[],{"categories":4203},[145],{"categories":4205},[145],{"categories":4207},[315],{"categories":4209},[286],{"categories":4211},[145],{"categories":4213},[145],{"categories":4215},[145],{"categories":4217},[],{"categories":4219},[315],{"categories":4221},[234],{"categories":4223},[145],{"categories":4225},[145],{"categories":4227},[145],{"categories":4229},[630],{"categories":4231},[188],{"categories":4233},[145],{"categories":4235},[201],{"categories":4237},[145],{"categories":4239},[],{"categories":4241},[],{"categories":4243},[286],{"categories":4245},[145],{"categories":4247},[237],{"categories":4249},[315],{"categories":4251},[198],{"categories":4253},[145],{"categories":4255},[145],{"categories":4257},[315],{"categories":4259},[234],{"categories":4261},[145],{"categories":4263},[],{"categories":4265},[145],{"categories":4267},[145],{"categories":4269},[],{"categories":4271},[145],{"categories":4273},[145],{"categories":4275},[655],{"categories":4277},[145],{"categories":4279},[145],{"categories":4281},[198],{"categories":4283},[212],{"categories":4285},[527],{"categories":4287},[145],{"categories":4289},[145],{"categories":4291},[145],{"categories":4293},[],{"categories":4295},[145,212],{"categories":4297},[234],{"categories":4299},[198],{"categories":4301},[212],{"categories":4303},[198],{"categories":4305},[980],{"categories":4307},[212],{"categories":4309},[212],{"categories":4311},[198],{"categories":4313},[145],{"categories":4315},[188],{"categories":4317},[],{"categories":4319},[],{"categories":4321},[198],{"categories":4323},[145],{"categories":4325},[212],{"categories":4327},[145],{"categories":4329},[188],{"categories":4331},[212],{"categories":4333},[212],{"categories":4335},[145],{"categories":4337},[315],{"categories":4339},[145],{"categories":4341},[212],{"categories":4343},[145],{"categories":4345},[],{"categories":4347},[145],{"categories":4349},[145],{"categories":4351},[286,145],{"categories":4353},[356],{"categories":4355},[188],{"categories":4357},[145],{"categories":4359},[],{"categories":4361},[145],{"categories":4363},[145],{"categories":4365},[193],{"categories":4367},[145],{"categories":4369},[193],{"categories":4371},[145],{"categories":4373},[145],{"categories":4375},[448],{"categories":4377},[145],{"categories":4379},[193],{"categories":4381},[212],{"categories":4383},[237],{"categories":4385},[198],{"categories":4387},[145],{"categories":4389},[212],{"categories":4391},[145],{"categories":4393},[145],{"categories":4395},[234],{"categories":4397},[315],{"categories":4399},[286],{"categories":4401},[145],{"categories":4403},[145],{"categories":4405},[145],{"categories":4407},[145],{"categories":4409},[188],{"categories":4411},[145],{"categories":4413},[198],{"categories":4415},[198],{"categories":4417},[212],{"categories":4419},[234],{"categories":4421},[212],{"categories":4423},[212],{"categories":4425},[145],{"categories":4427},[145],{"categories":4429},[],{"categories":4431},[],{"categories":4433},[237],{"categories":4435},[145],{"categories":4437},[212],{"categories":4439},[145],{"categories":4441},[286],{"categories":4443},[527],{"categories":4445},[471],{"categories":4447},[448],{"categories":4449},[145],{"categories":4451},[145],{"categories":4453},[145],{"categories":4455},[237],{"categories":4457},[145],{"categories":4459},[145],{"categories":4461},[145],{"categories":4463},[145],{"categories":4465},[145],{"categories":4467},[145],{"categories":4469},[145],{"categories":4471},[198],{"categories":4473},[188],{"categories":4475},[198],{"categories":4477},[145,193],{"categories":4479},[],{"categories":4481},[286],{"categories":4483},[],{"categories":4485},[201],{"categories":4487},[145],{"categories":4489},[234],{"categories":4491},[188],{"categories":4493},[145],{"categories":4495},[188],{"categories":4497},[198],{"categories":4499},[237],{"categories":4501},[198],{"categories":4503},[201],{"categories":4505},[198],{"categories":4507},[145],{"categories":4509},[145],{"categories":4511},[193],{"categories":4513},[198],{"categories":4515},[212],{"categories":4517},[315],{"categories":4519},[145],{"categories":4521},[145],{"categories":4523},[],{"categories":4525},[234],{"categories":4527},[145],{"categories":4529},[145],{"categories":4531},[145],{"categories":4533},[145],{"categories":4535},[145],{"categories":4537},[145],{"categories":4539},[212],{"categories":4541},[234],{"categories":4543},[212],{"categories":4545},[212],{"categories":4547},[145],{"categories":4549},[145],{"categories":4551},[145],{"categories":4553},[145],{"categories":4555},[471],{"categories":4557},[145],{"categories":4559},[198],{"categories":4561},[234],{"categories":4563},[145],{"categories":4565},[145],{"categories":4567},[145],{"categories":4569},[198],{"categories":4571},[145],{"categories":4573},[145],{"categories":4575},[145],{"categories":4577},[3186],{"categories":4579},[4580],"Clinical AI",{"categories":4582},[286],{"categories":4584},[145],{"categories":4586},[145],{"categories":4588},[145],{"categories":4590},[145],{"categories":4592},[356],{"categories":4594},[2545],{"categories":4596},[145],{"categories":4598},[201],{"categories":4600},[286],{"categories":4602},[145],{"categories":4604},[198],{"categories":4606},[145],{"categories":4608},[145],{"categories":4610},[234],{"categories":4612},[145],{"categories":4614},[198],{"categories":4616},[212],{"categories":4618},[315],{"categories":4620},[145],{"categories":4622},[145],{"categories":4624},[193],{"categories":4626},[145],{"categories":4628},[145],{"categories":4630},[584],{"categories":4632},[145],{"categories":4634},[],{"categories":4636},[198],{"categories":4638},[145],{"categories":4640},[212],{"categories":4642},[188],{"categories":4644},[145],{"categories":4646},[],{"categories":4648},[],{"categories":4650},[145],{"categories":4652},[],{"categories":4654},[193],{"categories":4656},[145],{"categories":4658},[145],{"categories":4660},[198],{"categories":4662},[145],{"categories":4664},[234],{"categories":4666},[234],{"categories":4668},[234],{"categories":4670},[234],{"categories":4672},[],{"categories":4674},[188],{"categories":4676},[198],{"categories":4678},[234],{"categories":4680},[145],{"categories":4682},[655],{"categories":4684},[201],{"categories":4686},[198],{"categories":4688},[145],{"categories":4690},[188],{"categories":4692},[145],{"categories":4694},[198],{"categories":4696},[145],{"categories":4698},[145],{"categories":4700},[145],{"categories":4702},[145,198],{"categories":4704},[198],{"categories":4706},[356],{"categories":4708},[234],{"categories":4710},[198],{"categories":4712},[234],{"categories":4714},[198],{"categories":4716},[145],{"categories":4718},[],{"categories":4720},[234],{"categories":4722},[315],{"categories":4724},[188],{"categories":4726},[145],{"categories":4728},[145],{"categories":4730},[],{"categories":4732},[212],{"categories":4734},[],{"categories":4736},[188],{"categories":4738},[198],{"categories":4740},[234],{"categories":4742},[145],{"categories":4744},[234],{"categories":4746},[188],{"categories":4748},[234],{"categories":4750},[234],{"categories":4752},[],{"categories":4754},[193],{"categories":4756},[198],{"categories":4758},[234],{"categories":4760},[234],{"categories":4762},[234],{"categories":4764},[234],{"categories":4766},[234],{"categories":4768},[234],{"categories":4770},[234],{"categories":4772},[234],{"categories":4774},[234],{"categories":4776},[234],{"categories":4778},[237],{"categories":4780},[188],{"categories":4782},[145],{"categories":4784},[145],{"categories":4786},[198],{"categories":4788},[198],{"categories":4790},[],{"categories":4792},[145],{"categories":4794},[145,188],{"categories":4796},[],{"categories":4798},[198],{"categories":4800},[145],{"categories":4802},[234],{"categories":4804},[198],{"categories":4806},[980],{"categories":4808},[145],{"categories":4810},[145],{"categories":4812},[145],{"categories":4814},[145],{"categories":4816},[145],{"categories":4818},[448],{"categories":4820},[145],{"categories":4822},[145],{"categories":4824},[198],{"categories":4826},[145],{"categories":4828},[145],{"categories":4830},[193],{"categories":4832},[201],{"categories":4834},[198],{"categories":4836},[198],{"categories":4838},[],{"categories":4840},[198],{"categories":4842},[286],{"categories":4844},[234],{"categories":4846},[145],{"categories":4848},[],{"categories":4850},[201],{"categories":4852},[],{"categories":4854},[212],{"categories":4856},[145],{"categories":4858},[198],{"categories":4860},[286],{"categories":4862},[145],{"categories":4864},[],{"categories":4866},[145],{"categories":4868},[145],{"categories":4870},[],{"categories":4872},[315],{"categories":4874},[145],{"categories":4876},[198],{"categories":4878},[],{"categories":4880},[],{"categories":4882},[234],{"categories":4884},[188],{"categories":4886},[145],{"categories":4888},[145],{"categories":4890},[193],{"categories":4892},[145],{"categories":4894},[145],{"categories":4896},[198],{"categories":4898},[145],{"categories":4900},[193],{"categories":4902},[193],{"categories":4904},[286],{"categories":4906},[],{"categories":4908},[145],{"categories":4910},[234],{"categories":4912},[],{"categories":4914},[145],{"categories":4916},[145],{"categories":4918},[286],{"categories":4920},[145],{"categories":4922},[145],{"categories":4924},[315],{"categories":4926},[145],{"categories":4928},[356],{"categories":4930},[],{"categories":4932},[198],{"categories":4934},[145],{"categories":4936},[315],{"categories":4938},[212],{"categories":4940},[],{"categories":4942},[145],{"categories":4944},[],{"categories":4946},[198],{"categories":4948},[286],{"categories":4950},[212],{"categories":4952},[],{"categories":4954},[3186],{"categories":4956},[193],{"categories":4958},[188],{"categories":4960},[145],{"categories":4962},[237],{"categories":4964},[198],{"categories":4966},[286],{"categories":4968},[145],{"categories":4970},[212],{"categories":4972},[],{"categories":4974},[],{"categories":4976},[145],{"categories":4978},[188],{"categories":4980},[145],{"categories":4982},[315],{"categories":4984},[],{"categories":4986},[198],{"categories":4988},[198],{"categories":4990},[145],{"categories":4992},[198],{"categories":4994},[145],{"categories":4996},[234],{"categories":4998},[212],{"categories":5000},[145],{"categories":5002},[198],{"categories":5004},[201],{"categories":5006},[145],{"categories":5008},[145],{"categories":5010},[145],{"categories":5012},[198],{"categories":5014},[145],{"categories":5016},[201],{"categories":5018},[315],{"categories":5020},[234],{"categories":5022},[],{"categories":5024},[315],{"categories":5026},[145],{"categories":5028},[],{"categories":5030},[212],{"categories":5032},[198],{"categories":5034},[],{"categories":5036},[145],{"categories":5038},[145],{"categories":5040},[145],{"categories":5042},[145],{"categories":5044},[145],{"categories":5046},[198],{"categories":5048},[193],{"categories":5050},[188],{"categories":5052},[198],{"categories":5054},[145],{"categories":5056},[286],{"categories":5058},[212],{"categories":5060},[212],{"categories":5062},[145],{"categories":5064},[237],{"categories":5066},[198],{"categories":5068},[145],{"categories":5070},[145],{"categories":5072},[198],{"categories":5074},[145],{"categories":5076},[145],{"categories":5078},[198],{"categories":5080},[193],{"categories":5082},[145],{"categories":5084},[286],{"categories":5086},[212],{"categories":5088},[198],{"categories":5090},[145],{"categories":5092},[201],{"categories":5094},[145],{"categories":5096},[198],{"categories":5098},[145],{"categories":5100},[145],{"categories":5102},[234],{"categories":5104},[145],{"categories":5106},[],{"categories":5108},[188],{"categories":5110},[145],{"categories":5112},[145],{"categories":5114},[145],{"categories":5116},[212],{"categories":5118},[212],{"categories":5120},[145],{"categories":5122},[212],{"categories":5124},[145],{"categories":5126},[198],{"categories":5128},[145],{"categories":5130},[145],{"categories":5132},[145],{"categories":5134},[145],{"categories":5136},[145],{"categories":5138},[],{"categories":5140},[145],{"categories":5142},[286],{"categories":5144},[198],{"categories":5146},[193],{"categories":5148},[234],{"categories":5150},[145],{"categories":5152},[198],{"categories":5154},[145],{"categories":5156},[198],{"categories":5158},[145],{"categories":5160},[145],{"categories":5162},[286],{"categories":5164},[198],{"categories":5166},[145],{"categories":5168},[315],{"categories":5170},[145],{"categories":5172},[237],{"categories":5174},[145],{"categories":5176},[145],{"categories":5178},[234],{"categories":5180},[145],{"categories":5182},[145],{"categories":5184},[145],{"categories":5186},[145],{"categories":5188},[198],{"categories":5190},[356],{"categories":5192},[145],{"categories":5194},[212],{"categories":5196},[198],{"categories":5198},[237],{"categories":5200},[],{"categories":5202},[198],{"categories":5204},[212],{"categories":5206},[145],{"categories":5208},[145],{"categories":5210},[2383],{"categories":5212},[286],{"categories":5214},[385],{"categories":5216},[145],{"categories":5218},[145],{"categories":5220},[145],{"categories":5222},[145],{"categories":5224},[188],{"categories":5226},[145],{"categories":5228},[145],{"categories":5230},[212],{"categories":5232},[193],{"categories":5234},[145],{"categories":5236},[212],{"categories":5238},[145],{"categories":5240},[],{"categories":5242},[198],{"categories":5244},[198],{"categories":5246},[145],{"categories":5248},[145],{"categories":5250},[145],{"categories":5252},[237],{"categories":5254},[],{"categories":5256},[234],{"categories":5258},[],{"categories":5260},[234],{"categories":5262},[145],{"categories":5264},[145],{"categories":5266},[198],{"categories":5268},[145],{"categories":5270},[198],{"categories":5272},[198],{"categories":5274},[],{"categories":5276},[145],{"categories":5278},[234],{"categories":5280},[145],{"categories":5282},[],{"categories":5284},[145],{"categories":5286},[145],{"categories":5288},[],{"categories":5290},[145],{"categories":5292},[145],{"categories":5294},[286],{"categories":5296},[212],{"categories":5298},[198],{"categories":5300},[145],{"categories":5302},[145],{"categories":5304},[145],{"categories":5306},[145],{"categories":5308},[315],{"categories":5310},[145],{"categories":5312},[145],{"categories":5314},[145],{"categories":5316},[188],{"categories":5318},[145],{"categories":5320},[145],{"categories":5322},[],{"categories":5324},[145],{"categories":5326},[145],{"categories":5328},[145],{"categories":5330},[],{"categories":5332},[188],{"categories":5334},[145],{"categories":5336},[145],{"categories":5338},[234],{"categories":5340},[212],{"categories":5342},[201],{"categories":5344},[198],{"categories":5346},[527],{"categories":5348},[145],{"categories":5350},[145],{"categories":5352},[145],{"categories":5354},[212],{"categories":5356},[234],{"categories":5358},[286],{"categories":5360},[145],{"categories":5362},[145],{"categories":5364},[145],{"categories":5366},[145],{"categories":5368},[234],{"categories":5370},[145],{"categories":5372},[286],{"categories":5374},[145],{"categories":5376},[145],{"categories":5378},[234],{"categories":5380},[286],{"categories":5382},[145],{"categories":5384},[234],{"categories":5386},[145],{"categories":5388},[198],{"categories":5390},[198],{"categories":5392},[198],{"categories":5394},[212],{"categories":5396},[234],{"categories":5398},[198],{"categories":5400},[198],{"categories":5402},[145],{"categories":5404},[212],{"categories":5406},[286],{"categories":5408},[145],{"categories":5410},[145],{"categories":5412},[198],{"categories":5414},[145],{"categories":5416},[],{"categories":5418},[198],{"categories":5420},[],{"categories":5422},[145],{"categories":5424},[145],{"categories":5426},[],{"categories":5428},[],{"categories":5430},[198],{"categories":5432},[193],{"categories":5434},[198],{"categories":5436},[5437],"Liability & Ethics",{"categories":5439},[145],{"categories":5441},[145],{"categories":5443},[145],{"categories":5445},[198],{"categories":5447},[188],{"categories":5449},[198],{"categories":5451},[193],{"categories":5453},[315],{"categories":5455},[198],{"categories":5457},[145],{"categories":5459},[145],{"categories":5461},[],{"categories":5463},[630],{"categories":5465},[198],{"categories":5467},[],{"categories":5469},[145],{"categories":5471},[188],{"categories":5473},[198],{"categories":5475},[],{"categories":5477},[198],{"categories":5479},[145],{"categories":5481},[145],{"categories":5483},[212],{"categories":5485},[145],{"categories":5487},[234],{"categories":5489},[145],{"categories":5491},[145],{"categories":5493},[198],{"categories":5495},[145],{"categories":5497},[145],{"categories":5499},[145],{"categories":5501},[234],{"categories":5503},[198],{"categories":5505},[212],{"categories":5507},[286],{"categories":5509},[188],{"categories":5511},[145],{"categories":5513},[145],{"categories":5515},[145],{"categories":5517},[],{"categories":5519},[198],{"categories":5521},[198],{"categories":5523},[198],{"categories":5525},[527],{"categories":5527},[286],{"categories":5529},[198],{"categories":5531},[356],{"categories":5533},[212],{"categories":5535},[234],{"categories":5537},[145],{"categories":5539},[286],{"categories":5541},[145],{"categories":5543},[188],{"categories":5545},[],{"categories":5547},[198],{"categories":5549},[145],{"categories":5551},[145],{"categories":5553},[145],{"categories":5555},[145],{"categories":5557},[198],{"categories":5559},[145],{"categories":5561},[145],{"categories":5563},[286],{"categories":5565},[],{"categories":5567},[198],{"categories":5569},[201],{"categories":5571},[234],{"categories":5573},[198],{"categories":5575},[193],{"categories":5577},[],{"categories":5579},[145],{"categories":5581},[145],{"categories":5583},[201],{"categories":5585},[145],{"categories":5587},[198],{"categories":5589},[234],{"categories":5591},[188],{"categories":5593},[356],{"categories":5595},[145],{"categories":5597},[145],{"categories":5599},[145],{"categories":5601},[234],{"categories":5603},[193],{"categories":5605},[145],{"categories":5607},[286],{"categories":5609},[234],{"categories":5611},[356],{"categories":5613},[145],{"categories":5615},[198],{"categories":5617},[],{"categories":5619},[584],{"categories":5621},[],{"categories":5623},[145],{"categories":5625},[356],{"categories":5627},[145],{"categories":5629},[237],{"categories":5631},[145],{"categories":5633},[198],{"categories":5635},[198],{"categories":5637},[5638],"Design News & Tools",{"categories":5640},[145],{"categories":5642},[234],{"categories":5644},[145],{"categories":5646},[145],{"categories":5648},[188],{"categories":5650},[198],{"categories":5652},[145],{"categories":5654},[286],{"categories":5656},[198],{"categories":5658},[198],{"categories":5660},[286],{"categories":5662},[145],{"categories":5664},[527],{"categories":5666},[198],{"categories":5668},[145],{"categories":5670},[145],{"categories":5672},[527],{"categories":5674},[145],{"categories":5676},[315],{"categories":5678},[145],{"categories":5680},[198],{"categories":5682},[],{"categories":5684},[145],{"categories":5686},[145],{"categories":5688},[145],{"categories":5690},[234],{"categories":5692},[145],{"categories":5694},[188],{"categories":5696},[],{"categories":5698},[145],{"categories":5700},[145],{"categories":5702},[145],{"categories":5704},[212],{"categories":5706},[655],{"categories":5708},[212],{"categories":5710},[286],{"categories":5712},[145],{"categories":5714},[145,198],{"categories":5716},[315,193],{"categories":5718},[212],{"categories":5720},[145],{"categories":5722},[145],{"categories":5724},[145],{"categories":5726},[145],{"categories":5728},[],{"categories":5730},[198],{"categories":5732},[145],{"categories":5734},[],{"categories":5736},[145],{"categories":5738},[212],{"categories":5740},[145],{"categories":5742},[212],{"categories":5744},[],{"categories":5746},[198],{"categories":5748},[145],{"categories":5750},[193],{"categories":5752},[145],{"categories":5754},[234],{"categories":5756},[145],{"categories":5758},[],{"categories":5760},[198],{"categories":5762},[145],{"categories":5764},[],{"categories":5766},[286],{"categories":5768},[145],{"categories":5770},[145],{"categories":5772},[198],{"categories":5774},[145],{"categories":5776},[145],{"categories":5778},[188],{"categories":5780},[198],{"categories":5782},[145],{"categories":5784},[],{"categories":5786},[145],{"categories":5788},[356],{"categories":5790},[315],{"categories":5792},[193],{"categories":5794},[193],{"categories":5796},[145],{"categories":5798},[188],{"categories":5800},[188],{"categories":5802},[145],{"categories":5804},[198],{"categories":5806},[145],{"categories":5808},[145],{"categories":5810},[145],{"categories":5812},[145],{"categories":5814},[212],{"categories":5816},[145],{"categories":5818},[188],{"categories":5820},[145],{"categories":5822},[145],{"categories":5824},[198],{"categories":5826},[145],{"categories":5828},[315],{"categories":5830},[145],{"categories":5832},[234],{"categories":5834},[145],{"categories":5836},[145],{"categories":5838},[198],{"categories":5840},[201],{"categories":5842},[145],{"categories":5844},[145],{"categories":5846},[198],{"categories":5848},[],{"categories":5850},[212],{"categories":5852},[],{"categories":5854},[212],{"categories":5856},[198],{"categories":5858},[188],{"categories":5860},[145],{"categories":5862},[],{"categories":5864},[237],{"categories":5866},[356],{"categories":5868},[145],{"categories":5870},[212],{"categories":5872},[145],{"categories":5874},[],{"categories":5876},[234],{"categories":5878},[198],{"categories":5880},[212],{"categories":5882},[286],{"categories":5884},[193],{"categories":5886},[145],{"categories":5888},[145],{"categories":5890},[198],{"categories":5892},[212],{"categories":5894},[198],{"categories":5896},[234],{"categories":5898},[145],{"categories":5900},[201],{"categories":5902},[188],{"categories":5904},[201],{"categories":5906},[234],{"categories":5908},[145],{"categories":5910},[212],{"categories":5912},[145],{"categories":5914},[286],{"categories":5916},[193],{"categories":5918},[145],{"categories":5920},[145],{"categories":5922},[145],{"categories":5924},[145],{"categories":5926},[145],{"categories":5928},[145],{"categories":5930},[198],{"categories":5932},[145],{"categories":5934},[198],{"categories":5936},[145],{"categories":5938},[145],{"categories":5940},[188],{"categories":5942},[145],{"categories":5944},[198],{"categories":5946},[198],{"categories":5948},[286],{"categories":5950},[198],{"categories":5952},[198],{"categories":5954},[145],{"categories":5956},[188],{"categories":5958},[198],{"categories":5960},[286],{"categories":5962},[],{"categories":5964},[145],{"categories":5966},[237],{"categories":5968},[527],{"categories":5970},[145],{"categories":5972},[145],{"categories":5974},[145],{"categories":5976},[212],{"categories":5978},[145],{"categories":5980},[],{"categories":5982},[145],{"categories":5984},[198],{"categories":5986},[145],{"categories":5988},[315],{"categories":5990},[145],{"categories":5992},[212],{"categories":5994},[145],{"categories":5996},[234],{"categories":5998},[198],{"categories":6000},[145],{"categories":6002},[315],{"categories":6004},[198],{"categories":6006},[193],{"categories":6008},[193],{"categories":6010},[145],{"categories":6012},[145],{"categories":6014},[145],{"categories":6016},[145],{"categories":6018},[145],{"categories":6020},[145],{"categories":6022},[188],{"categories":6024},[],{"categories":6026},[145],{"categories":6028},[145],{"categories":6030},[198],{"categories":6032},[198],{"categories":6034},[145],{"categories":6036},[145],{"categories":6038},[145],{"categories":6040},[145],{"categories":6042},[145],{"categories":6044},[212],{"categories":6046},[],{"categories":6048},[188],{"categories":6050},[145],{"categories":6052},[145],{"categories":6054},[198],{"categories":6056},[198],{"categories":6058},[],{"categories":6060},[212],{"categories":6062},[212],{"categories":6064},[145],{"categories":6066},[315],{"categories":6068},[193],{"categories":6070},[286],{"categories":6072},[],{"categories":6074},[145],{"categories":6076},[198],{"categories":6078},[188],{"categories":6080},[145],{"categories":6082},[145],{"categories":6084},[212],{"categories":6086},[188],{"categories":6088},[145],{"categories":6090},[145],{"categories":6092},[234],{"categories":6094},[237],{"categories":6096},[145],{"categories":6098},[234],{"categories":6100},[198],{"categories":6102},[145],{"categories":6104},[],{"categories":6106},[234],{"categories":6108},[198],{"categories":6110},[286],{"categories":6112},[237],{"categories":6114},[145],{"categories":6116},[145],{"categories":6118},[],{"categories":6120},[198],{"categories":6122},[198],{"categories":6124},[198],{"categories":6126},[3186],{"categories":6128},[234],{"categories":6130},[145],{"categories":6132},[212],{"categories":6134},[145],{"categories":6136},[145],{"categories":6138},[145],{"categories":6140},[145],{"categories":6142},[145],{"categories":6144},[193],{"categories":6146},[145],{"categories":6148},[188],{"categories":6150},[1861],{"categories":6152},[356],{"categories":6154},[188],{"categories":6156},[],{"categories":6158},[145],{"categories":6160},[],{"categories":6162},[234],{"categories":6164},[198],{"categories":6166},[286],{"categories":6168},[145],{"categories":6170},[145],{"categories":6172},[145],{"categories":6174},[234],{"categories":6176},[],{"categories":6178},[198],{"categories":6180},[145],{"categories":6182},[198],{"categories":6184},[198],{"categories":6186},[],{"categories":6188},[145],{"categories":6190},[],{"categories":6192},[234],{"categories":6194},[188],{"categories":6196},[286],{"categories":6198},[145],{"categories":6200},[198],{"categories":6202},[234],{"categories":6204},[145],{"categories":6206},[234],{"categories":6208},[],{"categories":6210},[234],{"categories":6212},[145],{"categories":6214},[188],{"categories":6216},[527],{"categories":6218},[198],{"categories":6220},[145],{"categories":6222},[],{"categories":6224},[212],{"categories":6226},[198],{"categories":6228},[201],{"categories":6230},[198],{"categories":6232},[188],{"categories":6234},[145],{"categories":6236},[145],{"categories":6238},[],{"categories":6240},[],{"categories":6242},[],{"categories":6244},[286],{"categories":6246},[145],{"categories":6248},[198],{"categories":6250},[145],{"categories":6252},[145],{"categories":6254},[],{"categories":6256},[],{"categories":6258},[],{"categories":6260},[145],{"categories":6262},[198],{"categories":6264},[286],{"categories":6266},[145],{"categories":6268},[],{"categories":6270},[198],{"categories":6272},[145],{"categories":6274},[145],{"categories":6276},[188],{"categories":6278},[],{"categories":6280},[],{"categories":6282},[145],{"categories":6284},[145],{"categories":6286},[198],{"categories":6288},[286],{"categories":6290},[145],{"categories":6292},[234],{"categories":6294},[],{"categories":6296},[145],{"categories":6298},[145],{"categories":6300},[315],{"categories":6302},[234],{"categories":6304},[315],{"categories":6306},[237],{"categories":6308},[145],{"categories":6310},[145],{"categories":6312},[],{"categories":6314},[],{"categories":6316},[198],{"categories":6318},[],{"categories":6320},[145],{"categories":6322},[527],{"categories":6324},[145],{"categories":6326},[145],{"categories":6328},[145],{"categories":6330},[145],{"categories":6332},[],{"categories":6334},[198],{"categories":6336},[145],{"categories":6338},[145],{"categories":6340},[],{"categories":6342},[198],{"categories":6344},[145],{"categories":6346},[234],{"categories":6348},[145],{"categories":6350},[315],{"categories":6352},[193],{"categories":6354},[201],{"categories":6356},[145],{"categories":6358},[145],{"categories":6360},[198],{"categories":6362},[237],{"categories":6364},[198],{"categories":6366},[198],{"categories":6368},[],{"categories":6370},[145],{"categories":6372},[198],{"categories":6374},[],{"categories":6376},[145],{"categories":6378},[],{"categories":6380},[234],{"categories":6382},[193],{"categories":6384},[],{"categories":6386},[145],{"categories":6388},[145],{"categories":6390},[],{"categories":6392},[198],{"categories":6394},[286],{"categories":6396},[188],{"categories":6398},[145],{"categories":6400},[],{"categories":6402},[193],{"categories":6404},[315],{"categories":6406},[145],{"categories":6408},[212],{"categories":6410},[188],{"categories":6412},[237],{"categories":6414},[193],{"categories":6416},[212],{"categories":6418},[198],{"categories":6420},[212],{"categories":6422},[],{"categories":6424},[145],{"categories":6426},[201],{"categories":6428},[145],{"categories":6430},[],{"categories":6432},[198],{"categories":6434},[188],{"categories":6436},[286],{"categories":6438},[145],{"categories":6440},[188],{"categories":6442},[198],{"categories":6444},[356],{"categories":6446},[145],{"categories":6448},[145],{"categories":6450},[145],{"categories":6452},[145],{"categories":6454},[188],{"categories":6456},[145],{"categories":6458},[237],{"categories":6460},[198],{"categories":6462},[],{"categories":6464},[145],{"categories":6466},[145],{"categories":6468},[145],{"categories":6470},[212],{"categories":6472},[198],{"categories":6474},[234],{"categories":6476},[212],{"categories":6478},[145],{"categories":6480},[201],{"categories":6482},[],{"categories":6484},[286],{"categories":6486},[212],{"categories":6488},[234],{"categories":6490},[188],{"categories":6492},[198],{"categories":6494},[145],{"categories":6496},[145],{"categories":6498},[198],{"categories":6500},[201],{"categories":6502},[145],{"categories":6504},[198],{"categories":6506},[145],{"categories":6508},[193],{"categories":6510},[198],{"categories":6512},[198,356],{"categories":6514},[145],{"categories":6516},[145],{"categories":6518},[198],{"categories":6520},[212],{"categories":6522},[145],{"categories":6524},[145],{"categories":6526},[237],{"categories":6528},[198],{"categories":6530},[315],{"categories":6532},[198],{"categories":6534},[193],{"categories":6536},[],{"categories":6538},[198],{"categories":6540},[145],{"categories":6542},[193],{"categories":6544},[],{"categories":6546},[],{"categories":6548},[212],{"categories":6550},[145],{"categories":6552},[145],{"categories":6554},[198],{"categories":6556},[237],{"categories":6558},[315],{"categories":6560},[145],{"categories":6562},[145],{"categories":6564},[145],{"categories":6566},[198],{"categories":6568},[],{"categories":6570},[198],{"categories":6572},[234],{"categories":6574},[145],{"categories":6576},[198],{"categories":6578},[198],{"categories":6580},[145],{"categories":6582},[],{"categories":6584},[234],{"categories":6586},[212],{"categories":6588},[3186],{"categories":6590},[188],{"categories":6592},[212],{"categories":6594},[145],{"categories":6596},[198],{"categories":6598},[145],{"categories":6600},[145],{"categories":6602},[315],{"categories":6604},[212],{"categories":6606},[237],{"categories":6608},[],{"categories":6610},[234],{"categories":6612},[145],{"categories":6614},[145],{"categories":6616},[],{"categories":6618},[198],{"categories":6620},[145],{"categories":6622},[145],{"categories":6624},[145],{"categories":6626},[145],{"categories":6628},[198],{"categories":6630},[145],{"categories":6632},[145],{"categories":6634},[145],{"categories":6636},[201],{"categories":6638},[145],{"categories":6640},[198],{"categories":6642},[145],{"categories":6644},[145],{"categories":6646},[145],{"categories":6648},[145],{"categories":6650},[145],{"categories":6652},[145],{"categories":6654},[145],{"categories":6656},[193],{"categories":6658},[],{"categories":6660},[201],{"categories":6662},[234],{"categories":6664},[198],{"categories":6666},[145],{"categories":6668},[212],{"categories":6670},[],{"categories":6672},[212],{"categories":6674},[212],{"categories":6676},[198],{"categories":6678},[212],{"categories":6680},[145],{"categories":6682},[145],{"categories":6684},[145],{"categories":6686},[198],{"categories":6688},[212],{"categories":6690},[145],{"categories":6692},[145],{"categories":6694},[145],{"categories":6696},[198],{"categories":6698},[234],{"categories":6700},[145],{"categories":6702},[145],{"categories":6704},[145],{"categories":6706},[193],{"categories":6708},[145],{"categories":6710},[198],{"categories":6712},[286],{"categories":6714},[],{"categories":6716},[145],{"categories":6718},[237],{"categories":6720},[198],{"categories":6722},[145],{"categories":6724},[145],{"categories":6726},[],{"categories":6728},[145],{"categories":6730},[145],{"categories":6732},[234],{"categories":6734},[145],{"categories":6736},[145],{"categories":6738},[198],{"categories":6740},[315],{"categories":6742},[],{"categories":6744},[],{"categories":6746},[212],{"categories":6748},[145],{"categories":6750},[145],{"categories":6752},[234],{"categories":6754},[145],{"categories":6756},[212],{"categories":6758},[234],{"categories":6760},[145],{"categories":6762},[145],{"categories":6764},[315],{"categories":6766},[237],{"categories":6768},[145],{"categories":6770},[145],{"categories":6772},[188],{"categories":6774},[198],{"categories":6776},[145],{"categories":6778},[145],{"categories":6780},[198],{"categories":6782},[193],{"categories":6784},[198],{"categories":6786},[212],{"categories":6788},[145],{"categories":6790},[193],{"categories":6792},[],{"categories":6794},[145],{"categories":6796},[237],{"categories":6798},[145],{"categories":6800},[145],{"categories":6802},[],{"categories":6804},[234],{"categories":6806},[145],{"categories":6808},[198],{"categories":6810},[237],{"categories":6812},[145],{"categories":6814},[212],{"categories":6816},[212],{"categories":6818},[212],{"categories":6820},[145],{"categories":6822},[198],{"categories":6824},[198],{"categories":6826},[145],{"categories":6828},[198],{"categories":6830},[145],{"categories":6832},[145],{"categories":6834},[286],{"categories":6836},[237],{"categories":6838},[237],{"categories":6840},[],{"categories":6842},[234],{"categories":6844},[145],{"categories":6846},[145],{"categories":6848},[212],{"categories":6850},[],{"categories":6852},[234],{"categories":6854},[234],{"categories":6856},[234],{"categories":6858},[],{"categories":6860},[198],{"categories":6862},[145],{"categories":6864},[],{"categories":6866},[188],{"categories":6868},[193],{"categories":6870},[],{"categories":6872},[145],{"categories":6874},[145],{"categories":6876},[],{"categories":6878},[212],{"categories":6880},[],{"categories":6882},[],{"categories":6884},[],{"categories":6886},[],{"categories":6888},[145],{"categories":6890},[234],{"categories":6892},[],{"categories":6894},[],{"categories":6896},[145],{"categories":6898},[145],{"categories":6900},[145],{"categories":6902},[237],{"categories":6904},[145],{"categories":6906},[237],{"categories":6908},[],{"categories":6910},[237],{"categories":6912},[237],{"categories":6914},[356],{"categories":6916},[198],{"categories":6918},[212],{"categories":6920},[],{"categories":6922},[],{"categories":6924},[237],{"categories":6926},[212],{"categories":6928},[212],{"categories":6930},[212],{"categories":6932},[],{"categories":6934},[188],{"categories":6936},[212],{"categories":6938},[212],{"categories":6940},[188],{"categories":6942},[212],{"categories":6944},[193],{"categories":6946},[212],{"categories":6948},[212],{"categories":6950},[212],{"categories":6952},[237],{"categories":6954},[234],{"categories":6956},[234],{"categories":6958},[145],{"categories":6960},[212],{"categories":6962},[237],{"categories":6964},[356],{"categories":6966},[237],{"categories":6968},[237],{"categories":6970},[237],{"categories":6972},[],{"categories":6974},[193],{"categories":6976},[],{"categories":6978},[356],{"categories":6980},[212],{"categories":6982},[212],{"categories":6984},[212],{"categories":6986},[198],{"categories":6988},[234,193],{"categories":6990},[237],{"categories":6992},[],{"categories":6994},[],{"categories":6996},[237],{"categories":6998},[],{"categories":7000},[237],{"categories":7002},[234],{"categories":7004},[198],{"categories":7006},[],{"categories":7008},[212],{"categories":7010},[145],{"categories":7012},[286],{"categories":7014},[],{"categories":7016},[145],{"categories":7018},[],{"categories":7020},[234],{"categories":7022},[188],{"categories":7024},[237],{"categories":7026},[],{"categories":7028},[212],{"categories":7030},[234],[7032,7118,7228,7306],{"id":7033,"title":7034,"ai":7035,"body":7040,"categories":7088,"created_at":146,"date_modified":146,"description":138,"extension":147,"faq":146,"featured":148,"kicker_label":146,"meta":7089,"navigation":162,"path":7103,"published_at":7104,"question":146,"scraped_at":7105,"seo":7106,"sitemap":7107,"source_id":7108,"source_name":7109,"source_type":170,"source_url":7110,"stem":7111,"tags":7112,"thumbnail_url":7113,"tldr":7114,"tweet":7115,"unknown_tags":7116,"__hash__":7117},"summaries\u002Fsummaries\u002Fc76e27ecccda7886-scaling-compute-on-context-moving-beyond-public-da-summary.md","Scaling Compute on Context: Moving Beyond Public Data",{"provider":7,"model":8,"input_tokens":7036,"output_tokens":7037,"processing_time_ms":7038,"cost_usd":7039},8225,609,3108,0.00296975,{"type":14,"value":7041,"toc":7083},[7042,7046,7049,7053,7056,7076,7080],[17,7043,7045],{"id":7044},"the-limitation-of-public-data","The Limitation of Public Data",[22,7047,7048],{},"Modern AI models are defined by three scaling axes: more data, more compute, and larger models. While this has driven the deep learning revolution, it relies entirely on public data (Wikipedia, GitHub, arXiv). Consequently, models lack 'depth' in private domains—they cannot learn your specific emails, company meetings, or niche technical skills (like AMD kernels) because these are not part of the public corpus. Training from scratch on private data is impractical, and simply performing next-token prediction on a private corpus leads to 'collapsed generation,' where the model memorizes the data perfectly but loses its ability to generalize or reason.",[17,7050,7052],{"id":7051},"the-failure-of-current-approaches","The Failure of Current Approaches",[22,7054,7055],{},"Researchers have attempted several methods to bridge this gap, but each hits a ceiling:",[46,7057,7058,7064,7070],{},[49,7059,7060,7063],{},[26,7061,7062],{},"KV Compaction:"," Attempts to compress long contexts into a succinct representation. This is limited by the initial context window and fails to leverage the power of gradient updates.",[49,7065,7066,7069],{},[26,7067,7068],{},"On-Policy Distillation:"," Uses the model to generate synthetic data (often Q&A pairs) to simulate pretraining. While effective, it eventually hits a 'synthetic data wall.' Once the model absorbs the synthetic dataset, adding more compute yields diminishing returns rather than the depth observed in original pretraining.",[49,7071,7072,7075],{},[26,7073,7074],{},"Continued Pretraining:"," Fine-tuning on synthetic data conditioned on the private corpus. This often overwrites previous pretraining knowledge and is difficult to scale, especially when starting from a post-trained model rather than a raw base model.",[17,7077,7079],{"id":7078},"the-path-to-recursive-self-improvement","The Path to Recursive Self-Improvement",[22,7081,7082],{},"The goal is to move from static training to a process that mimics the success of AlphaGo, where the model's improvement makes its own training tasks progressively harder. Instead of a fixed dataset, the system must recursively generate better data as the model's internal representation of the domain (the 'value function') deepens. This approach treats the data budget as dynamic rather than fixed, allowing for the application of compute to deepen the model's understanding of a specific context over time, rather than simply memorizing it.",{"title":138,"searchDepth":139,"depth":139,"links":7084},[7085,7086,7087],{"id":7044,"depth":139,"text":7045},{"id":7051,"depth":139,"text":7052},{"id":7078,"depth":139,"text":7079},[145],{"content_references":7090,"triage":7099},[7091,7095],{"type":7092,"title":7093,"author":7094,"context":154},"paper","Cartridges: Self-study for LLMs","Unknown",{"type":7096,"title":7097,"url":7098,"context":154},"tool","Engram","https:\u002F\u002Fengram.com",{"relevance":159,"novelty":7100,"quality":159,"actionability":7100,"composite":7101,"reasoning":7102},3,3.6,"Category: AI & LLMs. The article discusses the limitations of current AI models in utilizing public data and proposes a novel approach of recursive self-improvement to enhance model understanding of private data, addressing a specific pain point for AI developers. While it presents some actionable insights, it lacks detailed frameworks or step-by-step guidance for implementation.","\u002Fsummaries\u002Fc76e27ecccda7886-scaling-compute-on-context-moving-beyond-public-da-summary","2026-08-12 15:30:14","2026-08-13 03:25:10",{"title":7034,"description":138},{"loc":7103},"c76e27ecccda7886","AI Engineer","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=WiqDvX6isc4","summaries\u002Fc76e27ecccda7886-scaling-compute-on-context-moving-beyond-public-da-summary",[174,175,177,176],"https:\u002F\u002Fi.ytimg.com\u002Fvi\u002FWiqDvX6isc4\u002Fhqdefault.jpg","Current AI models excel on public data but fail to acquire deep, personalized knowledge. The solution lies in 'scaling compute on context'—using recursive self-improvement to deepen a model's understanding of private data without hitting a synthetic data wall.","This talk frames the current limitation of AI as a \"data axis\" problem: models excel at public information but fail to gain depth on private, non-public corpora because training from scratch is impractical. The speaker argues that since the data budget is effectively fixed for personal or enterprise use, the only remaining path to improvement is \"scaling compute on context\"—a search for ways to apply deep learning's scaling laws to private data without hitting a synthetic data wall.",[],"Hp1q0M0nAWrXWdiLm_8SlhqKLTecqmGprG6lXyEn_FQ",{"id":7119,"title":7120,"ai":7121,"body":7126,"categories":7202,"created_at":146,"date_modified":146,"description":138,"extension":147,"faq":146,"featured":148,"kicker_label":146,"meta":7203,"navigation":162,"path":7215,"published_at":7216,"question":146,"scraped_at":7217,"seo":7218,"sitemap":7219,"source_id":7220,"source_name":7109,"source_type":170,"source_url":7221,"stem":7222,"tags":7223,"thumbnail_url":146,"tldr":7224,"tweet":7225,"unknown_tags":7226,"__hash__":7227},"summaries\u002Fsummaries\u002F6cf49539e4192bcf-scaling-continual-learning-with-on-policy-self-dis-summary.md","Scaling Continual Learning with On-Policy Self-Distillation",{"provider":7,"model":8,"input_tokens":7122,"output_tokens":7123,"processing_time_ms":7124,"cost_usd":7125},8152,719,3387,0.0031165,{"type":14,"value":7127,"toc":7197},[7128,7132,7135,7139,7142,7145,7165,7169,7172,7194],[17,7129,7131],{"id":7130},"the-limitations-of-current-rl-paradigms","The Limitations of Current RL Paradigms",[22,7133,7134],{},"Modern AI training relies heavily on benchmarks that are becoming increasingly expensive and time-consuming to scale. Current methods like GRPO (Group Relative Policy Optimization) require massive parallel infrastructure to generate on-policy rollouts and rely on sparse, sequence-level rewards. This creates a \"trillion-token problem\" where models fail to learn from the vast amounts of real-world inference data generated daily. The core challenge is moving toward a system that features online task distributions, on-policy sampling, minimal infrastructure requirements, and dense, per-token feedback.",[17,7136,7138],{"id":7137},"on-policy-self-distillation-opsd","On-Policy Self-Distillation (OPSD)",[22,7140,7141],{},"OPSD addresses these bottlenecks by replacing fixed datasets with student-generated rollouts. The algorithm functions by providing a \"hint\" (privileged information) to a teacher model, then training the student model to match the teacher's log probabilities.",[22,7143,7144],{},"Key advantages include:",[46,7146,7147,7153,7159],{},[49,7148,7149,7152],{},[26,7150,7151],{},"Infrastructure Efficiency:"," Unlike GRPO, which requires parallel rollouts, OPSD works with single-example trajectories, removing the environment bottleneck.",[49,7154,7155,7158],{},[26,7156,7157],{},"Dense Feedback:"," By matching log probabilities at the token level rather than the sequence level, the model receives rich, granular feedback across the entire vocabulary.",[49,7160,7161,7164],{},[26,7162,7163],{},"Distribution Shifting:"," OPSD doesn't just sharpen existing distributions; it shifts them, allowing models to explore new solution spaces and improve token efficiency.",[17,7166,7168],{"id":7167},"scaling-challenges-and-solutions","Scaling Challenges and Solutions",[22,7170,7171],{},"As models scale (e.g., 120B+ parameters) and tasks become more complex (e.g., 100+ tool calls), OPSD faces two primary failure modes: the \"but-wait\" problem and hint leakage.",[46,7173,7174,7184],{},[49,7175,7176,7179,7180,7183],{},[26,7177,7178],{},"The \"But-Wait\" Problem:"," In long-horizon tasks, the student and teacher distributions diverge, causing the model to collapse into suboptimal, repetitive hedging (e.g., \"but,\" \"maybe,\" \"wait\"). This is mitigated by ",[26,7181,7182],{},"step-level divergence weighting",", where the KL divergence between student and teacher is used to dynamically weight tokens. This allows the model to ignore off-track segments while focusing on productive reasoning steps.",[49,7185,7186,7189,7190,7193],{},[26,7187,7188],{},"Hint Leakage:"," If the hint provides the answer directly, the model \"shortcuts\" its reasoning process. This is solved via ",[26,7191,7192],{},"residual guidance",", where the model is trained on a linear combination of partial and full hints. This prevents the model from shifting into unknown territory by ensuring the guidance remains close to the model's current distribution.",[22,7195,7196],{},"By combining these techniques, OPSD can surpass traditional RL performance in agentic tasks, providing a path toward systems that improve automatically with every real-world interaction.",{"title":138,"searchDepth":139,"depth":139,"links":7198},[7199,7200,7201],{"id":7130,"depth":139,"text":7131},{"id":7137,"depth":139,"text":7138},{"id":7167,"depth":139,"text":7168},[145],{"content_references":7204,"triage":7212},[7205,7209],{"type":7096,"title":7206,"url":7207,"context":7208},"Open Claw","https:\u002F\u002Fgithub.com\u002Fopen-claw\u002Fclaw","recommended",{"type":7096,"title":7210,"url":7211,"context":154},"LiveCodeBench","https:\u002F\u002Flivecodebench.github.io\u002F",{"relevance":159,"novelty":159,"quality":159,"actionability":7100,"composite":7213,"reasoning":7214},3.8,"Category: AI & LLMs. The article discusses On-Policy Self-Distillation (OPSD), which directly addresses the limitations of current reinforcement learning paradigms, a relevant topic for AI product builders. It provides insights into overcoming infrastructure challenges and improving model training, which aligns with the audience's need for practical applications in AI. However, while it offers valuable information, it lacks specific actionable steps for implementation.","\u002Fsummaries\u002F6cf49539e4192bcf-scaling-continual-learning-with-on-policy-self-dis-summary","2026-08-12 14:30:11","2026-08-13 03:25:20",{"title":7120,"description":138},{"loc":7215},"6cf49539e4192bcf","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=zL1kLftVTlo","summaries\u002F6cf49539e4192bcf-scaling-continual-learning-with-on-policy-self-dis-summary",[174,176,177,175],"On-Policy Self-Distillation (OPSD) enables models to learn continuously from real-world data by using privileged hints to guide training, overcoming the infrastructure and reward-density limitations of traditional RLHF and GRPO.","This is a technical talk proposing \"On-Policy Self-Distillation\" (OPSD) as a more efficient alternative to GRPO for training LLMs. The speaker argues that by using \"privileged information\" as a hint in the prompt, you can train models on-policy without the need for massive parallel rollouts or sequence-level rewards.",[],"vhAr8zjS2WBCPA3tk7FLWmZs8sGVkc4pKRjYggsoalU",{"id":7229,"title":7230,"ai":7231,"body":7236,"categories":7267,"created_at":146,"date_modified":146,"description":138,"extension":147,"faq":146,"featured":148,"kicker_label":146,"meta":7268,"navigation":162,"path":7292,"published_at":7293,"question":146,"scraped_at":7294,"seo":7295,"sitemap":7296,"source_id":7297,"source_name":7109,"source_type":170,"source_url":7298,"stem":7299,"tags":7300,"thumbnail_url":7301,"tldr":7302,"tweet":7303,"unknown_tags":7304,"__hash__":7305},"summaries\u002Fsummaries\u002F1ccade4e93cfe410-the-base-model-s-evolution-from-web-mirror-to-reas-summary.md","The Base Model's Evolution: From Web Mirror to Reasoning Prior",{"provider":7,"model":8,"input_tokens":7232,"output_tokens":7233,"processing_time_ms":7234,"cost_usd":7235},6677,840,4112,0.00292925,{"type":14,"value":7237,"toc":7262},[7238,7242,7245,7249,7252,7256,7259],[17,7239,7241],{"id":7240},"the-shift-from-web-mirror-to-reasoning-prior","The Shift from Web Mirror to Reasoning Prior",[22,7243,7244],{},"The traditional concept of a base model—a massive, uncurated scrape of the internet meant to reflect human knowledge—is obsolete. In the GPT-3 era, pre-training on raw web text (like Common Crawl) accounted for ~85% of the data mix, with reinforcement learning (RL) serving merely as a final \"cherry on top.\" Today, the base model's primary function is to provide a robust prior for downstream RL. As models shift toward reasoning and agentic behaviors, the data mix has pivoted heavily toward code, STEM-focused content, and synthetic reasoning traces.",[17,7246,7248],{"id":7247},"integrating-post-training-data-early","Integrating Post-Training Data Early",[22,7250,7251],{},"Modern training recipes, such as those seen in Nemotron-3 Ultra, demonstrate a trend of pulling post-training data (like SFT chat templates) into the pre-training phase. This \"mid-training\" approach helps the model learn the structure of downstream tasks earlier, which is critical for solving stability issues in Mixture-of-Experts (MoE) architectures. By exposing the model to the expected distribution of RL and long-context agentic traces during pre-training, developers can avoid the massive load-balancing imbalances that occur when a model encounters a radically different data distribution during post-training.",[17,7253,7255],{"id":7254},"the-role-of-synthetic-data-and-rl","The Role of Synthetic Data and RL",[22,7257,7258],{},"Synthetic data has moved from a niche experiment to a core component of high-performance training. Techniques like rephrasing seed data allow models to see information in multiple ways, effectively cleaning the data and shaping the model's representations toward desired task formats.",[22,7260,7261],{},"As RL compute budgets grow—sometimes rivaling or exceeding supervised learning budgets—the goal of supervised learning has changed. It is no longer about building a general-purpose knowledge base, but about providing the \"atomic skills\" the model needs to compose complex behaviors during RL. The base model must now be \"warmed up\" to the specific shapes of reasoning traces and test-time compute schemes, ensuring the model is prepared to explore and extrapolate effectively once it enters the RL phase.",{"title":138,"searchDepth":139,"depth":139,"links":7263},[7264,7265,7266],{"id":7240,"depth":139,"text":7241},{"id":7247,"depth":139,"text":7248},{"id":7254,"depth":139,"text":7255},[145],{"content_references":7269,"triage":7290},[7270,7273,7275,7278,7281,7284,7287],{"type":152,"title":7271,"author":7272,"context":154},"GPT-3 Paper","OpenAI",{"type":152,"title":7274,"author":7272,"context":154},"o1",{"type":152,"title":7276,"author":7277,"context":154},"R1","DeepSeek",{"type":152,"title":7279,"author":7280,"context":154},"Trinity","Arcee AI",{"type":152,"title":7282,"author":7283,"context":154},"Nemotron 3 Ultra","NVIDIA",{"type":152,"title":7285,"author":7286,"context":154},"Kimi K2","Moonshot AI",{"type":152,"title":7288,"author":7289,"context":154},"Thinking 1","MAI",{"relevance":159,"novelty":159,"quality":159,"actionability":7100,"composite":7213,"reasoning":7291},"Category: AI & LLMs. The article discusses the evolution of base models in AI, specifically how they are transitioning from merely reflecting internet data to being designed for reasoning and agentic tasks, which addresses a key pain point for developers looking to implement AI features. It provides insights into modern training techniques and the role of synthetic data, making it relevant and actionable for those building AI-powered products.","\u002Fsummaries\u002F1ccade4e93cfe410-the-base-model-s-evolution-from-web-mirror-to-reas-summary","2026-07-31 20:30:21","2026-08-01 03:12:35",{"title":7230,"description":138},{"loc":7292},"1ccade4e93cfe410","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=xbPriQWXtWM","summaries\u002F1ccade4e93cfe410-the-base-model-s-evolution-from-web-mirror-to-reas-summary",[174,176,177,175],"https:\u002F\u002Fi.ytimg.com\u002Fvi\u002FxbPriQWXtWM\u002Fhqdefault.jpg","Modern base models no longer just mirror the internet. Instead, they are increasingly designed as specialized priors for reinforcement learning, incorporating synthetic data and reasoning traces earlier in the training process to prepare for agentic tasks.","This talk argues that the traditional \"base model\" trained on raw web text is becoming obsolete as reinforcement learning (RL) takes center stage. The speaker explains how modern training recipes now pull instruction-tuned and synthetic data into the pre-training phase to better prepare models for the reasoning tasks required by RL, using his team's work on the [Trinity](https:\u002F\u002Farcee.ai\u002Fblog\u002Ftrinity) series as a case study for managing data mixes and expert load balancing.",[],"n8VwkQbhaeuS6RHfKL80RtWdXVU5Xqw6q2oikxvJcNY",{"id":7307,"title":7308,"ai":7309,"body":7314,"categories":7373,"created_at":146,"date_modified":146,"description":138,"extension":147,"faq":146,"featured":148,"kicker_label":146,"meta":7374,"navigation":162,"path":7384,"published_at":7385,"question":146,"scraped_at":7386,"seo":7387,"sitemap":7388,"source_id":7389,"source_name":7109,"source_type":170,"source_url":7390,"stem":7391,"tags":7392,"thumbnail_url":7393,"tldr":7394,"tweet":7395,"unknown_tags":7396,"__hash__":7397},"summaries\u002Fsummaries\u002Fd25246d629f9869f-recursive-model-improvement-scaling-ai-training-at-summary.md","Recursive Model Improvement: Scaling AI Training at Cursor",{"provider":7,"model":8,"input_tokens":7310,"output_tokens":7311,"processing_time_ms":7312,"cost_usd":7313},8114,668,4110,0.0030305,{"type":14,"value":7315,"toc":7368},[7316,7320,7331,7335,7338,7358,7362,7365],[17,7317,7319],{"id":7318},"the-dual-loop-training-framework","The Dual-Loop Training Framework",[22,7321,7322,7323,7326,7327,7330],{},"Cursor approaches model training through two distinct, interconnected loops. The ",[26,7324,7325],{},"outer loop"," focuses on product-level feedback: collecting user interactions (thumbs up\u002Fdown) and internal dogfooding data to identify areas for improvement. The ",[26,7328,7329],{},"inner loop"," is the technical engine, focusing on high-quality evaluations (evals) and difficult training tasks designed to shape specific model behaviors, such as tool-use precision and intent recognition.",[17,7332,7334],{"id":7333},"solving-reward-hacking-and-evaluation-decay","Solving Reward Hacking and Evaluation Decay",[22,7336,7337],{},"As models improve, they often find ways to \"hack\" public benchmarks by accessing git history or searching the web for existing solutions. To combat this, Cursor employs:",[46,7339,7340,7346,7352],{},[49,7341,7342,7345],{},[26,7343,7344],{},"Clean-room Evals:"," Deleting git history during evaluation runs and using network allow-lists to prevent models from looking up answers.",[49,7347,7348,7351],{},[26,7349,7350],{},"Private Benchmarks:"," Utilizing \"Cursor Bench,\" a private set of real-world engineering tasks from their own codebase that remains held out from training data.",[49,7353,7354,7357],{},[26,7355,7356],{},"Dynamic Difficulty:"," Recognizing that eval \"half-life\" decreases as models get smarter, the team continuously retires old benchmarks in favor of more ambitious, verifiable engineering problems (e.g., deleting features from complex apps and requiring the model to reimplement them until all tests pass).",[17,7359,7361],{"id":7360},"scaling-research-with-ai-native-automation","Scaling Research with AI-Native Automation",[22,7363,7364],{},"To move beyond serial training runs, Cursor uses a \"teacher-student\" textual feedback method. Instead of providing a binary reward at the end of a long rollout, they use a teacher model to provide specific hints during the process, nudging the student model's probabilities toward desired behaviors.",[22,7366,7367],{},"Furthermore, the team treats the ML research process itself as an agent-based system. Researchers use Slack-based agents to launch experiments, monitor infrastructure, and generate new evals. By automating the \"monotonous\" parts of research, the team can run multiple large-scale training jobs in parallel. This creates a recursive flywheel: as the primary model becomes more intelligent, it becomes a better tool for judging, grading, and training the next generation of models, effectively raising the \"floor\" of the entire system's intelligence.",{"title":138,"searchDepth":139,"depth":139,"links":7369},[7370,7371,7372],{"id":7318,"depth":139,"text":7319},{"id":7333,"depth":139,"text":7334},{"id":7360,"depth":139,"text":7361},[145],{"content_references":7375,"triage":7382},[7376,7378,7380],{"type":7096,"title":7377,"context":154},"Composer 2.5",{"type":7096,"title":7379,"context":154},"Colossus",{"type":7096,"title":7381,"context":154},"Terapab",{"relevance":158,"novelty":159,"quality":159,"actionability":159,"composite":160,"reasoning":7383},"Category: AI & LLMs. The article provides a detailed overview of a dual-loop training framework that addresses specific challenges in AI model training, such as reward hacking and evaluation decay, which are relevant pain points for AI developers. It offers actionable insights into automating research processes and improving model training, making it highly relevant for product builders in the AI space.","\u002Fsummaries\u002Fd25246d629f9869f-recursive-model-improvement-scaling-ai-training-at-summary","2026-07-15 20:13:51","2026-07-17 18:00:44",{"title":7308,"description":138},{"loc":7384},"d25246d629f9869f","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=q4Tr-DknG2M","summaries\u002Fd25246d629f9869f-recursive-model-improvement-scaling-ai-training-at-summary",[174,176,177,175],"https:\u002F\u002Fi.ytimg.com\u002Fvi\u002Fq4Tr-DknG2M\u002Fhqdefault.jpg","Cursor accelerates AI development by implementing a dual-loop training framework where models are used to automate research, generate training data, and refine the very systems that train future model generations.","This talk outlines Cursor's internal framework for training models, specifically focusing on a \"two-loop\" system that balances user-driven feedback (the outer loop) with automated, high-difficulty evaluations (the inner loop). It explains how they use synthetic environments and private benchmarks to mitigate reward hacking and scale model performance through iterative, agent-based training.",[],"6sFbJp0QlRr-QtDRCtA4sLNbyDMC-At-vFaytECE_0E"]