[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"summary-d140953fe4179f6a-decoupling-ai-tasks-from-model-implementation-with-summary":3,"summaries-facets-categories":134,"summary-related-d140953fe4179f6a-decoupling-ai-tasks-from-model-implementation-with-summary":5896},{"id":4,"title":5,"ai":6,"body":13,"categories":91,"created_at":93,"date_modified":93,"description":85,"extension":94,"faq":93,"featured":95,"kicker_label":93,"meta":96,"navigation":113,"path":114,"published_at":115,"question":93,"scraped_at":116,"seo":117,"sitemap":118,"source_id":119,"source_name":120,"source_type":121,"source_url":122,"stem":123,"tags":124,"thumbnail_url":129,"tldr":130,"tweet":131,"unknown_tags":132,"__hash__":133},"summaries\u002Fsummaries\u002Fd140953fe4179f6a-decoupling-ai-tasks-from-model-implementation-with-summary.md","Decoupling AI Tasks from Model Implementation with DSPy",{"provider":7,"model":8,"input_tokens":9,"output_tokens":10,"processing_time_ms":11,"cost_usd":12},"openrouter","google\u002Fgemini-3.1-flash-lite",6928,659,3401,0.0027205,{"type":14,"value":15,"toc":84},"minimark",[16,21,30,34,37,59,63,66,69],[17,18,20],"h2",{"id":19},"the-case-for-functional-ai-programming","The Case for Functional AI Programming",[22,23,24,25,29],"p",{},"Modern AI development often suffers from \"prompt engineering\" fragility, where workflows are tightly coupled to specific model behaviors or prompt templates. DSPy proposes treating AI tasks as standard software functions: reusable, composable, and testable. By defining a clear contract—a ",[26,27,28],"strong",{},"Signature","—that specifies inputs and outputs, developers can treat the underlying AI implementation as a black box. This separation allows developers to swap models, integrate new techniques (like agents or tools), or change prompting strategies without altering the business logic.",[17,31,33],{"id":32},"the-three-pillars-of-task-specification","The Three Pillars of Task Specification",[22,35,36],{},"To move beyond manual prompt tuning and enable automatic optimization, DSPy requires three distinct components to fully specify a task:",[38,39,40,47,53],"ol",{},[41,42,43,46],"li",{},[26,44,45],{},"Instructions (Specs):"," Natural language definitions of what the task should achieve, independent of the model provider or specific prompt format.",[41,48,49,52],{},[26,50,51],{},"Code (Constraints):"," Programmatic logic that enforces requirements. This allows for \"loop engineering,\" where the system can automatically retry tasks, validate outputs (e.g., ensuring a value is not negative), or branch into more complex reasoning (Chain-of-Thought) if a simple pass fails.",[41,54,55,58],{},[26,56,57],{},"Evals (What Good Looks Like):"," A metric-driven approach to performance. By defining what success looks like, developers can use optimizers to automatically tune prompts, few-shot examples, and even model harnesses to climb the performance \"hill.\"",[17,60,62],{"id":61},"future-proofing-with-modular-ecosystems","Future-Proofing with Modular Ecosystems",[22,64,65],{},"This architecture enables \"last-mile\" AI engineering. Because the implementation is decoupled from the signature, developers can integrate cutting-edge research—such as Recursive Language Models (RLMs) or new prompt optimizers—with minimal code changes.",[22,67,68],{},"Looking ahead, the DSPy team is moving toward:",[70,71,72,78],"ul",{},[41,73,74,77],{},[26,75,76],{},"DSPy Flex:"," Learning a custom harness over time to solve specific functions, moving beyond simple prompt optimization to code-level optimization.",[41,79,80,83],{},[26,81,82],{},"Qualitative Learning:"," Using real-world production feedback (traces, user actions) to automatically refine evaluation metrics. The goal is to allow models to interpret textual feedback and iteratively improve their own performance against the actual business problem, rather than relying on static, hand-crafted benchmarks.",{"title":85,"searchDepth":86,"depth":86,"links":87},"",2,[88,89,90],{"id":19,"depth":86,"text":20},{"id":32,"depth":86,"text":33},{"id":61,"depth":86,"text":62},[92],"AI & LLMs",null,"md",false,{"content_references":97,"triage":108},[98,103],{"type":99,"title":100,"url":101,"context":102},"tool","DSPy","https:\u002F\u002Fgithub.com\u002Fstanfordnlp\u002Fdspy","recommended",{"type":104,"title":105,"author":106,"context":107},"paper","Recursive Language Models","Alex Zang","mentioned",{"relevance":109,"novelty":110,"quality":110,"actionability":110,"composite":111,"reasoning":112},5,4,4.35,"Category: AI & LLMs. The article provides a detailed framework for decoupling AI tasks from model implementation, addressing a key pain point for developers who struggle with prompt engineering fragility. It offers actionable insights on how to define AI tasks through signatures, which can be directly applied to improve AI workflows.",true,"\u002Fsummaries\u002Fd140953fe4179f6a-decoupling-ai-tasks-from-model-implementation-with-summary","2026-07-23 17:45:06","2026-07-23 18:18:48",{"title":5,"description":85},{"loc":114},"d140953fe4179f6a","AI Engineer","video","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=GgLQ02aO-hs","summaries\u002Fd140953fe4179f6a-decoupling-ai-tasks-from-model-implementation-with-summary",[125,126,127,128],"llm","ai-tools","python","software-engineering","https:\u002F\u002Fi.ytimg.com\u002Fvi\u002FGgLQ02aO-hs\u002Fhqdefault.jpg","By defining AI tasks through signatures (inputs\u002Foutputs) rather than specific prompts, developers can treat LLM logic as modular, optimizable functions, allowing them to swap models and techniques without rewriting the core workflow.","This talk advocates for using [DSPy](https:\u002F\u002Fgithub.com\u002Fstanfordnlp\u002Fdspy) to decouple AI task definitions from their underlying implementation. The speakers explain how defining \"signatures\" (inputs and outputs) allows developers to swap models, prompts, and optimization strategies without rewriting the core application logic.",[128],"ueRl4GqktWNaHS5uTcd2aMBmfMzJjo31qUFmsz5zzcI",[135,138,141,143,146,149,151,153,155,158,160,162,164,166,169,171,173,175,177,180,182,184,186,188,190,192,194,196,198,200,202,204,206,208,210,212,214,216,218,221,224,226,228,230,232,234,236,238,240,242,244,246,249,251,253,255,257,259,261,263,265,267,269,271,273,275,277,279,281,284,286,288,290,292,294,296,298,300,302,304,306,308,311,313,315,317,319,321,323,325,327,329,331,333,335,337,339,341,343,345,347,349,351,353,355,357,359,361,363,365,367,370,372,374,376,378,380,382,384,386,388,391,393,395,397,399,401,403,405,407,409,411,413,415,418,420,422,424,426,428,430,432,435,437,439,441,443,445,447,449,451,453,455,457,459,461,463,465,467,469,471,473,475,477,479,481,483,486,488,490,493,495,497,499,501,503,505,507,509,511,513,515,517,519,522,524,526,528,530,532,534,536,538,540,542,545,547,549,551,553,555,557,559,561,563,565,567,569,571,573,575,577,579,581,583,585,587,589,591,593,595,597,599,601,603,605,607,609,611,613,615,617,619,621,623,625,627,629,631,633,635,637,639,641,643,645,647,649,651,653,655,657,659,661,663,665,667,669,671,673,675,677,679,681,683,685,687,689,691,693,695,697,699,701,703,705,707,709,711,713,715,717,719,721,723,725,727,729,731,733,735,737,739,741,743,745,747,749,751,753,755,757,759,761,763,765,767,769,771,773,775,777,779,781,783,786,788,790,792,794,797,799,801,803,805,807,809,811,813,815,818,820,822,824,826,828,830,832,834,836,838,840,842,844,846,848,850,852,854,856,858,860,862,864,866,868,870,872,874,876,878,880,882,884,886,888,890,892,894,896,898,900,902,904,906,908,910,912,914,916,918,920,922,924,926,928,930,932,934,936,938,940,942,944,946,948,950,952,954,956,958,960,962,964,966,968,970,972,974,976,978,980,982,984,986,988,990,992,994,996,998,1000,1002,1004,1006,1008,1010,1012,1014,1016,1018,1020,1022,1024,1026,1028,1030,1032,1034,1036,1038,1040,1042,1044,1046,1048,1050,1052,1054,1056,1058,1060,1062,1064,1066,1068,1070,1072,1075,1077,1079,1081,1083,1085,1087,1089,1091,1093,1095,1097,1099,1101,1103,1105,1107,1109,1111,1113,1115,1117,1119,1121,1123,1125,1127,1129,1131,1133,1135,1137,1139,1141,1143,1145,1147,1149,1151,1153,1155,1157,1159,1161,1163,1165,1167,1169,1171,1173,1175,1177,1179,1181,1183,1185,1187,1189,1191,1193,1195,1197,1199,1201,1203,1205,1207,1209,1211,1213,1215,1217,1219,1221,1223,1225,1227,1229,1231,1233,1236,1238,1240,1242,1244,1246,1248,1250,1252,1254,1256,1258,1260,1262,1264,1266,1268,1270,1272,1274,1276,1278,1280,1282,1284,1286,1288,1290,1292,1294,1296,1298,1300,1302,1304,1306,1308,1310,1312,1314,1316,1318,1320,1322,1324,1326,1328,1330,1332,1334,1336,1338,1340,1342,1344,1346,1348,1350,1352,1355,1357,1359,1361,1363,1365,1367,1369,1371,1373,1375,1377,1379,1381,1383,1385,1387,1389,1391,1393,1395,1397,1399,1401,1403,1405,1407,1409,1411,1413,1415,1417,1419,1421,1423,1425,1427,1429,1431,1433,1435,1437,1439,1441,1443,1445,1447,1449,1451,1453,1455,1457,1459,1461,1463,1465,1467,1469,1471,1473,1475,1477,1480,1482,1484,1486,1488,1490,1492,1494,1496,1498,1500,1502,1504,1506,1508,1510,1512,1514,1516,1518,1520,1522,1524,1526,1528,1531,1533,1535,1537,1539,1541,1543,1545,1547,1549,1551,1553,1555,1557,1559,1561,1563,1565,1567,1569,1571,1573,1575,1577,1579,1581,1583,1585,1587,1589,1591,1593,1595,1597,1599,1601,1603,1605,1607,1609,1611,1613,1615,1617,1619,1621,1623,1625,1627,1629,1631,1633,1635,1637,1639,1641,1643,1645,1647,1649,1651,1653,1655,1657,1659,1661,1663,1665,1667,1669,1671,1673,1675,1677,1679,1681,1683,1685,1687,1689,1691,1693,1695,1697,1699,1701,1703,1705,1707,1709,1711,1713,1715,1717,1719,1721,1723,1725,1727,1729,1731,1733,1735,1737,1739,1741,1743,1745,1747,1749,1751,1753,1755,1757,1759,1761,1763,1765,1767,1769,1771,1773,1775,1777,1779,1781,1783,1785,1787,1789,1791,1793,1795,1797,1799,1801,1803,1805,1807,1809,1811,1813,1815,1817,1819,1821,1823,1825,1827,1829,1831,1833,1835,1837,1839,1841,1843,1845,1847,1849,1851,1853,1855,1857,1859,1861,1863,1865,1867,1869,1871,1873,1875,1877,1879,1881,1883,1886,1888,1890,1892,1894,1896,1898,1900,1902,1904,1906,1908,1910,1912,1914,1916,1918,1920,1922,1924,1926,1928,1930,1932,1934,1936,1938,1940,1942,1944,1946,1948,1950,1952,1954,1956,1958,1960,1962,1965,1967,1969,1971,1973,1975,1977,1979,1981,1983,1985,1987,1989,1991,1993,1995,1997,1999,2001,2003,2005,2007,2009,2011,2013,2015,2017,2019,2021,2023,2025,2027,2029,2031,2033,2035,2037,2039,2041,2043,2045,2047,2049,2051,2053,2055,2057,2059,2061,2063,2066,2068,2070,2072,2074,2076,2078,2080,2082,2084,2086,2088,2090,2092,2094,2096,2098,2100,2103,2105,2107,2109,2111,2113,2115,2117,2119,2121,2123,2125,2127,2129,2131,2133,2135,2137,2139,2141,2143,2145,2147,2149,2151,2153,2155,2157,2159,2161,2163,2165,2167,2169,2171,2173,2175,2177,2179,2181,2183,2185,2187,2189,2191,2193,2195,2197,2199,2201,2203,2205,2207,2209,2211,2213,2215,2217,2219,2221,2223,2225,2227,2229,2231,2233,2235,2237,2239,2241,2243,2245,2247,2249,2251,2253,2255,2257,2259,2261,2263,2265,2267,2269,2271,2273,2275,2277,2279,2281,2283,2285,2287,2289,2291,2293,2295,2297,2299,2301,2303,2305,2307,2309,2311,2313,2315,2317,2319,2321,2323,2325,2327,2329,2331,2333,2335,2337,2339,2341,2343,2345,2347,2349,2351,2353,2355,2357,2359,2361,2363,2365,2367,2369,2371,2373,2375,2377,2379,2381,2383,2385,2387,2389,2391,2393,2395,2397,2399,2401,2403,2405,2407,2409,2411,2413,2415,2417,2419,2421,2423,2425,2427,2429,2431,2433,2435,2437,2439,2441,2443,2445,2447,2449,2451,2453,2455,2457,2459,2461,2463,2465,2467,2469,2471,2473,2475,2477,2479,2481,2483,2485,2487,2489,2491,2493,2495,2497,2499,2501,2503,2505,2507,2509,2511,2513,2515,2517,2519,2521,2523,2525,2527,2529,2531,2533,2535,2537,2539,2541,2543,2545,2547,2549,2551,2553,2555,2557,2559,2561,2563,2565,2567,2569,2571,2573,2575,2577,2579,2581,2583,2585,2587,2589,2591,2593,2595,2597,2599,2601,2603,2605,2607,2609,2611,2613,2615,2617,2619,2621,2623,2625,2627,2629,2631,2633,2636,2638,2640,2642,2644,2646,2648,2650,2652,2654,2656,2658,2660,2662,2664,2666,2668,2670,2672,2674,2676,2678,2680,2682,2684,2686,2688,2690,2692,2694,2696,2698,2700,2702,2704,2706,2708,2710,2712,2714,2716,2718,2720,2722,2724,2726,2728,2730,2732,2735,2737,2739,2741,2743,2745,2747,2749,2751,2753,2755,2757,2759,2761,2763,2765,2767,2769,2771,2773,2775,2777,2779,2781,2783,2785,2787,2789,2791,2793,2795,2797,2799,2801,2803,2805,2807,2809,2811,2813,2815,2817,2819,2821,2823,2825,2827,2829,2831,2833,2835,2837,2839,2841,2843,2845,2847,2849,2851,2853,2855,2857,2859,2861,2863,2865,2867,2869,2871,2873,2875,2877,2879,2881,2883,2885,2887,2889,2891,2893,2895,2897,2899,2901,2903,2905,2907,2909,2911,2913,2915,2917,2919,2921,2923,2925,2927,2929,2931,2933,2935,2937,2939,2941,2943,2945,2947,2949,2951,2953,2955,2957,2959,2961,2963,2965,2967,2969,2971,2973,2975,2977,2979,2981,2983,2985,2987,2989,2991,2993,2995,2997,2999,3001,3003,3005,3007,3009,3011,3013,3015,3017,3019,3021,3023,3025,3027,3029,3031,3033,3035,3037,3039,3041,3043,3045,3047,3049,3051,3053,3055,3057,3059,3061,3063,3065,3067,3069,3071,3073,3075,3077,3079,3081,3083,3085,3087,3089,3091,3093,3095,3097,3099,3101,3103,3105,3107,3109,3111,3113,3115,3117,3119,3121,3123,3125,3127,3129,3131,3133,3135,3137,3139,3141,3143,3145,3147,3149,3151,3153,3155,3157,3159,3161,3163,3165,3167,3169,3171,3173,3175,3177,3179,3181,3183,3185,3187,3189,3191,3193,3195,3197,3199,3201,3203,3205,3207,3209,3211,3213,3215,3217,3219,3221,3223,3225,3227,3229,3231,3233,3235,3237,3239,3241,3243,3245,3247,3249,3251,3253,3255,3257,3259,3261,3263,3265,3267,3269,3271,3273,3275,3277,3279,3281,3283,3285,3287,3289,3291,3293,3295,3297,3299,3301,3303,3305,3307,3309,3311,3313,3315,3317,3319,3321,3323,3325,3327,3329,3331,3333,3335,3337,3339,3341,3343,3345,3347,3349,3351,3353,3355,3357,3359,3361,3363,3365,3367,3369,3371,3373,3375,3377,3379,3381,3383,3385,3387,3389,3391,3393,3395,3397,3399,3401,3403,3405,3407,3409,3411,3413,3415,3417,3419,3421,3423,3425,3427,3429,3431,3433,3435,3437,3439,3441,3443,3445,3447,3449,3451,3453,3455,3457,3459,3461,3463,3465,3467,3469,3471,3473,3475,3477,3479,3481,3483,3485,3487,3489,3491,3493,3495,3497,3499,3501,3503,3505,3507,3509,3511,3513,3515,3517,3519,3521,3523,3525,3527,3529,3531,3533,3535,3537,3539,3541,3543,3545,3547,3549,3551,3553,3555,3557,3559,3561,3563,3565,3567,3569,3571,3573,3575,3577,3579,3581,3583,3585,3587,3589,3591,3593,3595,3597,3599,3601,3603,3605,3607,3609,3611,3613,3615,3617,3619,3621,3623,3625,3627,3629,3631,3633,3635,3637,3639,3641,3643,3645,3647,3649,3651,3653,3655,3657,3659,3661,3663,3665,3667,3669,3671,3673,3675,3677,3679,3681,3683,3685,3687,3689,3691,3693,3695,3697,3699,3701,3703,3705,3707,3709,3711,3713,3715,3717,3719,3721,3723,3725,3727,3729,3731,3733,3735,3737,3739,3741,3743,3745,3747,3749,3751,3753,3755,3757,3759,3761,3763,3765,3767,3769,3771,3773,3775,3777,3779,3781,3783,3785,3787,3789,3791,3793,3795,3797,3799,3801,3803,3805,3808,3810,3812,3814,3816,3818,3820,3822,3824,3826,3828,3830,3832,3834,3836,3838,3840,3842,3844,3846,3848,3850,3852,3854,3856,3858,3860,3862,3864,3866,3868,3870,3872,3874,3876,3878,3880,3882,3884,3886,3888,3890,3892,3894,3896,3898,3900,3902,3904,3906,3908,3910,3912,3914,3916,3918,3920,3922,3924,3926,3928,3930,3932,3934,3936,3938,3940,3942,3944,3946,3948,3950,3952,3954,3956,3958,3960,3962,3964,3966,3968,3970,3972,3974,3976,3978,3980,3982,3984,3986,3988,3990,3992,3994,3996,3998,4000,4002,4004,4006,4008,4010,4012,4014,4016,4018,4020,4022,4024,4026,4028,4030,4032,4034,4036,4038,4040,4042,4044,4046,4048,4050,4052,4054,4056,4058,4060,4062,4064,4066,4068,4070,4072,4074,4076,4078,4080,4082,4084,4086,4088,4090,4092,4094,4096,4098,4100,4102,4104,4106,4108,4110,4112,4114,4116,4118,4120,4122,4124,4126,4128,4130,4132,4134,4136,4138,4140,4142,4144,4146,4148,4150,4152,4154,4156,4158,4160,4162,4164,4166,4168,4170,4172,4174,4176,4178,4180,4182,4184,4186,4188,4190,4192,4194,4196,4198,4200,4202,4204,4206,4208,4210,4212,4214,4216,4218,4220,4222,4224,4226,4228,4230,4232,4234,4236,4238,4240,4242,4244,4246,4248,4250,4252,4254,4256,4258,4260,4262,4264,4266,4268,4270,4272,4274,4276,4278,4280,4282,4284,4286,4288,4290,4292,4294,4296,4298,4300,4302,4304,4306,4308,4310,4312,4314,4316,4318,4320,4322,4324,4326,4328,4330,4332,4334,4336,4338,4340,4342,4344,4346,4348,4350,4352,4354,4356,4358,4360,4362,4364,4366,4368,4370,4372,4374,4376,4378,4380,4382,4384,4386,4388,4390,4392,4394,4396,4398,4400,4402,4404,4406,4408,4410,4412,4414,4416,4418,4420,4422,4424,4426,4428,4430,4432,4434,4436,4438,4440,4442,4444,4446,4448,4450,4452,4454,4456,4458,4460,4462,4464,4466,4468,4470,4472,4474,4476,4478,4480,4482,4484,4486,4488,4490,4492,4494,4496,4498,4500,4502,4504,4506,4508,4510,4512,4514,4516,4518,4520,4522,4524,4526,4528,4530,4532,4535,4537,4539,4541,4543,4545,4547,4549,4551,4553,4555,4557,4559,4561,4563,4565,4567,4569,4571,4573,4575,4577,4579,4581,4583,4585,4587,4589,4591,4593,4595,4597,4599,4601,4603,4605,4607,4609,4611,4613,4615,4617,4619,4621,4623,4625,4627,4629,4631,4633,4635,4637,4639,4641,4643,4645,4647,4649,4651,4653,4655,4657,4659,4661,4663,4665,4667,4669,4671,4673,4675,4677,4679,4681,4683,4685,4687,4689,4691,4693,4695,4697,4700,4702,4704,4706,4708,4710,4712,4714,4716,4718,4720,4722,4724,4726,4728,4730,4732,4734,4736,4738,4740,4742,4744,4746,4748,4750,4752,4754,4756,4758,4760,4762,4764,4766,4768,4770,4772,4774,4776,4778,4780,4782,4784,4786,4788,4790,4792,4794,4796,4798,4800,4802,4804,4806,4808,4810,4812,4814,4816,4818,4820,4822,4824,4826,4828,4830,4832,4834,4836,4838,4840,4842,4844,4846,4848,4850,4852,4854,4856,4858,4860,4862,4864,4866,4868,4870,4872,4874,4876,4878,4880,4882,4884,4886,4888,4890,4892,4894,4896,4898,4900,4902,4904,4906,4908,4910,4912,4914,4916,4918,4920,4922,4924,4926,4928,4930,4932,4934,4936,4938,4940,4942,4944,4946,4948,4950,4952,4954,4956,4958,4960,4962,4964,4966,4968,4970,4972,4974,4976,4978,4980,4982,4984,4986,4988,4990,4992,4994,4996,4998,5000,5002,5004,5006,5008,5010,5012,5014,5016,5018,5020,5022,5024,5026,5028,5030,5032,5034,5036,5038,5040,5042,5044,5046,5048,5050,5052,5054,5056,5058,5060,5062,5064,5066,5068,5070,5072,5074,5076,5078,5080,5082,5084,5086,5088,5090,5092,5094,5096,5098,5100,5102,5104,5106,5108,5110,5112,5114,5116,5118,5120,5122,5124,5126,5128,5130,5132,5134,5136,5138,5140,5142,5144,5146,5148,5150,5152,5154,5156,5158,5160,5162,5164,5166,5168,5170,5172,5174,5176,5178,5180,5182,5184,5186,5188,5190,5192,5194,5196,5198,5200,5202,5204,5206,5208,5210,5212,5214,5216,5218,5220,5222,5224,5226,5228,5230,5232,5234,5236,5238,5240,5242,5244,5246,5248,5250,5252,5254,5256,5258,5260,5262,5264,5266,5268,5270,5272,5274,5276,5278,5280,5282,5284,5286,5288,5290,5292,5294,5296,5298,5300,5302,5304,5306,5308,5310,5312,5314,5316,5318,5320,5322,5324,5326,5328,5330,5332,5334,5336,5338,5340,5342,5344,5346,5348,5350,5352,5354,5356,5358,5360,5362,5364,5366,5368,5370,5372,5374,5376,5378,5380,5382,5384,5386,5388,5390,5392,5394,5396,5398,5400,5402,5404,5406,5408,5410,5412,5414,5416,5418,5420,5422,5424,5426,5428,5430,5432,5434,5436,5438,5440,5442,5444,5446,5448,5450,5452,5454,5456,5458,5460,5462,5464,5466,5468,5470,5472,5474,5476,5478,5480,5482,5484,5486,5488,5490,5492,5494,5496,5498,5500,5502,5504,5506,5508,5510,5512,5514,5516,5518,5520,5522,5524,5526,5528,5530,5532,5534,5536,5538,5540,5542,5544,5546,5548,5550,5552,5554,5556,5558,5560,5562,5564,5566,5568,5570,5572,5574,5576,5578,5580,5582,5584,5586,5588,5590,5592,5594,5596,5598,5600,5602,5604,5606,5608,5610,5612,5614,5616,5618,5620,5622,5624,5626,5628,5630,5632,5634,5636,5638,5640,5642,5644,5646,5648,5650,5652,5654,5656,5658,5660,5662,5664,5666,5668,5670,5672,5674,5676,5678,5680,5682,5684,5686,5688,5690,5692,5694,5696,5698,5700,5702,5704,5706,5708,5710,5712,5714,5716,5718,5720,5722,5724,5726,5728,5730,5732,5734,5736,5738,5740,5742,5744,5746,5748,5750,5752,5754,5756,5758,5760,5762,5764,5766,5768,5770,5772,5774,5776,5778,5780,5782,5784,5786,5788,5790,5792,5794,5796,5798,5800,5802,5804,5806,5808,5810,5812,5814,5816,5818,5820,5822,5824,5826,5828,5830,5832,5834,5836,5838,5840,5842,5844,5846,5848,5850,5852,5854,5856,5858,5860,5862,5864,5866,5868,5870,5872,5874,5876,5878,5880,5882,5884,5886,5888,5890,5892,5894],{"categories":136},[137],"Developer Productivity",{"categories":139},[140],"Business & SaaS",{"categories":142},[92],{"categories":144},[145],"AI Automation",{"categories":147},[148],"Product Strategy",{"categories":150},[92],{"categories":152},[137],{"categories":154},[145],{"categories":156},[157],"Software Engineering",{"categories":159},[92],{"categories":161},[140],{"categories":163},[],{"categories":165},[92],{"categories":167},[168],"Inference & Serving",{"categories":170},[92],{"categories":172},[92],{"categories":174},[145],{"categories":176},[],{"categories":178},[179],"AI News & Trends",{"categories":181},[145],{"categories":183},[92],{"categories":185},[140],{"categories":187},[137],{"categories":189},[92],{"categories":191},[145],{"categories":193},[179],{"categories":195},[145],{"categories":197},[145],{"categories":199},[92],{"categories":201},[145],{"categories":203},[92],{"categories":205},[92],{"categories":207},[92],{"categories":209},[179],{"categories":211},[92],{"categories":213},[92],{"categories":215},[92],{"categories":217},[],{"categories":219},[220],"Design & Frontend",{"categories":222},[223],"Data Science & Visualization",{"categories":225},[179],{"categories":227},[92],{"categories":229},[92],{"categories":231},[92],{"categories":233},[],{"categories":235},[92],{"categories":237},[145],{"categories":239},[157],{"categories":241},[92],{"categories":243},[145],{"categories":245},[92],{"categories":247},[248],"Marketing & Growth",{"categories":250},[220],{"categories":252},[92],{"categories":254},[145],{"categories":256},[92],{"categories":258},[157],{"categories":260},[],{"categories":262},[],{"categories":264},[220],{"categories":266},[92],{"categories":268},[145],{"categories":270},[137],{"categories":272},[157],{"categories":274},[220],{"categories":276},[148],{"categories":278},[92],{"categories":280},[157],{"categories":282},[283],"DevOps & Cloud",{"categories":285},[145],{"categories":287},[148],{"categories":289},[179],{"categories":291},[92],{"categories":293},[],{"categories":295},[92],{"categories":297},[],{"categories":299},[145],{"categories":301},[157],{"categories":303},[],{"categories":305},[157],{"categories":307},[92],{"categories":309},[310],"Governance & Standards",{"categories":312},[140],{"categories":314},[],{"categories":316},[],{"categories":318},[92],{"categories":320},[92],{"categories":322},[145],{"categories":324},[92],{"categories":326},[92],{"categories":328},[145],{"categories":330},[92],{"categories":332},[92],{"categories":334},[92],{"categories":336},[],{"categories":338},[157],{"categories":340},[],{"categories":342},[],{"categories":344},[157],{"categories":346},[],{"categories":348},[157],{"categories":350},[92],{"categories":352},[92],{"categories":354},[248],{"categories":356},[92],{"categories":358},[220],{"categories":360},[220],{"categories":362},[92],{"categories":364},[157],{"categories":366},[145],{"categories":368},[369],"GovTech & Public-Sector Adoption",{"categories":371},[157],{"categories":373},[92],{"categories":375},[92],{"categories":377},[145],{"categories":379},[145],{"categories":381},[223],{"categories":383},[92],{"categories":385},[179],{"categories":387},[145],{"categories":389},[390],"Legal AI Tools",{"categories":392},[145],{"categories":394},[248],{"categories":396},[145],{"categories":398},[148],{"categories":400},[157],{"categories":402},[369],{"categories":404},[],{"categories":406},[145],{"categories":408},[],{"categories":410},[140],{"categories":412},[145],{"categories":414},[145],{"categories":416},[417],"RAG & Retrieval",{"categories":419},[140],{"categories":421},[92],{"categories":423},[157],{"categories":425},[283],{"categories":427},[220],{"categories":429},[92],{"categories":431},[],{"categories":433},[434],"Agents & Orchestration",{"categories":436},[157],{"categories":438},[92],{"categories":440},[],{"categories":442},[145],{"categories":444},[140],{"categories":446},[],{"categories":448},[92],{"categories":450},[],{"categories":452},[137],{"categories":454},[157],{"categories":456},[140],{"categories":458},[92],{"categories":460},[92],{"categories":462},[179],{"categories":464},[92],{"categories":466},[],{"categories":468},[92],{"categories":470},[],{"categories":472},[157],{"categories":474},[92],{"categories":476},[223],{"categories":478},[],{"categories":480},[92],{"categories":482},[220],{"categories":484},[485],"Models & Frontier Labs",{"categories":487},[],{"categories":489},[220],{"categories":491},[492],"Regulation & Governance of AI",{"categories":494},[145],{"categories":496},[],{"categories":498},[92],{"categories":500},[92],{"categories":502},[145],{"categories":504},[179],{"categories":506},[140],{"categories":508},[92],{"categories":510},[],{"categories":512},[157],{"categories":514},[145],{"categories":516},[92],{"categories":518},[148],{"categories":520},[521],"AI Policy & Regulation",{"categories":523},[],{"categories":525},[92],{"categories":527},[148],{"categories":529},[145],{"categories":531},[92],{"categories":533},[92],{"categories":535},[92],{"categories":537},[145],{"categories":539},[],{"categories":541},[223],{"categories":543},[544],"Evals & Reliability",{"categories":546},[92],{"categories":548},[],{"categories":550},[137],{"categories":552},[369],{"categories":554},[521],{"categories":556},[92],{"categories":558},[140],{"categories":560},[92],{"categories":562},[145],{"categories":564},[92],{"categories":566},[145],{"categories":568},[434],{"categories":570},[92],{"categories":572},[157],{"categories":574},[92],{"categories":576},[],{"categories":578},[],{"categories":580},[92],{"categories":582},[369],{"categories":584},[92],{"categories":586},[92],{"categories":588},[],{"categories":590},[220],{"categories":592},[],{"categories":594},[92],{"categories":596},[],{"categories":598},[145],{"categories":600},[92],{"categories":602},[220],{"categories":604},[],{"categories":606},[92],{"categories":608},[145],{"categories":610},[92],{"categories":612},[140],{"categories":614},[145],{"categories":616},[92],{"categories":618},[92],{"categories":620},[157],{"categories":622},[220],{"categories":624},[145],{"categories":626},[],{"categories":628},[157],{"categories":630},[145],{"categories":632},[],{"categories":634},[179],{"categories":636},[],{"categories":638},[92],{"categories":640},[92],{"categories":642},[92],{"categories":644},[140,248],{"categories":646},[],{"categories":648},[92],{"categories":650},[92],{"categories":652},[145],{"categories":654},[],{"categories":656},[],{"categories":658},[92],{"categories":660},[220],{"categories":662},[92],{"categories":664},[],{"categories":666},[92],{"categories":668},[283],{"categories":670},[],{"categories":672},[145],{"categories":674},[179],{"categories":676},[92],{"categories":678},[220],{"categories":680},[],{"categories":682},[179],{"categories":684},[92],{"categories":686},[168],{"categories":688},[92],{"categories":690},[145],{"categories":692},[179],{"categories":694},[485],{"categories":696},[92],{"categories":698},[248],{"categories":700},[],{"categories":702},[145],{"categories":704},[140],{"categories":706},[157],{"categories":708},[92],{"categories":710},[145],{"categories":712},[],{"categories":714},[92,283],{"categories":716},[92],{"categories":718},[92],{"categories":720},[92],{"categories":722},[145],{"categories":724},[92,157],{"categories":726},[223],{"categories":728},[92],{"categories":730},[92],{"categories":732},[157],{"categories":734},[145],{"categories":736},[521],{"categories":738},[248],{"categories":740},[92],{"categories":742},[145],{"categories":744},[92],{"categories":746},[92],{"categories":748},[145],{"categories":750},[],{"categories":752},[92],{"categories":754},[145],{"categories":756},[92],{"categories":758},[92,140],{"categories":760},[140],{"categories":762},[],{"categories":764},[220],{"categories":766},[220],{"categories":768},[92],{"categories":770},[],{"categories":772},[],{"categories":774},[179],{"categories":776},[],{"categories":778},[137],{"categories":780},[92],{"categories":782},[157],{"categories":784},[785],"Generative UI & Design-to-Code",{"categories":787},[92],{"categories":789},[92],{"categories":791},[220],{"categories":793},[92],{"categories":795},[796],"Algorithmic Accountability",{"categories":798},[145],{"categories":800},[157],{"categories":802},[179],{"categories":804},[220],{"categories":806},[],{"categories":808},[92],{"categories":810},[92],{"categories":812},[92],{"categories":814},[145],{"categories":816},[817],"MLOps & Infrastructure",{"categories":819},[92],{"categories":821},[92],{"categories":823},[92],{"categories":825},[92],{"categories":827},[92],{"categories":829},[179],{"categories":831},[137],{"categories":833},[92],{"categories":835},[145],{"categories":837},[283],{"categories":839},[140],{"categories":841},[92],{"categories":843},[220],{"categories":845},[92],{"categories":847},[145],{"categories":849},[],{"categories":851},[],{"categories":853},[168],{"categories":855},[220],{"categories":857},[179],{"categories":859},[223],{"categories":861},[],{"categories":863},[92],{"categories":865},[92],{"categories":867},[140],{"categories":869},[92],{"categories":871},[92],{"categories":873},[92],{"categories":875},[179],{"categories":877},[168],{"categories":879},[92],{"categories":881},[220],{"categories":883},[],{"categories":885},[145],{"categories":887},[157],{"categories":889},[],{"categories":891},[92],{"categories":893},[92],{"categories":895},[145],{"categories":897},[157],{"categories":899},[92],{"categories":901},[223],{"categories":903},[],{"categories":905},[92],{"categories":907},[],{"categories":909},[92],{"categories":911},[],{"categories":913},[148],{"categories":915},[140],{"categories":917},[145],{"categories":919},[145],{"categories":921},[],{"categories":923},[137],{"categories":925},[92],{"categories":927},[140],{"categories":929},[179],{"categories":931},[137],{"categories":933},[],{"categories":935},[92],{"categories":937},[],{"categories":939},[],{"categories":941},[179],{"categories":943},[179],{"categories":945},[],{"categories":947},[434],{"categories":949},[92],{"categories":951},[220],{"categories":953},[157],{"categories":955},[],{"categories":957},[390],{"categories":959},[140],{"categories":961},[],{"categories":963},[],{"categories":965},[137],{"categories":967},[223],{"categories":969},[],{"categories":971},[248],{"categories":973},[145],{"categories":975},[140],{"categories":977},[145],{"categories":979},[140],{"categories":981},[157],{"categories":983},[],{"categories":985},[168],{"categories":987},[148],{"categories":989},[92],{"categories":991},[220],{"categories":993},[157],{"categories":995},[140],{"categories":997},[92],{"categories":999},[145],{"categories":1001},[140],{"categories":1003},[92],{"categories":1005},[92],{"categories":1007},[92],{"categories":1009},[],{"categories":1011},[],{"categories":1013},[157],{"categories":1015},[223],{"categories":1017},[148],{"categories":1019},[92],{"categories":1021},[145],{"categories":1023},[92],{"categories":1025},[],{"categories":1027},[179],{"categories":1029},[148],{"categories":1031},[92],{"categories":1033},[544],{"categories":1035},[283],{"categories":1037},[],{"categories":1039},[145],{"categories":1041},[],{"categories":1043},[137],{"categories":1045},[],{"categories":1047},[92],{"categories":1049},[92],{"categories":1051},[220],{"categories":1053},[248],{"categories":1055},[157],{"categories":1057},[145],{"categories":1059},[],{"categories":1061},[157],{"categories":1063},[137],{"categories":1065},[],{"categories":1067},[140],{"categories":1069},[179],{"categories":1071},[92,283],{"categories":1073},[1074],"Design Systems for AI",{"categories":1076},[92],{"categories":1078},[179],{"categories":1080},[92],{"categories":1082},[92],{"categories":1084},[140],{"categories":1086},[92],{"categories":1088},[],{"categories":1090},[92],{"categories":1092},[92],{"categories":1094},[140],{"categories":1096},[92],{"categories":1098},[],{"categories":1100},[145],{"categories":1102},[157],{"categories":1104},[157],{"categories":1106},[220],{"categories":1108},[179],{"categories":1110},[223],{"categories":1112},[92],{"categories":1114},[137],{"categories":1116},[521],{"categories":1118},[92],{"categories":1120},[145],{"categories":1122},[92],{"categories":1124},[157],{"categories":1126},[157],{"categories":1128},[],{"categories":1130},[],{"categories":1132},[145],{"categories":1134},[148],{"categories":1136},[],{"categories":1138},[92],{"categories":1140},[],{"categories":1142},[220],{"categories":1144},[145],{"categories":1146},[157],{"categories":1148},[220],{"categories":1150},[92],{"categories":1152},[92],{"categories":1154},[220],{"categories":1156},[],{"categories":1158},[],{"categories":1160},[179],{"categories":1162},[145],{"categories":1164},[145],{"categories":1166},[92],{"categories":1168},[92],{"categories":1170},[92],{"categories":1172},[140],{"categories":1174},[92],{"categories":1176},[92],{"categories":1178},[],{"categories":1180},[157],{"categories":1182},[157],{"categories":1184},[92],{"categories":1186},[157],{"categories":1188},[140],{"categories":1190},[],{"categories":1192},[92],{"categories":1194},[92],{"categories":1196},[92],{"categories":1198},[92],{"categories":1200},[145],{"categories":1202},[137],{"categories":1204},[140],{"categories":1206},[179],{"categories":1208},[145],{"categories":1210},[168],{"categories":1212},[248],{"categories":1214},[92],{"categories":1216},[145],{"categories":1218},[],{"categories":1220},[220],{"categories":1222},[],{"categories":1224},[92],{"categories":1226},[92],{"categories":1228},[],{"categories":1230},[157],{"categories":1232},[140],{"categories":1234},[1235],"Visual & Generative Media",{"categories":1237},[145],{"categories":1239},[],{"categories":1241},[92],{"categories":1243},[92],{"categories":1245},[157],{"categories":1247},[283],{"categories":1249},[223],{"categories":1251},[521],{"categories":1253},[157],{"categories":1255},[248],{"categories":1257},[92],{"categories":1259},[220],{"categories":1261},[92],{"categories":1263},[92],{"categories":1265},[157],{"categories":1267},[145],{"categories":1269},[92],{"categories":1271},[],{"categories":1273},[],{"categories":1275},[145],{"categories":1277},[137],{"categories":1279},[145],{"categories":1281},[485],{"categories":1283},[92],{"categories":1285},[148],{"categories":1287},[140],{"categories":1289},[],{"categories":1291},[92],{"categories":1293},[148],{"categories":1295},[92],{"categories":1297},[92],{"categories":1299},[92],{"categories":1301},[92],{"categories":1303},[92],{"categories":1305},[248],{"categories":1307},[92],{"categories":1309},[434],{"categories":1311},[92],{"categories":1313},[92],{"categories":1315},[92],{"categories":1317},[92],{"categories":1319},[92],{"categories":1321},[220],{"categories":1323},[145],{"categories":1325},[],{"categories":1327},[145],{"categories":1329},[],{"categories":1331},[283],{"categories":1333},[157],{"categories":1335},[],{"categories":1337},[485],{"categories":1339},[145],{"categories":1341},[92],{"categories":1343},[220,92],{"categories":1345},[137],{"categories":1347},[],{"categories":1349},[92],{"categories":1351},[137],{"categories":1353},[1354],"Medical Imaging & Radiology",{"categories":1356},[220],{"categories":1358},[145],{"categories":1360},[157],{"categories":1362},[],{"categories":1364},[92],{"categories":1366},[92],{"categories":1368},[92],{"categories":1370},[],{"categories":1372},[],{"categories":1374},[92],{"categories":1376},[434],{"categories":1378},[92],{"categories":1380},[137],{"categories":1382},[92],{"categories":1384},[92],{"categories":1386},[],{"categories":1388},[145],{"categories":1390},[92],{"categories":1392},[148],{"categories":1394},[157],{"categories":1396},[92],{"categories":1398},[434],{"categories":1400},[92],{"categories":1402},[145],{"categories":1404},[92],{"categories":1406},[220],{"categories":1408},[145],{"categories":1410},[283],{"categories":1412},[220],{"categories":1414},[140],{"categories":1416},[145],{"categories":1418},[92],{"categories":1420},[92],{"categories":1422},[92],{"categories":1424},[92],{"categories":1426},[92],{"categories":1428},[145],{"categories":1430},[157],{"categories":1432},[92],{"categories":1434},[148],{"categories":1436},[],{"categories":1438},[179],{"categories":1440},[],{"categories":1442},[148],{"categories":1444},[145],{"categories":1446},[1074],{"categories":1448},[1074],{"categories":1450},[220],{"categories":1452},[92],{"categories":1454},[92],{"categories":1456},[145],{"categories":1458},[157],{"categories":1460},[220],{"categories":1462},[145],{"categories":1464},[179],{"categories":1466},[],{"categories":1468},[92],{"categories":1470},[],{"categories":1472},[92],{"categories":1474},[92],{"categories":1476},[92],{"categories":1478},[1479],"Contract Review & E-Discovery",{"categories":1481},[220],{"categories":1483},[92],{"categories":1485},[137],{"categories":1487},[179],{"categories":1489},[92],{"categories":1491},[92],{"categories":1493},[248],{"categories":1495},[157],{"categories":1497},[92],{"categories":1499},[92],{"categories":1501},[145],{"categories":1503},[145],{"categories":1505},[796],{"categories":1507},[145],{"categories":1509},[145],{"categories":1511},[92],{"categories":1513},[92],{"categories":1515},[145],{"categories":1517},[92],{"categories":1519},[434],{"categories":1521},[417],{"categories":1523},[92],{"categories":1525},[145],{"categories":1527},[92],{"categories":1529},[1530],"Law-Firm Practice & Adoption",{"categories":1532},[92],{"categories":1534},[145],{"categories":1536},[220],{"categories":1538},[92],{"categories":1540},[92],{"categories":1542},[],{"categories":1544},[],{"categories":1546},[157],{"categories":1548},[],{"categories":1550},[137],{"categories":1552},[283],{"categories":1554},[92],{"categories":1556},[],{"categories":1558},[137],{"categories":1560},[140],{"categories":1562},[92],{"categories":1564},[248],{"categories":1566},[],{"categories":1568},[140],{"categories":1570},[140],{"categories":1572},[],{"categories":1574},[92],{"categories":1576},[92],{"categories":1578},[157],{"categories":1580},[],{"categories":1582},[],{"categories":1584},[],{"categories":1586},[],{"categories":1588},[92],{"categories":1590},[145],{"categories":1592},[283],{"categories":1594},[92],{"categories":1596},[137],{"categories":1598},[157],{"categories":1600},[92],{"categories":1602},[92],{"categories":1604},[157],{"categories":1606},[148],{"categories":1608},[92],{"categories":1610},[817],{"categories":1612},[92],{"categories":1614},[248],{"categories":1616},[157],{"categories":1618},[140],{"categories":1620},[92],{"categories":1622},[92],{"categories":1624},[220],{"categories":1626},[92],{"categories":1628},[92],{"categories":1630},[92],{"categories":1632},[145],{"categories":1634},[92,137],{"categories":1636},[434],{"categories":1638},[92],{"categories":1640},[92],{"categories":1642},[157],{"categories":1644},[157],{"categories":1646},[220],{"categories":1648},[145],{"categories":1650},[157],{"categories":1652},[92],{"categories":1654},[92],{"categories":1656},[],{"categories":1658},[],{"categories":1660},[92],{"categories":1662},[],{"categories":1664},[92],{"categories":1666},[157],{"categories":1668},[223],{"categories":1670},[179],{"categories":1672},[220],{"categories":1674},[92],{"categories":1676},[157],{"categories":1678},[],{"categories":1680},[145],{"categories":1682},[92],{"categories":1684},[92],{"categories":1686},[92],{"categories":1688},[92],{"categories":1690},[],{"categories":1692},[145],{"categories":1694},[92],{"categories":1696},[92],{"categories":1698},[],{"categories":1700},[145],{"categories":1702},[92],{"categories":1704},[92],{"categories":1706},[140],{"categories":1708},[92],{"categories":1710},[],{"categories":1712},[137],{"categories":1714},[92],{"categories":1716},[220],{"categories":1718},[157],{"categories":1720},[92],{"categories":1722},[137],{"categories":1724},[92],{"categories":1726},[157],{"categories":1728},[248],{"categories":1730},[145],{"categories":1732},[145],{"categories":1734},[92,220],{"categories":1736},[92],{"categories":1738},[179],{"categories":1740},[92],{"categories":1742},[179],{"categories":1744},[145],{"categories":1746},[220],{"categories":1748},[],{"categories":1750},[157],{"categories":1752},[283],{"categories":1754},[220],{"categories":1756},[157],{"categories":1758},[92],{"categories":1760},[148],{"categories":1762},[92],{"categories":1764},[145],{"categories":1766},[],{"categories":1768},[],{"categories":1770},[92],{"categories":1772},[],{"categories":1774},[],{"categories":1776},[148],{"categories":1778},[157],{"categories":1780},[92],{"categories":1782},[145],{"categories":1784},[145],{"categories":1786},[140],{"categories":1788},[145],{"categories":1790},[283],{"categories":1792},[92],{"categories":1794},[92],{"categories":1796},[168],{"categories":1798},[92],{"categories":1800},[92],{"categories":1802},[145],{"categories":1804},[92],{"categories":1806},[92],{"categories":1808},[390],{"categories":1810},[796],{"categories":1812},[],{"categories":1814},[220],{"categories":1816},[1530],{"categories":1818},[157],{"categories":1820},[],{"categories":1822},[],{"categories":1824},[145],{"categories":1826},[],{"categories":1828},[],{"categories":1830},[248],{"categories":1832},[92],{"categories":1834},[248],{"categories":1836},[145],{"categories":1838},[92],{"categories":1840},[157],{"categories":1842},[],{"categories":1844},[92],{"categories":1846},[92],{"categories":1848},[157],{"categories":1850},[1479],{"categories":1852},[220],{"categories":1854},[220],{"categories":1856},[92],{"categories":1858},[145],{"categories":1860},[137],{"categories":1862},[92],{"categories":1864},[92],{"categories":1866},[92],{"categories":1868},[220],{"categories":1870},[220],{"categories":1872},[145],{"categories":1874},[145],{"categories":1876},[92],{"categories":1878},[],{"categories":1880},[92],{"categories":1882},[],{"categories":1884},[1885],"Interaction & Product Design",{"categories":1887},[92],{"categories":1889},[145],{"categories":1891},[310],{"categories":1893},[179],{"categories":1895},[157],{"categories":1897},[92],{"categories":1899},[92],{"categories":1901},[157],{"categories":1903},[137],{"categories":1905},[145],{"categories":1907},[92],{"categories":1909},[],{"categories":1911},[145],{"categories":1913},[145],{"categories":1915},[],{"categories":1917},[157],{"categories":1919},[92],{"categories":1921},[137],{"categories":1923},[1885],{"categories":1925},[92],{"categories":1927},[137],{"categories":1929},[137],{"categories":1931},[],{"categories":1933},[157],{"categories":1935},[],{"categories":1937},[145],{"categories":1939},[179],{"categories":1941},[92],{"categories":1943},[145],{"categories":1945},[92],{"categories":1947},[145],{"categories":1949},[92],{"categories":1951},[92],{"categories":1953},[179],{"categories":1955},[223],{"categories":1957},[92],{"categories":1959},[148],{"categories":1961},[157],{"categories":1963},[1964],"Coding Agents & Dev Productivity",{"categories":1966},[179],{"categories":1968},[220],{"categories":1970},[],{"categories":1972},[92],{"categories":1974},[796],{"categories":1976},[],{"categories":1978},[92],{"categories":1980},[92],{"categories":1982},[179],{"categories":1984},[],{"categories":1986},[],{"categories":1988},[92],{"categories":1990},[],{"categories":1992},[145],{"categories":1994},[92],{"categories":1996},[],{"categories":1998},[157],{"categories":2000},[157],{"categories":2002},[92],{"categories":2004},[223],{"categories":2006},[],{"categories":2008},[92],{"categories":2010},[92],{"categories":2012},[92],{"categories":2014},[223],{"categories":2016},[157],{"categories":2018},[],{"categories":2020},[],{"categories":2022},[92],{"categories":2024},[145],{"categories":2026},[145],{"categories":2028},[369],{"categories":2030},[157],{"categories":2032},[157],{"categories":2034},[145],{"categories":2036},[179],{"categories":2038},[179],{"categories":2040},[145],{"categories":2042},[145],{"categories":2044},[92],{"categories":2046},[137],{"categories":2048},[1885],{"categories":2050},[92,283],{"categories":2052},[],{"categories":2054},[220],{"categories":2056},[157],{"categories":2058},[137],{"categories":2060},[92],{"categories":2062},[145],{"categories":2064},[2065],"The Designer's Role & Craft",{"categories":2067},[220],{"categories":2069},[],{"categories":2071},[145],{"categories":2073},[92],{"categories":2075},[145],{"categories":2077},[145],{"categories":2079},[92],{"categories":2081},[248],{"categories":2083},[92],{"categories":2085},[157],{"categories":2087},[220],{"categories":2089},[92],{"categories":2091},[],{"categories":2093},[145],{"categories":2095},[220],{"categories":2097},[92],{"categories":2099},[92],{"categories":2101},[2102],"AI UX Patterns",{"categories":2104},[145],{"categories":2106},[145],{"categories":2108},[145],{"categories":2110},[145],{"categories":2112},[248],{"categories":2114},[223],{"categories":2116},[92],{"categories":2118},[145],{"categories":2120},[92],{"categories":2122},[1074],{"categories":2124},[],{"categories":2126},[248],{"categories":2128},[179],{"categories":2130},[157],{"categories":2132},[92],{"categories":2134},[145],{"categories":2136},[],{"categories":2138},[],{"categories":2140},[92],{"categories":2142},[145],{"categories":2144},[92],{"categories":2146},[145],{"categories":2148},[369],{"categories":2150},[220],{"categories":2152},[179],{"categories":2154},[157],{"categories":2156},[92],{"categories":2158},[145],{"categories":2160},[145],{"categories":2162},[],{"categories":2164},[92],{"categories":2166},[],{"categories":2168},[],{"categories":2170},[92],{"categories":2172},[92],{"categories":2174},[145],{"categories":2176},[157],{"categories":2178},[],{"categories":2180},[],{"categories":2182},[223],{"categories":2184},[168],{"categories":2186},[92],{"categories":2188},[223],{"categories":2190},[179],{"categories":2192},[92],{"categories":2194},[92],{"categories":2196},[145],{"categories":2198},[145],{"categories":2200},[92],{"categories":2202},[92],{"categories":2204},[145],{"categories":2206},[],{"categories":2208},[],{"categories":2210},[92],{"categories":2212},[283],{"categories":2214},[92],{"categories":2216},[],{"categories":2218},[],{"categories":2220},[220],{"categories":2222},[817],{"categories":2224},[145],{"categories":2226},[137],{"categories":2228},[2065],{"categories":2230},[],{"categories":2232},[],{"categories":2234},[92],{"categories":2236},[],{"categories":2238},[],{"categories":2240},[157],{"categories":2242},[179],{"categories":2244},[248],{"categories":2246},[140],{"categories":2248},[92],{"categories":2250},[92],{"categories":2252},[140],{"categories":2254},[],{"categories":2256},[220],{"categories":2258},[92],{"categories":2260},[92],{"categories":2262},[145],{"categories":2264},[140],{"categories":2266},[92],{"categories":2268},[92],{"categories":2270},[137],{"categories":2272},[92],{"categories":2274},[],{"categories":2276},[137],{"categories":2278},[92],{"categories":2280},[248],{"categories":2282},[145],{"categories":2284},[179],{"categories":2286},[92],{"categories":2288},[140],{"categories":2290},[92],{"categories":2292},[92],{"categories":2294},[92],{"categories":2296},[145],{"categories":2298},[],{"categories":2300},[92],{"categories":2302},[157],{"categories":2304},[137],{"categories":2306},[92],{"categories":2308},[92],{"categories":2310},[],{"categories":2312},[92],{"categories":2314},[434],{"categories":2316},[179],{"categories":2318},[92],{"categories":2320},[92],{"categories":2322},[],{"categories":2324},[140],{"categories":2326},[140],{"categories":2328},[92],{"categories":2330},[92],{"categories":2332},[148],{"categories":2334},[92],{"categories":2336},[92],{"categories":2338},[157],{"categories":2340},[157],{"categories":2342},[92],{"categories":2344},[],{"categories":2346},[157],{"categories":2348},[92],{"categories":2350},[157],{"categories":2352},[521],{"categories":2354},[],{"categories":2356},[],{"categories":2358},[92],{"categories":2360},[179],{"categories":2362},[],{"categories":2364},[283],{"categories":2366},[92],{"categories":2368},[92],{"categories":2370},[220],{"categories":2372},[785],{"categories":2374},[],{"categories":2376},[92],{"categories":2378},[92],{"categories":2380},[92],{"categories":2382},[157],{"categories":2384},[92],{"categories":2386},[92],{"categories":2388},[92,283],{"categories":2390},[92],{"categories":2392},[92],{"categories":2394},[220],{"categories":2396},[145],{"categories":2398},[],{"categories":2400},[145],{"categories":2402},[145],{"categories":2404},[92],{"categories":2406},[92],{"categories":2408},[92],{"categories":2410},[223],{"categories":2412},[92],{"categories":2414},[2102],{"categories":2416},[137],{"categories":2418},[223],{"categories":2420},[137],{"categories":2422},[157],{"categories":2424},[220],{"categories":2426},[145],{"categories":2428},[92],{"categories":2430},[],{"categories":2432},[92],{"categories":2434},[92],{"categories":2436},[179],{"categories":2438},[92],{"categories":2440},[145],{"categories":2442},[92],{"categories":2444},[92],{"categories":2446},[140],{"categories":2448},[],{"categories":2450},[283],{"categories":2452},[92],{"categories":2454},[369],{"categories":2456},[220],{"categories":2458},[220],{"categories":2460},[157],{"categories":2462},[145],{"categories":2464},[92],{"categories":2466},[140],{"categories":2468},[179],{"categories":2470},[92],{"categories":2472},[220],{"categories":2474},[145],{"categories":2476},[92],{"categories":2478},[92],{"categories":2480},[485],{"categories":2482},[],{"categories":2484},[92],{"categories":2486},[92],{"categories":2488},[92],{"categories":2490},[],{"categories":2492},[],{"categories":2494},[92],{"categories":2496},[92],{"categories":2498},[92],{"categories":2500},[92],{"categories":2502},[157],{"categories":2504},[92],{"categories":2506},[92],{"categories":2508},[145],{"categories":2510},[92],{"categories":2512},[92],{"categories":2514},[92],{"categories":2516},[92],{"categories":2518},[92],{"categories":2520},[],{"categories":2522},[157],{"categories":2524},[223],{"categories":2526},[92],{"categories":2528},[145],{"categories":2530},[92],{"categories":2532},[],{"categories":2534},[],{"categories":2536},[92],{"categories":2538},[92],{"categories":2540},[92],{"categories":2542},[179],{"categories":2544},[],{"categories":2546},[92],{"categories":2548},[220],{"categories":2550},[92],{"categories":2552},[283],{"categories":2554},[1530],{"categories":2556},[179],{"categories":2558},[157],{"categories":2560},[157],{"categories":2562},[157],{"categories":2564},[179],{"categories":2566},[179],{"categories":2568},[283],{"categories":2570},[],{"categories":2572},[179],{"categories":2574},[92],{"categories":2576},[137],{"categories":2578},[157],{"categories":2580},[92],{"categories":2582},[179],{"categories":2584},[],{"categories":2586},[92],{"categories":2588},[157],{"categories":2590},[223],{"categories":2592},[92],{"categories":2594},[179],{"categories":2596},[92],{"categories":2598},[157],{"categories":2600},[145],{"categories":2602},[179],{"categories":2604},[145],{"categories":2606},[283],{"categories":2608},[145],{"categories":2610},[92],{"categories":2612},[92],{"categories":2614},[157],{"categories":2616},[92],{"categories":2618},[],{"categories":2620},[140],{"categories":2622},[157],{"categories":2624},[],{"categories":2626},[],{"categories":2628},[92],{"categories":2630},[145],{"categories":2632},[92],{"categories":2634},[2635],"Frameworks & Tooling",{"categories":2637},[92],{"categories":2639},[92],{"categories":2641},[157],{"categories":2643},[92],{"categories":2645},[92],{"categories":2647},[],{"categories":2649},[223],{"categories":2651},[223],{"categories":2653},[137],{"categories":2655},[145],{"categories":2657},[220],{"categories":2659},[],{"categories":2661},[1530],{"categories":2663},[92],{"categories":2665},[157],{"categories":2667},[92],{"categories":2669},[283],{"categories":2671},[283],{"categories":2673},[],{"categories":2675},[145],{"categories":2677},[179],{"categories":2679},[179],{"categories":2681},[92],{"categories":2683},[145],{"categories":2685},[],{"categories":2687},[220],{"categories":2689},[92],{"categories":2691},[92],{"categories":2693},[],{"categories":2695},[92],{"categories":2697},[92],{"categories":2699},[],{"categories":2701},[157],{"categories":2703},[92],{"categories":2705},[157],{"categories":2707},[283],{"categories":2709},[92],{"categories":2711},[157],{"categories":2713},[140],{"categories":2715},[92],{"categories":2717},[1530],{"categories":2719},[],{"categories":2721},[145],{"categories":2723},[137],{"categories":2725},[137],{"categories":2727},[],{"categories":2729},[145],{"categories":2731},[92],{"categories":2733},[2734],"AI Design Tooling",{"categories":2736},[220],{"categories":2738},[92],{"categories":2740},[92],{"categories":2742},[157],{"categories":2744},[220],{"categories":2746},[92],{"categories":2748},[157],{"categories":2750},[179],{"categories":2752},[148],{"categories":2754},[157],{"categories":2756},[145],{"categories":2758},[],{"categories":2760},[92],{"categories":2762},[92],{"categories":2764},[145],{"categories":2766},[92],{"categories":2768},[92],{"categories":2770},[],{"categories":2772},[145],{"categories":2774},[2635],{"categories":2776},[92],{"categories":2778},[145],{"categories":2780},[145],{"categories":2782},[157],{"categories":2784},[157],{"categories":2786},[],{"categories":2788},[157],{"categories":2790},[92],{"categories":2792},[92],{"categories":2794},[145],{"categories":2796},[140],{"categories":2798},[92],{"categories":2800},[],{"categories":2802},[92],{"categories":2804},[92],{"categories":2806},[1885],{"categories":2808},[],{"categories":2810},[92],{"categories":2812},[92],{"categories":2814},[92],{"categories":2816},[],{"categories":2818},[92],{"categories":2820},[92],{"categories":2822},[92],{"categories":2824},[248],{"categories":2826},[179],{"categories":2828},[92],{"categories":2830},[92],{"categories":2832},[1530],{"categories":2834},[137],{"categories":2836},[92],{"categories":2838},[92],{"categories":2840},[223],{"categories":2842},[92],{"categories":2844},[179],{"categories":2846},[145],{"categories":2848},[],{"categories":2850},[92],{"categories":2852},[92],{"categories":2854},[220],{"categories":2856},[92],{"categories":2858},[248],{"categories":2860},[92],{"categories":2862},[145],{"categories":2864},[],{"categories":2866},[],{"categories":2868},[],{"categories":2870},[137],{"categories":2872},[179],{"categories":2874},[145],{"categories":2876},[92],{"categories":2878},[92],{"categories":2880},[92],{"categories":2882},[390],{"categories":2884},[220],{"categories":2886},[145],{"categories":2888},[92],{"categories":2890},[],{"categories":2892},[145],{"categories":2894},[145],{"categories":2896},[],{"categories":2898},[92],{"categories":2900},[145],{"categories":2902},[92],{"categories":2904},[],{"categories":2906},[92],{"categories":2908},[92],{"categories":2910},[179],{"categories":2912},[220],{"categories":2914},[145],{"categories":2916},[220],{"categories":2918},[145],{"categories":2920},[92],{"categories":2922},[140],{"categories":2924},[],{"categories":2926},[],{"categories":2928},[92],{"categories":2930},[92],{"categories":2932},[137],{"categories":2934},[145],{"categories":2936},[179],{"categories":2938},[],{"categories":2940},[220],{"categories":2942},[],{"categories":2944},[157],{"categories":2946},[157],{"categories":2948},[220],{"categories":2950},[157],{"categories":2952},[92],{"categories":2954},[],{"categories":2956},[92],{"categories":2958},[92],{"categories":2960},[],{"categories":2962},[248],{"categories":2964},[92],{"categories":2966},[283],{"categories":2968},[157],{"categories":2970},[],{"categories":2972},[145],{"categories":2974},[92],{"categories":2976},[137],{"categories":2978},[485],{"categories":2980},[145],{"categories":2982},[145],{"categories":2984},[92],{"categories":2986},[92],{"categories":2988},[],{"categories":2990},[92],{"categories":2992},[137],{"categories":2994},[92],{"categories":2996},[140],{"categories":2998},[157],{"categories":3000},[220],{"categories":3002},[],{"categories":3004},[],{"categories":3006},[],{"categories":3008},[145],{"categories":3010},[157],{"categories":3012},[220],{"categories":3014},[179],{"categories":3016},[92],{"categories":3018},[179],{"categories":3020},[145],{"categories":3022},[220],{"categories":3024},[92],{"categories":3026},[],{"categories":3028},[92],{"categories":3030},[168],{"categories":3032},[145],{"categories":3034},[220],{"categories":3036},[179],{"categories":3038},[140],{"categories":3040},[157],{"categories":3042},[92],{"categories":3044},[179],{"categories":3046},[248],{"categories":3048},[],{"categories":3050},[],{"categories":3052},[223],{"categories":3054},[434],{"categories":3056},[92],{"categories":3058},[145],{"categories":3060},[92,157],{"categories":3062},[179],{"categories":3064},[92],{"categories":3066},[92],{"categories":3068},[92],{"categories":3070},[92],{"categories":3072},[145],{"categories":3074},[92],{"categories":3076},[145],{"categories":3078},[92],{"categories":3080},[92],{"categories":3082},[],{"categories":3084},[92],{"categories":3086},[1074],{"categories":3088},[157],{"categories":3090},[220],{"categories":3092},[92],{"categories":3094},[92],{"categories":3096},[92],{"categories":3098},[223],{"categories":3100},[145],{"categories":3102},[248],{"categories":3104},[283],{"categories":3106},[],{"categories":3108},[92],{"categories":3110},[140],{"categories":3112},[145],{"categories":3114},[137],{"categories":3116},[145],{"categories":3118},[92],{"categories":3120},[145],{"categories":3122},[148],{"categories":3124},[157],{"categories":3126},[92],{"categories":3128},[92],{"categories":3130},[],{"categories":3132},[],{"categories":3134},[],{"categories":3136},[283],{"categories":3138},[92],{"categories":3140},[179],{"categories":3142},[92],{"categories":3144},[92],{"categories":3146},[92],{"categories":3148},[92],{"categories":3150},[],{"categories":3152},[223],{"categories":3154},[140],{"categories":3156},[145],{"categories":3158},[92],{"categories":3160},[],{"categories":3162},[92],{"categories":3164},[145],{"categories":3166},[92],{"categories":3168},[283],{"categories":3170},[],{"categories":3172},[220],{"categories":3174},[220],{"categories":3176},[],{"categories":3178},[157],{"categories":3180},[92],{"categories":3182},[220],{"categories":3184},[92],{"categories":3186},[140],{"categories":3188},[145],{"categories":3190},[92],{"categories":3192},[],{"categories":3194},[179],{"categories":3196},[92],{"categories":3198},[92],{"categories":3200},[92],{"categories":3202},[220],{"categories":3204},[145],{"categories":3206},[179],{"categories":3208},[],{"categories":3210},[145],{"categories":3212},[140],{"categories":3214},[145],{"categories":3216},[220],{"categories":3218},[92],{"categories":3220},[92],{"categories":3222},[92],{"categories":3224},[434],{"categories":3226},[92],{"categories":3228},[],{"categories":3230},[92],{"categories":3232},[92],{"categories":3234},[283],{"categories":3236},[179],{"categories":3238},[223],{"categories":3240},[521],{"categories":3242},[223],{"categories":3244},[],{"categories":3246},[],{"categories":3248},[],{"categories":3250},[145],{"categories":3252},[145],{"categories":3254},[157],{"categories":3256},[92],{"categories":3258},[417],{"categories":3260},[157],{"categories":3262},[92],{"categories":3264},[92],{"categories":3266},[92],{"categories":3268},[92],{"categories":3270},[145],{"categories":3272},[],{"categories":3274},[],{"categories":3276},[92],{"categories":3278},[],{"categories":3280},[92],{"categories":3282},[145],{"categories":3284},[220],{"categories":3286},[92],{"categories":3288},[92],{"categories":3290},[],{"categories":3292},[145],{"categories":3294},[148],{"categories":3296},[92],{"categories":3298},[220],{"categories":3300},[92],{"categories":3302},[145],{"categories":3304},[140],{"categories":3306},[92],{"categories":3308},[248],{"categories":3310},[145],{"categories":3312},[92],{"categories":3314},[785],{"categories":3316},[92],{"categories":3318},[145],{"categories":3320},[92],{"categories":3322},[157],{"categories":3324},[92],{"categories":3326},[485],{"categories":3328},[220],{"categories":3330},[],{"categories":3332},[179],{"categories":3334},[434],{"categories":3336},[145],{"categories":3338},[92],{"categories":3340},[],{"categories":3342},[179],{"categories":3344},[369],{"categories":3346},[145],{"categories":3348},[145],{"categories":3350},[92],{"categories":3352},[92],{"categories":3354},[145],{"categories":3356},[],{"categories":3358},[92],{"categories":3360},[140],{"categories":3362},[145],{"categories":3364},[],{"categories":3366},[157],{"categories":3368},[92],{"categories":3370},[92],{"categories":3372},[137],{"categories":3374},[179],{"categories":3376},[283],{"categories":3378},[168],{"categories":3380},[145],{"categories":3382},[145],{"categories":3384},[92],{"categories":3386},[145],{"categories":3388},[92],{"categories":3390},[137],{"categories":3392},[],{"categories":3394},[92],{"categories":3396},[92],{"categories":3398},[],{"categories":3400},[],{"categories":3402},[220],{"categories":3404},[92,140],{"categories":3406},[145],{"categories":3408},[92],{"categories":3410},[],{"categories":3412},[137],{"categories":3414},[223],{"categories":3416},[140],{"categories":3418},[92],{"categories":3420},[157],{"categories":3422},[92],{"categories":3424},[145],{"categories":3426},[92],{"categories":3428},[92],{"categories":3430},[92],{"categories":3432},[179],{"categories":3434},[1074],{"categories":3436},[145],{"categories":3438},[92],{"categories":3440},[],{"categories":3442},[],{"categories":3444},[145],{"categories":3446},[92],{"categories":3448},[283],{"categories":3450},[],{"categories":3452},[92],{"categories":3454},[145],{"categories":3456},[168],{"categories":3458},[145],{"categories":3460},[434],{"categories":3462},[],{"categories":3464},[390],{"categories":3466},[145],{"categories":3468},[92],{"categories":3470},[248],{"categories":3472},[92],{"categories":3474},[223],{"categories":3476},[145],{"categories":3478},[92],{"categories":3480},[434],{"categories":3482},[92],{"categories":3484},[283],{"categories":3486},[],{"categories":3488},[92],{"categories":3490},[248],{"categories":3492},[220],{"categories":3494},[92],{"categories":3496},[92],{"categories":3498},[],{"categories":3500},[248],{"categories":3502},[179],{"categories":3504},[92],{"categories":3506},[92],{"categories":3508},[521],{"categories":3510},[137],{"categories":3512},[92],{"categories":3514},[],{"categories":3516},[],{"categories":3518},[220],{"categories":3520},[92],{"categories":3522},[223],{"categories":3524},[248],{"categories":3526},[145],{"categories":3528},[248],{"categories":3530},[179],{"categories":3532},[],{"categories":3534},[92],{"categories":3536},[92],{"categories":3538},[],{"categories":3540},[92],{"categories":3542},[544],{"categories":3544},[92],{"categories":3546},[92],{"categories":3548},[145],{"categories":3550},[157],{"categories":3552},[434],{"categories":3554},[92],{"categories":3556},[92],{"categories":3558},[92],{"categories":3560},[],{"categories":3562},[92,157],{"categories":3564},[179],{"categories":3566},[145],{"categories":3568},[157],{"categories":3570},[145],{"categories":3572},[817],{"categories":3574},[157],{"categories":3576},[92],{"categories":3578},[137],{"categories":3580},[],{"categories":3582},[],{"categories":3584},[145],{"categories":3586},[92],{"categories":3588},[157],{"categories":3590},[137],{"categories":3592},[157],{"categories":3594},[157],{"categories":3596},[92],{"categories":3598},[248],{"categories":3600},[92],{"categories":3602},[157],{"categories":3604},[],{"categories":3606},[92],{"categories":3608},[220,92],{"categories":3610},[283],{"categories":3612},[137],{"categories":3614},[],{"categories":3616},[92],{"categories":3618},[92],{"categories":3620},[140],{"categories":3622},[140],{"categories":3624},[92],{"categories":3626},[92],{"categories":3628},[369],{"categories":3630},[92],{"categories":3632},[157],{"categories":3634},[223],{"categories":3636},[145],{"categories":3638},[157],{"categories":3640},[92],{"categories":3642},[92],{"categories":3644},[179],{"categories":3646},[248],{"categories":3648},[220],{"categories":3650},[92],{"categories":3652},[92],{"categories":3654},[92],{"categories":3656},[92],{"categories":3658},[137],{"categories":3660},[92],{"categories":3662},[145],{"categories":3664},[145],{"categories":3666},[157],{"categories":3668},[179],{"categories":3670},[157],{"categories":3672},[157],{"categories":3674},[],{"categories":3676},[],{"categories":3678},[223],{"categories":3680},[92],{"categories":3682},[157],{"categories":3684},[92],{"categories":3686},[220],{"categories":3688},[434],{"categories":3690},[390],{"categories":3692},[369],{"categories":3694},[92],{"categories":3696},[92],{"categories":3698},[92],{"categories":3700},[223],{"categories":3702},[92],{"categories":3704},[92],{"categories":3706},[92],{"categories":3708},[92],{"categories":3710},[92],{"categories":3712},[145],{"categories":3714},[137],{"categories":3716},[145],{"categories":3718},[92,140],{"categories":3720},[],{"categories":3722},[220],{"categories":3724},[],{"categories":3726},[148],{"categories":3728},[92],{"categories":3730},[179],{"categories":3732},[137],{"categories":3734},[137],{"categories":3736},[145],{"categories":3738},[145],{"categories":3740},[145],{"categories":3742},[92],{"categories":3744},[92],{"categories":3746},[140],{"categories":3748},[157],{"categories":3750},[248],{"categories":3752},[92],{"categories":3754},[],{"categories":3756},[179],{"categories":3758},[92],{"categories":3760},[92],{"categories":3762},[92],{"categories":3764},[92],{"categories":3766},[92],{"categories":3768},[157],{"categories":3770},[179],{"categories":3772},[157],{"categories":3774},[157],{"categories":3776},[92],{"categories":3778},[92],{"categories":3780},[92],{"categories":3782},[390],{"categories":3784},[92],{"categories":3786},[145],{"categories":3788},[179],{"categories":3790},[92],{"categories":3792},[92],{"categories":3794},[92],{"categories":3796},[145],{"categories":3798},[92],{"categories":3800},[92],{"categories":3802},[92],{"categories":3804},[2635],{"categories":3806},[3807],"Clinical AI",{"categories":3809},[220],{"categories":3811},[92],{"categories":3813},[92],{"categories":3815},[92],{"categories":3817},[283],{"categories":3819},[2102],{"categories":3821},[92],{"categories":3823},[148],{"categories":3825},[92],{"categories":3827},[145],{"categories":3829},[92],{"categories":3831},[92],{"categories":3833},[179],{"categories":3835},[92],{"categories":3837},[145],{"categories":3839},[157],{"categories":3841},[248],{"categories":3843},[92],{"categories":3845},[92],{"categories":3847},[140],{"categories":3849},[92],{"categories":3851},[92],{"categories":3853},[485],{"categories":3855},[92],{"categories":3857},[],{"categories":3859},[92],{"categories":3861},[157],{"categories":3863},[137],{"categories":3865},[92],{"categories":3867},[],{"categories":3869},[],{"categories":3871},[92],{"categories":3873},[],{"categories":3875},[140],{"categories":3877},[92],{"categories":3879},[145],{"categories":3881},[179],{"categories":3883},[179],{"categories":3885},[179],{"categories":3887},[179],{"categories":3889},[],{"categories":3891},[137],{"categories":3893},[145],{"categories":3895},[179],{"categories":3897},[92],{"categories":3899},[544],{"categories":3901},[148],{"categories":3903},[92],{"categories":3905},[137],{"categories":3907},[145],{"categories":3909},[92],{"categories":3911},[92],{"categories":3913},[92,145],{"categories":3915},[145],{"categories":3917},[283],{"categories":3919},[179],{"categories":3921},[145],{"categories":3923},[179],{"categories":3925},[145],{"categories":3927},[92],{"categories":3929},[],{"categories":3931},[179],{"categories":3933},[248],{"categories":3935},[137],{"categories":3937},[92],{"categories":3939},[92],{"categories":3941},[],{"categories":3943},[157],{"categories":3945},[],{"categories":3947},[137],{"categories":3949},[145],{"categories":3951},[179],{"categories":3953},[92],{"categories":3955},[179],{"categories":3957},[137],{"categories":3959},[179],{"categories":3961},[179],{"categories":3963},[],{"categories":3965},[140],{"categories":3967},[145],{"categories":3969},[179],{"categories":3971},[179],{"categories":3973},[179],{"categories":3975},[179],{"categories":3977},[179],{"categories":3979},[179],{"categories":3981},[179],{"categories":3983},[179],{"categories":3985},[179],{"categories":3987},[179],{"categories":3989},[223],{"categories":3991},[137],{"categories":3993},[92],{"categories":3995},[92],{"categories":3997},[145],{"categories":3999},[145],{"categories":4001},[],{"categories":4003},[92,137],{"categories":4005},[],{"categories":4007},[145],{"categories":4009},[179],{"categories":4011},[145],{"categories":4013},[817],{"categories":4015},[92],{"categories":4017},[92],{"categories":4019},[92],{"categories":4021},[92],{"categories":4023},[92],{"categories":4025},[369],{"categories":4027},[92],{"categories":4029},[145],{"categories":4031},[140],{"categories":4033},[145],{"categories":4035},[145],{"categories":4037},[],{"categories":4039},[145],{"categories":4041},[220],{"categories":4043},[179],{"categories":4045},[92],{"categories":4047},[],{"categories":4049},[148],{"categories":4051},[],{"categories":4053},[157],{"categories":4055},[145],{"categories":4057},[220],{"categories":4059},[92],{"categories":4061},[],{"categories":4063},[92],{"categories":4065},[],{"categories":4067},[248],{"categories":4069},[92],{"categories":4071},[],{"categories":4073},[],{"categories":4075},[179],{"categories":4077},[137],{"categories":4079},[92],{"categories":4081},[92],{"categories":4083},[140],{"categories":4085},[92],{"categories":4087},[92],{"categories":4089},[92],{"categories":4091},[140],{"categories":4093},[220],{"categories":4095},[],{"categories":4097},[92],{"categories":4099},[179],{"categories":4101},[],{"categories":4103},[92],{"categories":4105},[92],{"categories":4107},[220],{"categories":4109},[92],{"categories":4111},[248],{"categories":4113},[92],{"categories":4115},[283],{"categories":4117},[],{"categories":4119},[145],{"categories":4121},[248],{"categories":4123},[157],{"categories":4125},[],{"categories":4127},[92],{"categories":4129},[],{"categories":4131},[145],{"categories":4133},[220],{"categories":4135},[157],{"categories":4137},[],{"categories":4139},[2635],{"categories":4141},[140],{"categories":4143},[137],{"categories":4145},[92],{"categories":4147},[223],{"categories":4149},[145],{"categories":4151},[220],{"categories":4153},[157],{"categories":4155},[],{"categories":4157},[],{"categories":4159},[92],{"categories":4161},[137],{"categories":4163},[92],{"categories":4165},[248],{"categories":4167},[],{"categories":4169},[145],{"categories":4171},[145],{"categories":4173},[145],{"categories":4175},[92],{"categories":4177},[179],{"categories":4179},[157],{"categories":4181},[92],{"categories":4183},[145],{"categories":4185},[148],{"categories":4187},[92],{"categories":4189},[92],{"categories":4191},[145],{"categories":4193},[92],{"categories":4195},[148],{"categories":4197},[248],{"categories":4199},[179],{"categories":4201},[],{"categories":4203},[248],{"categories":4205},[],{"categories":4207},[157],{"categories":4209},[145],{"categories":4211},[],{"categories":4213},[92],{"categories":4215},[92],{"categories":4217},[92],{"categories":4219},[92],{"categories":4221},[145],{"categories":4223},[140],{"categories":4225},[137],{"categories":4227},[92],{"categories":4229},[220],{"categories":4231},[157],{"categories":4233},[157],{"categories":4235},[92],{"categories":4237},[223],{"categories":4239},[145],{"categories":4241},[92],{"categories":4243},[92],{"categories":4245},[145],{"categories":4247},[92],{"categories":4249},[140],{"categories":4251},[220],{"categories":4253},[157],{"categories":4255},[145],{"categories":4257},[92],{"categories":4259},[148],{"categories":4261},[92],{"categories":4263},[145],{"categories":4265},[92],{"categories":4267},[179],{"categories":4269},[],{"categories":4271},[137],{"categories":4273},[92],{"categories":4275},[92],{"categories":4277},[92],{"categories":4279},[157],{"categories":4281},[157],{"categories":4283},[92],{"categories":4285},[157],{"categories":4287},[92],{"categories":4289},[145],{"categories":4291},[92],{"categories":4293},[92],{"categories":4295},[92],{"categories":4297},[92],{"categories":4299},[],{"categories":4301},[92],{"categories":4303},[220],{"categories":4305},[140],{"categories":4307},[179],{"categories":4309},[145],{"categories":4311},[92],{"categories":4313},[92],{"categories":4315},[220],{"categories":4317},[145],{"categories":4319},[92],{"categories":4321},[248],{"categories":4323},[92],{"categories":4325},[223],{"categories":4327},[92],{"categories":4329},[92],{"categories":4331},[179],{"categories":4333},[92],{"categories":4335},[92],{"categories":4337},[92],{"categories":4339},[145],{"categories":4341},[283],{"categories":4343},[92],{"categories":4345},[157],{"categories":4347},[145],{"categories":4349},[223],{"categories":4351},[],{"categories":4353},[145],{"categories":4355},[157],{"categories":4357},[92],{"categories":4359},[1964],{"categories":4361},[220],{"categories":4363},[310],{"categories":4365},[92],{"categories":4367},[92],{"categories":4369},[137],{"categories":4371},[157],{"categories":4373},[140],{"categories":4375},[157],{"categories":4377},[92],{"categories":4379},[],{"categories":4381},[145],{"categories":4383},[145],{"categories":4385},[92],{"categories":4387},[92],{"categories":4389},[223],{"categories":4391},[],{"categories":4393},[179],{"categories":4395},[],{"categories":4397},[179],{"categories":4399},[92],{"categories":4401},[92],{"categories":4403},[145],{"categories":4405},[92],{"categories":4407},[145],{"categories":4409},[145],{"categories":4411},[],{"categories":4413},[179],{"categories":4415},[92],{"categories":4417},[],{"categories":4419},[92],{"categories":4421},[92],{"categories":4423},[],{"categories":4425},[220],{"categories":4427},[157],{"categories":4429},[145],{"categories":4431},[92],{"categories":4433},[92],{"categories":4435},[248],{"categories":4437},[92],{"categories":4439},[92],{"categories":4441},[137],{"categories":4443},[],{"categories":4445},[92],{"categories":4447},[92],{"categories":4449},[],{"categories":4451},[137],{"categories":4453},[179],{"categories":4455},[157],{"categories":4457},[148],{"categories":4459},[434],{"categories":4461},[92],{"categories":4463},[92],{"categories":4465},[92],{"categories":4467},[157],{"categories":4469},[179],{"categories":4471},[220],{"categories":4473},[92],{"categories":4475},[92],{"categories":4477},[92],{"categories":4479},[179],{"categories":4481},[220],{"categories":4483},[92],{"categories":4485},[179],{"categories":4487},[220],{"categories":4489},[92],{"categories":4491},[179],{"categories":4493},[145],{"categories":4495},[145],{"categories":4497},[145],{"categories":4499},[157],{"categories":4501},[179],{"categories":4503},[145],{"categories":4505},[145],{"categories":4507},[92],{"categories":4509},[157],{"categories":4511},[220],{"categories":4513},[92],{"categories":4515},[],{"categories":4517},[145],{"categories":4519},[],{"categories":4521},[92],{"categories":4523},[],{"categories":4525},[],{"categories":4527},[145],{"categories":4529},[140],{"categories":4531},[145],{"categories":4533},[4534],"Liability & Ethics",{"categories":4536},[92],{"categories":4538},[145],{"categories":4540},[137],{"categories":4542},[145],{"categories":4544},[140],{"categories":4546},[248],{"categories":4548},[145],{"categories":4550},[],{"categories":4552},[521],{"categories":4554},[145],{"categories":4556},[],{"categories":4558},[137],{"categories":4560},[145],{"categories":4562},[],{"categories":4564},[145],{"categories":4566},[92],{"categories":4568},[92],{"categories":4570},[179],{"categories":4572},[92],{"categories":4574},[92],{"categories":4576},[145],{"categories":4578},[92],{"categories":4580},[92],{"categories":4582},[179],{"categories":4584},[145],{"categories":4586},[157],{"categories":4588},[220],{"categories":4590},[137],{"categories":4592},[92],{"categories":4594},[92],{"categories":4596},[],{"categories":4598},[145],{"categories":4600},[145],{"categories":4602},[434],{"categories":4604},[220],{"categories":4606},[283],{"categories":4608},[179],{"categories":4610},[92],{"categories":4612},[220],{"categories":4614},[92],{"categories":4616},[137],{"categories":4618},[],{"categories":4620},[145],{"categories":4622},[92],{"categories":4624},[92],{"categories":4626},[145],{"categories":4628},[92],{"categories":4630},[220],{"categories":4632},[],{"categories":4634},[145],{"categories":4636},[148],{"categories":4638},[179],{"categories":4640},[145],{"categories":4642},[140],{"categories":4644},[],{"categories":4646},[92],{"categories":4648},[148],{"categories":4650},[92],{"categories":4652},[145],{"categories":4654},[179],{"categories":4656},[137],{"categories":4658},[283],{"categories":4660},[92],{"categories":4662},[92],{"categories":4664},[92],{"categories":4666},[179],{"categories":4668},[140],{"categories":4670},[92],{"categories":4672},[220],{"categories":4674},[179],{"categories":4676},[283],{"categories":4678},[92],{"categories":4680},[145],{"categories":4682},[],{"categories":4684},[485],{"categories":4686},[],{"categories":4688},[92],{"categories":4690},[283],{"categories":4692},[223],{"categories":4694},[145],{"categories":4696},[145],{"categories":4698},[4699],"Design News & Tools",{"categories":4701},[92],{"categories":4703},[179],{"categories":4705},[92],{"categories":4707},[92],{"categories":4709},[137],{"categories":4711},[92],{"categories":4713},[220],{"categories":4715},[145],{"categories":4717},[145],{"categories":4719},[220],{"categories":4721},[92],{"categories":4723},[434],{"categories":4725},[92],{"categories":4727},[92],{"categories":4729},[434],{"categories":4731},[92],{"categories":4733},[248],{"categories":4735},[92],{"categories":4737},[145],{"categories":4739},[],{"categories":4741},[92],{"categories":4743},[92],{"categories":4745},[92],{"categories":4747},[179],{"categories":4749},[137],{"categories":4751},[],{"categories":4753},[92],{"categories":4755},[92],{"categories":4757},[157],{"categories":4759},[544],{"categories":4761},[157],{"categories":4763},[220],{"categories":4765},[92],{"categories":4767},[92,145],{"categories":4769},[248,140],{"categories":4771},[92],{"categories":4773},[92],{"categories":4775},[92],{"categories":4777},[],{"categories":4779},[145],{"categories":4781},[],{"categories":4783},[157],{"categories":4785},[92],{"categories":4787},[157],{"categories":4789},[],{"categories":4791},[145],{"categories":4793},[92],{"categories":4795},[179],{"categories":4797},[92],{"categories":4799},[],{"categories":4801},[145],{"categories":4803},[92],{"categories":4805},[],{"categories":4807},[220],{"categories":4809},[92],{"categories":4811},[145],{"categories":4813},[92],{"categories":4815},[92],{"categories":4817},[137],{"categories":4819},[145],{"categories":4821},[92],{"categories":4823},[],{"categories":4825},[283],{"categories":4827},[248],{"categories":4829},[140],{"categories":4831},[140],{"categories":4833},[92],{"categories":4835},[137],{"categories":4837},[137],{"categories":4839},[92],{"categories":4841},[145],{"categories":4843},[92],{"categories":4845},[92],{"categories":4847},[92],{"categories":4849},[157],{"categories":4851},[92],{"categories":4853},[137],{"categories":4855},[145],{"categories":4857},[92],{"categories":4859},[248],{"categories":4861},[92],{"categories":4863},[179],{"categories":4865},[92],{"categories":4867},[92],{"categories":4869},[145],{"categories":4871},[92],{"categories":4873},[],{"categories":4875},[157],{"categories":4877},[],{"categories":4879},[157],{"categories":4881},[145],{"categories":4883},[137],{"categories":4885},[],{"categories":4887},[223],{"categories":4889},[283],{"categories":4891},[92],{"categories":4893},[157],{"categories":4895},[92],{"categories":4897},[],{"categories":4899},[179],{"categories":4901},[145],{"categories":4903},[157],{"categories":4905},[220],{"categories":4907},[92],{"categories":4909},[92],{"categories":4911},[145],{"categories":4913},[157],{"categories":4915},[145],{"categories":4917},[179],{"categories":4919},[92],{"categories":4921},[137],{"categories":4923},[179],{"categories":4925},[157],{"categories":4927},[92],{"categories":4929},[220],{"categories":4931},[140],{"categories":4933},[92],{"categories":4935},[92],{"categories":4937},[92],{"categories":4939},[92],{"categories":4941},[92],{"categories":4943},[145],{"categories":4945},[92],{"categories":4947},[145],{"categories":4949},[92],{"categories":4951},[92],{"categories":4953},[137],{"categories":4955},[92],{"categories":4957},[145],{"categories":4959},[145],{"categories":4961},[220],{"categories":4963},[145],{"categories":4965},[145],{"categories":4967},[137],{"categories":4969},[145],{"categories":4971},[220],{"categories":4973},[],{"categories":4975},[92],{"categories":4977},[223],{"categories":4979},[434],{"categories":4981},[92],{"categories":4983},[92],{"categories":4985},[92],{"categories":4987},[157],{"categories":4989},[92],{"categories":4991},[],{"categories":4993},[145],{"categories":4995},[248],{"categories":4997},[92],{"categories":4999},[179],{"categories":5001},[145],{"categories":5003},[92],{"categories":5005},[248],{"categories":5007},[145],{"categories":5009},[140],{"categories":5011},[140],{"categories":5013},[92],{"categories":5015},[92],{"categories":5017},[92],{"categories":5019},[137],{"categories":5021},[],{"categories":5023},[92],{"categories":5025},[92],{"categories":5027},[145],{"categories":5029},[145],{"categories":5031},[92],{"categories":5033},[92],{"categories":5035},[92],{"categories":5037},[157],{"categories":5039},[],{"categories":5041},[137],{"categories":5043},[92],{"categories":5045},[92],{"categories":5047},[145],{"categories":5049},[145],{"categories":5051},[],{"categories":5053},[157],{"categories":5055},[157],{"categories":5057},[92],{"categories":5059},[248],{"categories":5061},[140],{"categories":5063},[220],{"categories":5065},[],{"categories":5067},[92],{"categories":5069},[145],{"categories":5071},[137],{"categories":5073},[92],{"categories":5075},[157],{"categories":5077},[137],{"categories":5079},[179],{"categories":5081},[223],{"categories":5083},[179],{"categories":5085},[145],{"categories":5087},[],{"categories":5089},[179],{"categories":5091},[145],{"categories":5093},[220],{"categories":5095},[223],{"categories":5097},[92],{"categories":5099},[],{"categories":5101},[145],{"categories":5103},[145],{"categories":5105},[2635],{"categories":5107},[179],{"categories":5109},[157],{"categories":5111},[92],{"categories":5113},[92],{"categories":5115},[92],{"categories":5117},[92],{"categories":5119},[140],{"categories":5121},[92],{"categories":5123},[137],{"categories":5125},[1530],{"categories":5127},[283],{"categories":5129},[137],{"categories":5131},[],{"categories":5133},[],{"categories":5135},[179],{"categories":5137},[145],{"categories":5139},[179],{"categories":5141},[],{"categories":5143},[145],{"categories":5145},[145],{"categories":5147},[145],{"categories":5149},[],{"categories":5151},[92],{"categories":5153},[],{"categories":5155},[179],{"categories":5157},[137],{"categories":5159},[220],{"categories":5161},[92],{"categories":5163},[145],{"categories":5165},[179],{"categories":5167},[92],{"categories":5169},[179],{"categories":5171},[],{"categories":5173},[179],{"categories":5175},[137],{"categories":5177},[434],{"categories":5179},[145],{"categories":5181},[92],{"categories":5183},[],{"categories":5185},[157],{"categories":5187},[145],{"categories":5189},[148],{"categories":5191},[145],{"categories":5193},[137],{"categories":5195},[],{"categories":5197},[],{"categories":5199},[],{"categories":5201},[220],{"categories":5203},[145],{"categories":5205},[92],{"categories":5207},[92],{"categories":5209},[],{"categories":5211},[],{"categories":5213},[],{"categories":5215},[220],{"categories":5217},[92],{"categories":5219},[],{"categories":5221},[145],{"categories":5223},[92],{"categories":5225},[137],{"categories":5227},[],{"categories":5229},[],{"categories":5231},[220],{"categories":5233},[92],{"categories":5235},[179],{"categories":5237},[],{"categories":5239},[248],{"categories":5241},[179],{"categories":5243},[248],{"categories":5245},[223],{"categories":5247},[92],{"categories":5249},[92],{"categories":5251},[],{"categories":5253},[],{"categories":5255},[145],{"categories":5257},[],{"categories":5259},[92],{"categories":5261},[434],{"categories":5263},[92],{"categories":5265},[92],{"categories":5267},[92],{"categories":5269},[92],{"categories":5271},[],{"categories":5273},[145],{"categories":5275},[92],{"categories":5277},[92],{"categories":5279},[],{"categories":5281},[145],{"categories":5283},[92],{"categories":5285},[179],{"categories":5287},[92],{"categories":5289},[248],{"categories":5291},[140],{"categories":5293},[92],{"categories":5295},[92],{"categories":5297},[145],{"categories":5299},[223],{"categories":5301},[145],{"categories":5303},[145],{"categories":5305},[],{"categories":5307},[145],{"categories":5309},[],{"categories":5311},[92],{"categories":5313},[],{"categories":5315},[179],{"categories":5317},[140],{"categories":5319},[],{"categories":5321},[92],{"categories":5323},[],{"categories":5325},[220],{"categories":5327},[137],{"categories":5329},[],{"categories":5331},[140],{"categories":5333},[248],{"categories":5335},[92],{"categories":5337},[157],{"categories":5339},[137],{"categories":5341},[223],{"categories":5343},[140],{"categories":5345},[157],{"categories":5347},[157],{"categories":5349},[],{"categories":5351},[92],{"categories":5353},[],{"categories":5355},[145],{"categories":5357},[137],{"categories":5359},[220],{"categories":5361},[92],{"categories":5363},[137],{"categories":5365},[145],{"categories":5367},[283],{"categories":5369},[92],{"categories":5371},[92],{"categories":5373},[92],{"categories":5375},[137],{"categories":5377},[223],{"categories":5379},[145],{"categories":5381},[],{"categories":5383},[92],{"categories":5385},[92],{"categories":5387},[157],{"categories":5389},[145],{"categories":5391},[179],{"categories":5393},[157],{"categories":5395},[92],{"categories":5397},[148],{"categories":5399},[],{"categories":5401},[220],{"categories":5403},[179],{"categories":5405},[137],{"categories":5407},[145],{"categories":5409},[92],{"categories":5411},[92],{"categories":5413},[145],{"categories":5415},[148],{"categories":5417},[92],{"categories":5419},[145],{"categories":5421},[92],{"categories":5423},[140],{"categories":5425},[145],{"categories":5427},[145,283],{"categories":5429},[92],{"categories":5431},[92],{"categories":5433},[145],{"categories":5435},[157],{"categories":5437},[92],{"categories":5439},[92],{"categories":5441},[223],{"categories":5443},[145],{"categories":5445},[248],{"categories":5447},[145],{"categories":5449},[140],{"categories":5451},[],{"categories":5453},[145],{"categories":5455},[92],{"categories":5457},[140],{"categories":5459},[],{"categories":5461},[],{"categories":5463},[157],{"categories":5465},[92],{"categories":5467},[92],{"categories":5469},[145],{"categories":5471},[223],{"categories":5473},[248],{"categories":5475},[92],{"categories":5477},[92],{"categories":5479},[145],{"categories":5481},[],{"categories":5483},[145],{"categories":5485},[179],{"categories":5487},[145],{"categories":5489},[],{"categories":5491},[179],{"categories":5493},[157],{"categories":5495},[2635],{"categories":5497},[137],{"categories":5499},[157],{"categories":5501},[92],{"categories":5503},[145],{"categories":5505},[92],{"categories":5507},[92],{"categories":5509},[248],{"categories":5511},[157],{"categories":5513},[],{"categories":5515},[179],{"categories":5517},[92],{"categories":5519},[],{"categories":5521},[145],{"categories":5523},[92],{"categories":5525},[92],{"categories":5527},[92],{"categories":5529},[92],{"categories":5531},[145],{"categories":5533},[92],{"categories":5535},[92],{"categories":5537},[148],{"categories":5539},[145],{"categories":5541},[92],{"categories":5543},[92],{"categories":5545},[92],{"categories":5547},[92],{"categories":5549},[92],{"categories":5551},[92],{"categories":5553},[140],{"categories":5555},[],{"categories":5557},[148],{"categories":5559},[179],{"categories":5561},[145],{"categories":5563},[92],{"categories":5565},[157],{"categories":5567},[],{"categories":5569},[157],{"categories":5571},[157],{"categories":5573},[145],{"categories":5575},[157],{"categories":5577},[92],{"categories":5579},[92],{"categories":5581},[157],{"categories":5583},[92],{"categories":5585},[145],{"categories":5587},[179],{"categories":5589},[92],{"categories":5591},[92],{"categories":5593},[92],{"categories":5595},[140],{"categories":5597},[92],{"categories":5599},[145],{"categories":5601},[220],{"categories":5603},[],{"categories":5605},[92],{"categories":5607},[223],{"categories":5609},[145],{"categories":5611},[92],{"categories":5613},[92],{"categories":5615},[],{"categories":5617},[92],{"categories":5619},[92],{"categories":5621},[179],{"categories":5623},[92],{"categories":5625},[92],{"categories":5627},[145],{"categories":5629},[248],{"categories":5631},[],{"categories":5633},[],{"categories":5635},[157],{"categories":5637},[92],{"categories":5639},[179],{"categories":5641},[157],{"categories":5643},[179],{"categories":5645},[92],{"categories":5647},[248],{"categories":5649},[223],{"categories":5651},[92],{"categories":5653},[137],{"categories":5655},[145],{"categories":5657},[92],{"categories":5659},[145],{"categories":5661},[145],{"categories":5663},[92],{"categories":5665},[140],{"categories":5667},[],{"categories":5669},[223],{"categories":5671},[92],{"categories":5673},[],{"categories":5675},[179],{"categories":5677},[92],{"categories":5679},[223],{"categories":5681},[92],{"categories":5683},[157],{"categories":5685},[157],{"categories":5687},[157],{"categories":5689},[145],{"categories":5691},[145],{"categories":5693},[145],{"categories":5695},[92],{"categories":5697},[92],{"categories":5699},[220],{"categories":5701},[223],{"categories":5703},[223],{"categories":5705},[],{"categories":5707},[179],{"categories":5709},[92],{"categories":5711},[92],{"categories":5713},[157],{"categories":5715},[],{"categories":5717},[179],{"categories":5719},[179],{"categories":5721},[179],{"categories":5723},[],{"categories":5725},[145],{"categories":5727},[92],{"categories":5729},[],{"categories":5731},[137],{"categories":5733},[140],{"categories":5735},[],{"categories":5737},[92],{"categories":5739},[92],{"categories":5741},[],{"categories":5743},[157],{"categories":5745},[],{"categories":5747},[],{"categories":5749},[],{"categories":5751},[],{"categories":5753},[92],{"categories":5755},[179],{"categories":5757},[],{"categories":5759},[],{"categories":5761},[92],{"categories":5763},[92],{"categories":5765},[92],{"categories":5767},[223],{"categories":5769},[92],{"categories":5771},[223],{"categories":5773},[],{"categories":5775},[223],{"categories":5777},[223],{"categories":5779},[283],{"categories":5781},[145],{"categories":5783},[157],{"categories":5785},[],{"categories":5787},[],{"categories":5789},[223],{"categories":5791},[157],{"categories":5793},[157],{"categories":5795},[157],{"categories":5797},[],{"categories":5799},[137],{"categories":5801},[157],{"categories":5803},[157],{"categories":5805},[137],{"categories":5807},[157],{"categories":5809},[140],{"categories":5811},[157],{"categories":5813},[157],{"categories":5815},[157],{"categories":5817},[223],{"categories":5819},[179],{"categories":5821},[179],{"categories":5823},[92],{"categories":5825},[157],{"categories":5827},[223],{"categories":5829},[283],{"categories":5831},[223],{"categories":5833},[223],{"categories":5835},[223],{"categories":5837},[],{"categories":5839},[140],{"categories":5841},[],{"categories":5843},[283],{"categories":5845},[157],{"categories":5847},[157],{"categories":5849},[157],{"categories":5851},[145],{"categories":5853},[179,140],{"categories":5855},[223],{"categories":5857},[],{"categories":5859},[],{"categories":5861},[223],{"categories":5863},[],{"categories":5865},[223],{"categories":5867},[179],{"categories":5869},[145],{"categories":5871},[],{"categories":5873},[157],{"categories":5875},[92],{"categories":5877},[220],{"categories":5879},[],{"categories":5881},[92],{"categories":5883},[],{"categories":5885},[179],{"categories":5887},[137],{"categories":5889},[223],{"categories":5891},[],{"categories":5893},[157],{"categories":5895},[179],[5897,6004,6198,6273],{"id":5898,"title":5899,"ai":5900,"body":5906,"categories":5960,"created_at":93,"date_modified":93,"description":85,"extension":94,"faq":93,"featured":95,"kicker_label":93,"meta":5961,"navigation":113,"path":5990,"published_at":5991,"question":93,"scraped_at":5992,"seo":5993,"sitemap":5994,"source_id":5995,"source_name":5996,"source_type":5997,"source_url":5998,"stem":5999,"tags":6000,"thumbnail_url":93,"tldr":6001,"tweet":93,"unknown_tags":6002,"__hash__":6003},"summaries\u002Fsummaries\u002F352a655761b08b28-35b-models-on-rtx-4090-turboquant-kv-compression-u-summary.md","35B Models on RTX 4090: TurboQuant KV Compression Unlocks 32K Context",{"provider":7,"model":5901,"input_tokens":5902,"output_tokens":5903,"processing_time_ms":5904,"cost_usd":5905},"x-ai\u002Fgrok-4.1-fast",6914,2052,13171,0.00190195,{"type":14,"value":5907,"toc":5954},[5908,5912,5915,5919,5922,5926,5932,5938,5944,5947,5951],[17,5909,5911],{"id":5910},"q4_k_m-quantization-delivers-90-95-quality-at-60-original-size","Q4_K_M Quantization Delivers 90-95% Quality at 60% Original Size",[22,5913,5914],{},"Q4_K_M GGUF compresses model weights to ~0.6 GB per billion parameters (7B → 4GB, 32B → 19GB, 70B → 40GB) by storing weights in 4 bits with K-quant block grouping and M-medium mixed precision for sensitive layers. This preserves 90-95% of FP16 accuracy, making it the default for local runs on HuggingFace\u002FOllama. Dense 35B models need 21-22GB VRAM for weights alone on RTX 4090 (24GB total), leaving ~2GB for KV cache—insufficient beyond short contexts. MoE 35B (e.g., Qwen2.5-35B-A3B) activates only 3B params\u002Ftoken, fitting in ~20GB with 1.2GB KV at 64K context due to fewer active heads, reducing TurboQuant's necessity.",[17,5916,5918],{"id":5917},"turboquant-stacks-on-weights-for-long-context-memory-wins","TurboQuant Stacks on Weights for Long-Context Memory Wins",[22,5920,5921],{},"TurboQuant compresses KV cache to 2-4 bits at inference (PolarQuant + QJL, e.g., bits=3) without touching weights, enabling dense models like Mistral Small 3.1 24B or Qwen2.5-32B (64 layers, 8 GQA heads, head_dim=128) to handle 32K context on 24GB VRAM. Formula: 2 × layers × heads × head_dim × seq_len × bytes\u002Felement. Without it, 16K context KV hits ~4GB (total ~24GB borderline); with turbo3, drops to ~1.2GB, freeing space for 32K (~2.4GB). Fused Triton kernels compute attention on compressed KV, speeding up >8K contexts (major at 32K+). Asymmetric K@3bits\u002FV@2bits saves more with zero quality loss empirically.",[17,5923,5925],{"id":5924},"three-paths-to-turboquant-on-24gb-gpus-today","Three Paths to TurboQuant on 24GB GPUs Today",[22,5927,5928,5931],{},[26,5929,5930],{},"PyPI turboquant-kv",": Wrap HF Transformers (load_in_4bit) with TurboQuantModel(bits=3).enable_decoder_fused_attention() for Python scripts; handles 512+ new tokens on long inputs.",[22,5933,5934,5937],{},[26,5935,5936],{},"vLLM fork (0xSero\u002Fturboquant)",": install_turboquant_vllm(bits=3, head_dim=128) before LLM(model, gpu_memory_utilization=0.92); prebuilt codebooks for d=128\u002F256 at 2\u002F3\u002F4 bits; server-friendly.",[22,5939,5940,5943],{},[26,5941,5942],{},"llama.cpp fork (turboquant_plus)",": Build with CUDA, run llama-server -m model-Q4_K_M.gguf --cache-type-k turbo3 --cache-type-v turbo2 -c 32768 -ngl 99. Turbo4 ≈ q8_0 quality, turbo3 best tradeoff, turbo2 extreme. Fits 32K on Qwen2.5-32B (19GB weights + \u003C4GB KV).",[22,5945,5946],{},"Quality holds ≥8B models; speedups context-dependent (\u003C2K: memory only). Experimental—await Google impl (Q2-Q3 2026), llama.cpp #20969, vLLM #38171 merges.",[17,5948,5950],{"id":5949},"optimal-stack-q4_k_m-gguf-turboquant_plus-turbo32","Optimal Stack: Q4_K_M GGUF + turboquant_plus turbo3\u002F2",[22,5952,5953],{},"Download Q4_K_M GGUF, use llama.cpp fork at 16-32K context. Achieves reliable 35B dense inference where defaults crash; 128K impossible (KV still GBs post-compression).",{"title":85,"searchDepth":86,"depth":86,"links":5955},[5956,5957,5958,5959],{"id":5910,"depth":86,"text":5911},{"id":5917,"depth":86,"text":5918},{"id":5924,"depth":86,"text":5925},{"id":5949,"depth":86,"text":5950},[92],{"content_references":5962,"triage":5988},[5963,5967,5970,5974,5976,5979,5982,5985],{"type":5964,"title":5965,"url":5966,"context":107},"other","GGUF","https:\u002F\u002Fhuggingface.co\u002Fdocs\u002Fhub\u002Fgguf",{"type":5964,"title":5968,"url":5969,"context":107},"AWQ","https:\u002F\u002Fhuggingface.co\u002Fdocs\u002Ftransformers\u002Fquantization\u002Fawq",{"type":5964,"title":5971,"url":5972,"context":5973},"VRAM Requirements for AI Models","https:\u002F\u002Fwillitrunai.com\u002Fblog\u002Fvram-requirements-for-ai-models","cited",{"type":99,"title":5975,"context":102},"turboquant-kv",{"type":99,"title":5977,"url":5978,"context":102},"0xSero\u002Fturboquant","https:\u002F\u002Fgithub.com\u002F0xSero\u002Fturboquant.git",{"type":99,"title":5980,"url":5981,"context":102},"turboquant_plus","https:\u002F\u002Fgithub.com\u002FTheTom\u002Fturboquant_plus.git",{"type":5964,"title":5983,"url":5984,"context":107},"llama.cpp discussion #20969","https:\u002F\u002Fgithub.com\u002Fggml-org\u002Fllama.cpp\u002Fdiscussions\u002F20969",{"type":5964,"title":5986,"url":5987,"context":107},"vLLM issue #38171","https:\u002F\u002Fgithub.com\u002Fvllm-project\u002Fvllm\u002Fissues\u002F38171",{"relevance":109,"novelty":110,"quality":110,"actionability":110,"composite":111,"reasoning":5989},"Category: AI & LLMs. The article provides in-depth technical insights on running large language models efficiently, addressing the pain point of integrating AI features into products. It offers specific implementation paths for using TurboQuant, which is actionable for developers looking to optimize AI model performance.","\u002Fsummaries\u002F352a655761b08b28-35b-models-on-rtx-4090-turboquant-kv-compression-u-summary","2026-04-15 12:31:01","2026-04-15 15:39:14",{"title":5899,"description":85},{"loc":5990},"352a655761b08b28","Towards AI","article","https:\u002F\u002Fpub.towardsai.net\u002Frunning-a-35b-model-locally-with-turboquant-whats-actually-possible-right-now-1ac5327430b0?source=rss----98111c9905da---4","summaries\u002F352a655761b08b28-35b-models-on-rtx-4090-turboquant-kv-compression-u-summary",[125,126,127],"Stack Q4_K_M weight quantization with TurboQuant's 3-bit KV cache compression to run dense 35B models at 32K context on 24GB VRAM, fitting weights (20GB) + KV cache (under 4GB) with room to spare—use llama.cpp forks today.",[],"sGRm9blteDamXpWHWdqmPUk1Seq5Nct_nBmywP1bFT0",{"id":6005,"title":6006,"ai":6007,"body":6012,"categories":6177,"created_at":93,"date_modified":93,"description":85,"extension":94,"faq":93,"featured":95,"kicker_label":93,"meta":6178,"navigation":113,"path":6187,"published_at":93,"question":93,"scraped_at":6188,"seo":6189,"sitemap":6190,"source_id":6191,"source_name":6192,"source_type":5997,"source_url":5987,"stem":6193,"tags":6194,"thumbnail_url":93,"tldr":6195,"tweet":93,"unknown_tags":6196,"__hash__":6197},"summaries\u002Fsummaries\u002Fd32d038984e0c1db-turboquant-4-7x-kv-cache-compression-in-vllm-summary.md","TurboQuant: 4-7x KV Cache Compression in vLLM",{"provider":7,"model":5901,"input_tokens":6008,"output_tokens":6009,"processing_time_ms":6010,"cost_usd":6011},10176,1474,8441,0.0027497,{"type":14,"value":6013,"toc":6172},[6014,6018,6021,6024,6028,6031,6110,6113,6117,6120,6169],[17,6015,6017],{"id":6016},"turboquant-delivers-superior-kv-cache-compression","TurboQuant Delivers Superior KV Cache Compression",[22,6019,6020],{},"TurboQuant uses online vector quantization with QR rotation, Lloyd-Max codebooks, and bit-packing for 2-4 bit (including 2.5\u002F3.5 fractional) KV caches, achieving provably near-optimal distortion within 2.7x of information-theoretic limits. Unlike scalar methods like FP8 (e4m3\u002Fe5m2) or INT4, it preserves inner products unbiased—key for attention—while enabling 4-5x memory savings. Paper benchmarks show perfect Needle-in-a-Haystack recall at 4x compression and competitive LongBench scores at 2.5-3.5 bits\u002Fdim. It requires no preprocessing, runs online, and suits accelerators.",[22,6022,6023],{},"vLLM alternatives (FP8, compressed-tensors) optimize MSE element-wise but lack vector codebooks, inner-product focus, theoretical guarantees, or sub-4-bit flexibility.",[17,6025,6027],{"id":6026},"proven-zero-loss-performance-and-throughput-gains","Proven Zero-Loss Performance and Throughput Gains",[22,6029,6030],{},"PoC on Qwen2.5-7B (H200, 4K-16K context) yields:",[6032,6033,6034,6053],"table",{},[6035,6036,6037],"thead",{},[6038,6039,6040,6044,6047,6050],"tr",{},[6041,6042,6043],"th",{},"Config",[6041,6045,6046],{},"Exact Match",[6041,6048,6049],{},"Avg Cache GB",[6041,6051,6052],{},"vs Full",[6054,6055,6056,6071,6084,6097],"tbody",{},[6038,6057,6058,6062,6065,6068],{},[6059,6060,6061],"td",{},"Full",[6059,6063,6064],{},"6\u002F6",[6059,6066,6067],{},"0.510",[6059,6069,6070],{},"1.0x",[6038,6072,6073,6076,6078,6081],{},[6059,6074,6075],{},"TQ 2-bit",[6059,6077,6064],{},[6059,6079,6080],{},"0.068",[6059,6082,6083],{},"7.5x",[6038,6085,6086,6089,6091,6094],{},[6059,6087,6088],{},"TQ 3.5-bit",[6059,6090,6064],{},[6059,6092,6093],{},"0.112",[6059,6095,6096],{},"4.5x",[6038,6098,6099,6102,6104,6107],{},[6059,6100,6101],{},"TQ 4-bit",[6059,6103,6064],{},[6059,6105,6106],{},"0.132",[6059,6108,6109],{},"3.9x",[22,6111,6112],{},"Upstream PR #38280 (Qwen2.5-1.5B, H200) confirms 12\u002F12 exact matches across bit-widths, TTFT\u002FITL latency matching baseline (9.3ms\u002F8.4ms), and 21% throughput boost at batch=16. Phase 2 adds bit-packed uint8 storage (ceil(head_size*bits\u002F8)+2 bytes\u002Fslot) for full ratios.",[17,6114,6116],{"id":6115},"straightforward-vllm-integration-path","Straightforward vLLM Integration Path",[22,6118,6119],{},"Aligns with vLLM's framework:",[70,6121,6122,6138,6145,6152,6159,6162],{},[41,6123,6124,6125,6129,6130,6133,6134,6137],{},"Extend ",[6126,6127,6128],"code",{},"CacheDType"," in ",[6126,6131,6132],{},"cache.py","\u002F",[6126,6135,6136],{},"torch_utils.py"," for integer indices.",[41,6139,6140,6141,6144],{},"Add ",[6126,6142,6143],{},"@register_quantization_config(\"turboquant\") TurboQuantConfig"," targeting Attention layers.",[41,6146,6147,6148,6151],{},"Implement ",[6126,6149,6150],{},"TurboQuantKVCacheMethod"," (extends BaseKVCacheMethod) for codebook params, MSE\u002FIP variants, per-head support.",[41,6153,6154,6155,6158],{},"Update ",[6126,6156,6157],{},"is_quantized_kv_cache()"," detection.",[41,6160,6161],{},"CUDA\u002FTriton encode\u002Fdecode kernels (43\u002F43 tests pass).",[41,6163,6164,6165,6168],{},"Adjust ",[6126,6166,6167],{},"KVCacheSpec"," for codebook overhead\u002Fvariable ratios.",[22,6170,6171],{},"PoC covers steps 1-5; PR #38280 integrates fully with Triton attention. Related: PolarQuant, ollama\u002Follama#15051, llama.cpp#20977, vllm-omni#2214.",{"title":85,"searchDepth":86,"depth":86,"links":6173},[6174,6175,6176],{"id":6016,"depth":86,"text":6017},{"id":6026,"depth":86,"text":6027},{"id":6115,"depth":86,"text":6116},[92],{"content_references":6179,"triage":6183},[6180],{"type":104,"title":6181,"url":6182,"context":5973},"TurboQuant: Online Vector Quantization with Near-optimal Distortion Rate","https:\u002F\u002Farxiv.org\u002Fpdf\u002F2504.19874",{"relevance":110,"novelty":6184,"quality":110,"actionability":110,"composite":6185,"reasoning":6186},3,3.8,"Category: AI & LLMs. The article discusses TurboQuant's vector quantization for KV cache compression, which is relevant for AI engineers looking to optimize LLM performance. It provides specific integration steps for vLLM, making it actionable for developers, though the content is quite technical and may not be accessible to all audiences.","\u002Fsummaries\u002Fd32d038984e0c1db-turboquant-4-7x-kv-cache-compression-in-vllm-summary","2026-04-16 03:08:39",{"title":6006,"description":85},{"loc":6187},"d32d038984e0c1db","__oneoff__","summaries\u002Fd32d038984e0c1db-turboquant-4-7x-kv-cache-compression-in-vllm-summary",[125,126,127],"TurboQuant vector quantization compresses vLLM KV caches 3.9-7.5x at 2-4 bits\u002Fdim with perfect Needle-in-a-Haystack recall, zero latency overhead, and 21% throughput gains.",[],"XlnqSgcG5nhgzzRW6Sdk3XPgtmFuSj6gJC1hWx2uIwk",{"id":6199,"title":6200,"ai":6201,"body":6206,"categories":6240,"created_at":93,"date_modified":93,"description":85,"extension":94,"faq":93,"featured":95,"kicker_label":93,"meta":6241,"navigation":113,"path":6260,"published_at":6261,"question":93,"scraped_at":6262,"seo":6263,"sitemap":6264,"source_id":6265,"source_name":6266,"source_type":5997,"source_url":6267,"stem":6268,"tags":6269,"thumbnail_url":93,"tldr":6270,"tweet":93,"unknown_tags":6271,"__hash__":6272},"summaries\u002Fsummaries\u002F4bc22ffbce5da7c8-mythos-ai-finds-1000s-of-firefox-bugs-13x-more-fix-summary.md","Mythos AI Finds 1000s of Firefox Bugs, 13x More Fixes",{"provider":7,"model":5901,"input_tokens":6202,"output_tokens":6203,"processing_time_ms":6204,"cost_usd":6205},6183,1931,22855,0.0021796,{"type":14,"value":6207,"toc":6235},[6208,6212,6215,6218,6222,6225,6228,6232],[17,6209,6211],{"id":6210},"breakthrough-in-ai-driven-vulnerability-hunting","Breakthrough in AI-Driven Vulnerability Hunting",[22,6213,6214],{},"Anthropic's Mythos model excels at detecting high-severity software bugs that evaded humans for years, uncovering thousands before public release—including a 15-year-old HTML parsing flaw and intricate sandbox escapes in Firefox. Unlike prior AI tools plagued by false positives and low-quality reports, Mythos uses agentic capabilities to self-assess outputs, write exploit patches, and verify attacks on hardened code. This multi-step reasoning—crafting malicious code, implementing it, then breaching the sandbox—demands creativity humans rarely match at scale. Result: Mythos outperforms Mozilla's $20,000-per-bug bounty program, finding more sandbox issues than all human researchers combined.",[22,6216,6217],{},"Mozilla attributes the leap to dual advances: Mythos' raw capability surge since late 2025, plus refined prompting techniques to harness it effectively. Security teams now filter noise automatically, turning AI from liability to accelerator.",[17,6219,6221],{"id":6220},"firefox-ships-13x-more-fixes-without-automating-patches","Firefox Ships 13x More Fixes Without Automating Patches",[22,6223,6224],{},"Integrating Mythos slashed vulnerability discovery time, driving Firefox to 423 fixes in April 2026—up from 31 the prior year. Mozilla detailed 12 bugs publicly, from sandbox pairs to legacy parser errors, all dormant until AI scrutiny. Internally, Mythos scans yield industry-leading signals, per engineer Brian Grinstead.",[22,6226,6227],{},"AI generates patch prototypes, but deployment demands human intervention: one engineer codes, another reviews. Patches aren't yet automatable due to reliability gaps, preserving safety in production browsers. This hybrid workflow maximizes speed without risking stability—AI for exploration, engineers for precision.",[17,6229,6231],{"id":6230},"net-advantage-tilts-toward-defenders-in-ai-arms-race","Net Advantage Tilts Toward Defenders in AI Arms Race",[22,6233,6234],{},"Mythos fixes exhaust finite bugs, potentially strengthening software long-term, as Anthropic CEO Dario Amodei argues: \"There are only so many bugs to find.\" Mozilla's Grinstead concurs it's useful for attackers but shifts edge to defense via accessible tools for good actors. One month post-preview, patches lag disclosure, but responsible practices limit harm. Bad actors trail with weaker models, buying time for remediation. Unknowns persist—full impact emerges as patches ship—but early evidence favors proactive teams scaling AI ethically.",{"title":85,"searchDepth":86,"depth":86,"links":6236},[6237,6238,6239],{"id":6210,"depth":86,"text":6211},{"id":6220,"depth":86,"text":6221},{"id":6230,"depth":86,"text":6231},[],{"content_references":6242,"triage":6257},[6243,6247,6251,6254],{"type":5964,"title":6244,"author":6245,"url":6246,"context":5973},"Mythos preview","Anthropic","https:\u002F\u002Fred.anthropic.com\u002F2026\u002Fmythos-preview\u002F",{"type":5964,"title":6248,"author":6249,"url":6250,"context":5973},"Behind the scenes: Hardening Firefox","Mozilla","https:\u002F\u002Fhacks.mozilla.org\u002F2026\u002F05\u002Fbehind-the-scenes-hardening-firefox",{"type":5964,"title":6252,"author":6249,"url":6253,"context":107},"client bug bounty","https:\u002F\u002Fwww.mozilla.org\u002Fen-US\u002Fsecurity\u002Fclient-bug-bounty\u002F",{"type":5964,"title":6255,"url":6256,"context":107},"a recent event","https:\u002F\u002Fyoutu.be\u002FL1hB6Nz16Fw?si=IUHfFuCk3O9IEvUx&t=1147",{"relevance":110,"novelty":6184,"quality":110,"actionability":6184,"composite":6258,"reasoning":6259},3.6,"Category: AI & LLMs. The article discusses the practical application of an AI model in software engineering, specifically in vulnerability detection, which addresses a pain point for developers looking to integrate AI into their workflows. It provides insights into how Mythos improves bug detection but lacks detailed actionable steps for implementation.","\u002Fsummaries\u002F4bc22ffbce5da7c8-mythos-ai-finds-1000s-of-firefox-bugs-13x-more-fix-summary","2026-05-07 16:05:48","2026-05-07 16:43:31",{"title":6200,"description":85},{"loc":6260},"4bc22ffbce5da7c8","TechCrunch AI","https:\u002F\u002Ftechcrunch.com\u002F2026\u002F05\u002F07\u002Fhow-anthropics-mythos-has-rewritten-firefoxs-approach-to-cybersecurity\u002F","summaries\u002F4bc22ffbce5da7c8-mythos-ai-finds-1000s-of-firefox-bugs-13x-more-fix-summary",[125,126,128],"Anthropic's Mythos LLM discovered thousands of high-severity vulnerabilities in Firefox, including decade-old ones and rare sandbox escapes, enabling 423 fixes in April 2026 vs 31 prior year—by automating discovery while humans patch.",[128],"kV7I4yigcg5wJoncyJCz-VLFgND8l_tLRKI_x-WZM7w",{"id":6274,"title":6275,"ai":6276,"body":6281,"categories":6628,"created_at":93,"date_modified":93,"description":85,"extension":94,"faq":93,"featured":95,"kicker_label":93,"meta":6629,"navigation":113,"path":6630,"published_at":6631,"question":93,"scraped_at":93,"seo":6632,"sitemap":6633,"source_id":6634,"source_name":6635,"source_type":5997,"source_url":6636,"stem":6637,"tags":6638,"thumbnail_url":93,"tldr":6639,"tweet":93,"unknown_tags":6640,"__hash__":6641},"summaries\u002Fsummaries\u002Fllm-as-judge-evaluates-rag-keyword-beats-vector-summary.md","LLM-as-Judge Evaluates RAG: Keyword Beats Vector",{"provider":7,"model":5901,"input_tokens":6277,"output_tokens":6278,"processing_time_ms":6279,"cost_usd":6280},5849,1975,17506,0.0021348,{"type":14,"value":6282,"toc":6623},[6283,6287,6294,6300,6320,6325,6343,6358,6362,6373,6394,6397,6468,6471,6498,6501,6521,6524,6559,6563,6566,6612,6619],[17,6284,6286],{"id":6285},"rag-needs-automated-internal-evaluation-for-optimization","RAG Needs Automated Internal Evaluation for Optimization",[22,6288,6289,6290,6293],{},"RAG systems require quantitative evaluation to compare optimizations like retrieval strategies, avoiding manual checks that are slow and subjective—integrate into CI\u002FCD pipelines like unit tests. Focus on ",[26,6291,6292],{},"internal evaluation"," of retrieval and generation modules:",[22,6295,6296,6299],{},[26,6297,6298],{},"Retrieval metrics",":",[70,6301,6302,6308,6314],{},[41,6303,6304,6307],{},[26,6305,6306],{},"Relevance",": Retrieved chunks match query?",[41,6309,6310,6313],{},[26,6311,6312],{},"Coverage",": All relevant database chunks fetched?",[41,6315,6316,6319],{},[26,6317,6318],{},"Correctness",": High signal-to-noise ratio, relevant chunks ranked top?",[22,6321,6322,6299],{},[26,6323,6324],{},"Generation metrics",[70,6326,6327,6332,6338],{},[41,6328,6329,6331],{},[26,6330,6306],{},": Answer aligns with query, no off-topic drift?",[41,6333,6334,6337],{},[26,6335,6336],{},"Factuality",": Answer grounded in retrieved sources, no hallucinations?",[41,6339,6340,6342],{},[26,6341,6318],{},": Answer factually accurate?",[22,6344,6345,6346,6349,6350,6353,6354,6357],{},"Prefer ",[26,6347,6348],{},"LLM-as-a-judge"," over traditional NLP metrics (ROUGE, BLEU) for nuanced semantic judgment. Ground evaluators in production setups like Azure AI Search indexes (e.g., ",[6126,6351,6352],{},"rag-evalution-chris"," with 50 chunks from employee handbook PDFs, vectorized in ",[6126,6355,6356],{},"text_vector"," field).",[17,6359,6361],{"id":6360},"azure-sdk-evaluators-automate-llm-as-judge-scoring","Azure SDK Evaluators Automate LLM-as-Judge Scoring",[22,6363,6364,6365,6368,6369,6372],{},"Leverage ",[6126,6366,6367],{},"azure.ai.evaluation"," package with GPT-4 (",[6126,6370,6371],{},"gpt-4.1"," deployment) for zero-shot scoring (1.0-5.0 scale). Key evaluators:",[70,6374,6375,6385],{},[41,6376,6377,6380,6381,6384],{},[26,6378,6379],{},"GroundednessEvaluator",": Measures answer's fidelity to sources—scores drop if facts can't be verified in context, even if externally true. Input: ",[6126,6382,6383],{},"response=answer, context=sources",".",[41,6386,6387,6390,6391,6384],{},[26,6388,6389],{},"RelevanceEvaluator",": Checks query-response alignment and contextual fit. Input: ",[6126,6392,6393],{},"query=user_question, response=answer, context=sources",[22,6395,6396],{},"Setup clients for Azure AI Search and OpenAI:",[6398,6399,6402],"pre",{"className":6400,"code":6401,"language":127,"meta":85,"style":85},"language-python shiki shiki-themes github-light github-dark","import os\nfrom azure.search.documents import SearchClient\nfrom azure.search.documents.models import VectorizedQuery\nfrom openai import AzureOpenAI\n# Load env vars: AZURE_SEARCH_*, AZURE_OPENAI_*\nopenai_client = AzureOpenAI(api_key=AZURE_OPENAI_API_KEY, azure_endpoint=AZURE_OPENAI_ENDPOINT, api_version=\"2024-10-21\")\nsearch_client = SearchClient(endpoint=AZURE_SEARCH_ENDPOINT, index_name=AZURE_SEARCH_INDEX_NAME, credential=AzureKeyCredential(AZURE_SEARCH_ADMIN_KEY))\n\ndef get_embedding_vector(query: str) -> list[float]:\n    response = openai_client.embeddings.create(model=AZURE_OPENAI_EMBEDDING_DEPLOYMENT_NAME, input=[query])\n    return response.data[0].embedding\n",[6126,6403,6404,6412,6417,6422,6427,6432,6438,6444,6450,6456,6462],{"__ignoreMap":85},[6405,6406,6409],"span",{"class":6407,"line":6408},"line",1,[6405,6410,6411],{},"import os\n",[6405,6413,6414],{"class":6407,"line":86},[6405,6415,6416],{},"from azure.search.documents import SearchClient\n",[6405,6418,6419],{"class":6407,"line":6184},[6405,6420,6421],{},"from azure.search.documents.models import VectorizedQuery\n",[6405,6423,6424],{"class":6407,"line":110},[6405,6425,6426],{},"from openai import AzureOpenAI\n",[6405,6428,6429],{"class":6407,"line":109},[6405,6430,6431],{},"# Load env vars: AZURE_SEARCH_*, AZURE_OPENAI_*\n",[6405,6433,6435],{"class":6407,"line":6434},6,[6405,6436,6437],{},"openai_client = AzureOpenAI(api_key=AZURE_OPENAI_API_KEY, azure_endpoint=AZURE_OPENAI_ENDPOINT, api_version=\"2024-10-21\")\n",[6405,6439,6441],{"class":6407,"line":6440},7,[6405,6442,6443],{},"search_client = SearchClient(endpoint=AZURE_SEARCH_ENDPOINT, index_name=AZURE_SEARCH_INDEX_NAME, credential=AzureKeyCredential(AZURE_SEARCH_ADMIN_KEY))\n",[6405,6445,6447],{"class":6407,"line":6446},8,[6405,6448,6449],{"emptyLinePlaceholder":113},"\n",[6405,6451,6453],{"class":6407,"line":6452},9,[6405,6454,6455],{},"def get_embedding_vector(query: str) -> list[float]:\n",[6405,6457,6459],{"class":6407,"line":6458},10,[6405,6460,6461],{},"    response = openai_client.embeddings.create(model=AZURE_OPENAI_EMBEDDING_DEPLOYMENT_NAME, input=[query])\n",[6405,6463,6465],{"class":6407,"line":6464},11,[6405,6466,6467],{},"    return response.data[0].embedding\n",[22,6469,6470],{},"Retrieval (top=5):",[70,6472,6473,6482,6490],{},[41,6474,6475,6478,6479],{},[26,6476,6477],{},"Keyword",": ",[6126,6480,6481],{},"search_client.search(search_text=user_question)",[41,6483,6484,6478,6487],{},[26,6485,6486],{},"Vector",[6126,6488,6489],{},"search_client.search(None, vector_queries=[VectorizedQuery(vector=get_embedding_vector(user_question), k_nearest_neighbors=50, fields=\"text_vector\")])",[41,6491,6492,6478,6495],{},[26,6493,6494],{},"Hybrid (semantic)",[6126,6496,6497],{},"search_client.search(user_question, vector_queries=[...], query_type=\"semantic\", semantic_configuration_name=\"rag-evaluation-chris-semantic-configuration\")",[22,6499,6500],{},"Generation prompt enforces grounding:",[6398,6502,6504],{"className":6400,"code":6503,"language":127,"meta":85,"style":85},"SYSTEM_MESSAGE = \"\"\"Answer ONLY with facts from sources. Use [source] citations.\"\"\"\nresponse = openai_client.chat.completions.create(model=AZURE_OPENAI_LLM_DEPLOYMENT_NAME, messages=[{\"role\": \"system\", \"content\": SYSTEM_MESSAGE}, {\"role\": \"user\", \"content\": user_question + \"\\nSources: \" + sources}])\nanswer = response.choices[0].message.content\n",[6126,6505,6506,6511,6516],{"__ignoreMap":85},[6405,6507,6508],{"class":6407,"line":6408},[6405,6509,6510],{},"SYSTEM_MESSAGE = \"\"\"Answer ONLY with facts from sources. Use [source] citations.\"\"\"\n",[6405,6512,6513],{"class":6407,"line":86},[6405,6514,6515],{},"response = openai_client.chat.completions.create(model=AZURE_OPENAI_LLM_DEPLOYMENT_NAME, messages=[{\"role\": \"system\", \"content\": SYSTEM_MESSAGE}, {\"role\": \"user\", \"content\": user_question + \"\\nSources: \" + sources}])\n",[6405,6517,6518],{"class":6407,"line":6184},[6405,6519,6520],{},"answer = response.choices[0].message.content\n",[22,6522,6523],{},"Evaluate:",[6398,6525,6527],{"className":6400,"code":6526,"language":127,"meta":85,"style":85},"from azure.ai.evaluation import AzureOpenAIModelConfiguration, GroundednessEvaluator, RelevanceEvaluator\nmodel_config = {\"azure_endpoint\": AZURE_OPENAI_ENDPOINT, \"azure_deployment\": AZURE_OPENAI_LLM_DEPLOYMENT_NAME, \"api_key\": AZURE_OPENAI_API_KEY}\nrelevance_eval = RelevanceEvaluator(model_config)\ngroundedness_eval = GroundednessEvaluator(model_config)\nrelevance_score = relevance_eval(query=user_question, response=answer, context=sources)\ngroundedness_score = groundedness_eval(response=answer, context=sources)\n",[6126,6528,6529,6534,6539,6544,6549,6554],{"__ignoreMap":85},[6405,6530,6531],{"class":6407,"line":6408},[6405,6532,6533],{},"from azure.ai.evaluation import AzureOpenAIModelConfiguration, GroundednessEvaluator, RelevanceEvaluator\n",[6405,6535,6536],{"class":6407,"line":86},[6405,6537,6538],{},"model_config = {\"azure_endpoint\": AZURE_OPENAI_ENDPOINT, \"azure_deployment\": AZURE_OPENAI_LLM_DEPLOYMENT_NAME, \"api_key\": AZURE_OPENAI_API_KEY}\n",[6405,6540,6541],{"class":6407,"line":6184},[6405,6542,6543],{},"relevance_eval = RelevanceEvaluator(model_config)\n",[6405,6545,6546],{"class":6407,"line":110},[6405,6547,6548],{},"groundedness_eval = GroundednessEvaluator(model_config)\n",[6405,6550,6551],{"class":6407,"line":109},[6405,6552,6553],{},"relevance_score = relevance_eval(query=user_question, response=answer, context=sources)\n",[6405,6555,6556],{"class":6407,"line":6434},[6405,6557,6558],{},"groundedness_score = groundedness_eval(response=answer, context=sources)\n",[17,6560,6562],{"id":6561},"keyword-search-wins-for-simple-queries-enables-agentic-rag","Keyword Search Wins for Simple Queries, Enables Agentic RAG",[22,6564,6565],{},"On query \"What does a product manager do?\" (50-chunk index):",[6032,6567,6568,6580],{},[6035,6569,6570],{},[6038,6571,6572,6575,6578],{},[6041,6573,6574],{},"Method",[6041,6576,6577],{},"Groundedness",[6041,6579,6306],{},[6054,6581,6582,6592,6602],{},[6038,6583,6584,6586,6589],{},[6059,6585,6477],{},[6059,6587,6588],{},"4.5",[6059,6590,6591],{},"5.0",[6038,6593,6594,6597,6600],{},[6059,6595,6596],{},"Hybrid",[6059,6598,6599],{},"4.0",[6059,6601,6588],{},[6038,6603,6604,6606,6609],{},[6059,6605,6486],{},[6059,6607,6608],{},"3.0",[6059,6610,6611],{},"3.5",[22,6613,6614,6615,6618],{},"Keyword search topped scores unexpectedly for this task, proving automated eval reveals trade-offs (e.g., vector struggles with exact phrasing). This closes the loop for ",[26,6616,6617],{},"Agentic RAG",": reliable metrics select best retrieval for self-improving agents.",[6620,6621,6622],"style",{},"html .default .shiki span {color: var(--shiki-default);background: var(--shiki-default-bg);font-style: var(--shiki-default-font-style);font-weight: var(--shiki-default-font-weight);text-decoration: var(--shiki-default-text-decoration);}html .shiki span {color: var(--shiki-default);background: var(--shiki-default-bg);font-style: var(--shiki-default-font-style);font-weight: var(--shiki-default-font-weight);text-decoration: var(--shiki-default-text-decoration);}html .dark .shiki span {color: var(--shiki-dark);background: var(--shiki-dark-bg);font-style: var(--shiki-dark-font-style);font-weight: var(--shiki-dark-font-weight);text-decoration: var(--shiki-dark-text-decoration);}html.dark .shiki span {color: var(--shiki-dark);background: var(--shiki-dark-bg);font-style: var(--shiki-dark-font-style);font-weight: var(--shiki-dark-font-weight);text-decoration: var(--shiki-dark-text-decoration);}",{"title":85,"searchDepth":86,"depth":86,"links":6624},[6625,6626,6627],{"id":6285,"depth":86,"text":6286},{"id":6360,"depth":86,"text":6361},{"id":6561,"depth":86,"text":6562},[],{},"\u002Fsummaries\u002Fllm-as-judge-evaluates-rag-keyword-beats-vector-summary","2026-04-08 21:21:17",{"title":6275,"description":85},{"loc":6630},"20b8d035b68db639","Level Up Coding","https:\u002F\u002Funknown","summaries\u002Fllm-as-judge-evaluates-rag-keyword-beats-vector-summary",[125,127,126],"Use Azure SDK's GroundednessEvaluator (1-5 scale: answer fidelity to sources) and RelevanceEvaluator (query-response alignment) to automate RAG scoring; keyword search outperformed vector\u002Fhybrid on 'product manager duties' query.",[],"WbpHbWCJqCpSbai5hGyHaCpcDDTRGieYViPox5fj2mc"]