[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"summary-41e798aa1961a662-beyond-accuracy-evaluating-ai-agents-after-benchma-summary":3,"summaries-facets-categories":118,"summary-related-41e798aa1961a662-beyond-accuracy-evaluating-ai-agents-after-benchma-summary":5227},{"id":4,"title":5,"ai":6,"body":13,"categories":75,"created_at":77,"date_modified":77,"description":69,"extension":78,"faq":77,"featured":79,"kicker_label":77,"meta":80,"navigation":100,"path":101,"published_at":102,"question":77,"scraped_at":102,"seo":103,"sitemap":104,"source_id":105,"source_name":106,"source_type":107,"source_url":108,"stem":109,"tags":110,"thumbnail_url":77,"tldr":115,"tweet":77,"unknown_tags":116,"__hash__":117},"summaries\u002Fsummaries\u002F41e798aa1961a662-beyond-accuracy-evaluating-ai-agents-after-benchma-summary.md","Beyond Accuracy: Evaluating AI Agents After Benchmark Saturation",{"provider":7,"model":8,"input_tokens":9,"output_tokens":10,"processing_time_ms":11,"cost_usd":12},"openrouter","google\u002Fgemini-3.1-flash-lite",6281,620,3629,0.00250025,{"type":14,"value":15,"toc":68},"minimark",[16,21,25,29,32,61,65],[17,18,20],"h2",{"id":19},"the-problem-with-accuracy-centric-evaluation","The Problem with Accuracy-Centric Evaluation",[22,23,24],"p",{},"Traditional AI evaluation often treats benchmarks as binary: once a model reaches high accuracy, the benchmark is considered 'solved' and retired. This approach is fundamentally flawed because it ignores the nuances of how agents actually perform in real-world environments. Relying solely on accuracy masks critical failures in reasoning, efficiency, and robustness that only become apparent when we look beyond the final score.",[17,26,28],{"id":27},"a-multi-dimensional-evaluation-framework","A Multi-Dimensional Evaluation Framework",[22,30,31],{},"Using CORE-Bench Hard as a case study, the authors propose shifting focus toward six key dimensions of agent performance that remain relevant even after accuracy saturates:",[33,34,35,43,49,55],"ul",{},[36,37,38,42],"li",{},[39,40,41],"strong",{},"Construct Validity:"," Identifying 'shortcuts' where agents pass tests without true understanding. The authors introduced CORE-Bench v1.1 and an out-of-distribution (OOD) suite to better stress-test agent capabilities.",[36,44,45,48],{},[39,46,47],{},"Efficiency & Reliability:"," Measuring the cost, time, and consistency of agent outputs rather than just the correctness of the final result.",[36,50,51,54],{},[39,52,53],{},"Model vs. Scaffold Performance:"," Disentangling the intelligence of the underlying LLM from the effectiveness of the 'scaffold' (the code\u002Fsystem wrapping the model).",[36,56,57,60],{},[39,58,59],{},"Human-Agent Collaboration:"," Assessing the 'uplift' provided by AI in real-world workflows. In a randomized experiment on computational reproducibility, human-agent teams achieved a 2x speedup compared to humans alone, though the study noted that many human-only attempts hit time limits, suggesting the true performance gap may be even wider.",[17,62,64],{"id":63},"moving-toward-rigorous-benchmarking","Moving Toward Rigorous Benchmarking",[22,66,67],{},"The authors argue that saturation is not an end-point but an opportunity to deepen evaluation. By moving away from simple accuracy metrics, developers can build more reliable systems that are actually useful in production. The findings demonstrate that even when agents appear to 'solve' a task, they often lack the reliability and efficiency required for professional scientific or engineering work. Future benchmarking should prioritize these operational metrics to ensure AI tools are ready for real-world deployment.",{"title":69,"searchDepth":70,"depth":70,"links":71},"",2,[72,73,74],{"id":19,"depth":70,"text":20},{"id":27,"depth":70,"text":28},{"id":63,"depth":70,"text":64},[76],"AI & LLMs",null,"md",false,{"content_references":81,"triage":94},[82,86,89,92],{"type":83,"title":84,"context":85},"other","CORE-Bench","mentioned",{"type":83,"title":87,"context":88},"CORE-Bench Hard","reviewed",{"type":83,"title":90,"context":91},"CORE-Bench v1.1","recommended",{"type":83,"title":93,"context":91},"CORE-Bench OOD",{"relevance":95,"novelty":96,"quality":96,"actionability":97,"composite":98,"reasoning":99},5,4,3,4.15,"Category: AI & LLMs. The article provides a comprehensive framework for evaluating AI agents beyond traditional accuracy metrics, addressing a critical pain point for developers who need to ensure their AI systems are reliable and efficient in production. It introduces six dimensions of evaluation that can be directly applied to improve AI product development.",true,"\u002Fsummaries\u002F41e798aa1961a662-beyond-accuracy-evaluating-ai-agents-after-benchma-summary","2026-06-26 12:58:18",{"title":5,"description":69},{"loc":101},"41e798aa1961a662","arXiv cs.AI","article","https:\u002F\u002Farxiv.org\u002Fabs\u002F2606.26158","summaries\u002F41e798aa1961a662-beyond-accuracy-evaluating-ai-agents-after-benchma-summary",[111,112,113,114],"agents","research","ai-llms","evaluation","When AI benchmarks saturate, accuracy becomes a poor metric. Researchers should instead evaluate agents across six dimensions: construct validity, generalizability, efficiency, reliability, model\u002Fscaffold performance, and human-agent collaboration.",[113,114],"1Ugd05Q41bU5Qhe6sZOAaduce3Pr8FzheR7WbGXcis8",[119,122,125,127,130,133,135,137,139,141,143,145,147,149,151,153,156,158,160,162,164,166,168,170,172,174,176,178,180,182,184,186,188,191,194,196,198,200,202,204,207,209,211,213,216,218,220,222,224,226,228,230,232,234,236,238,240,242,245,247,249,251,253,255,257,259,261,263,265,267,269,271,273,275,277,279,281,283,285,287,289,291,293,295,297,299,301,303,305,307,309,311,313,315,317,319,321,323,325,327,329,331,333,335,337,339,341,343,345,347,349,351,353,355,357,359,361,363,365,367,369,371,373,375,377,379,381,383,385,387,389,391,393,395,397,399,401,403,405,407,409,411,413,415,417,419,421,423,425,427,429,431,433,435,437,439,441,443,445,447,449,451,453,455,457,459,461,463,465,467,469,471,473,475,477,479,481,483,485,487,489,491,493,495,497,499,501,503,505,507,509,511,513,515,517,519,521,523,525,527,529,531,533,535,537,539,541,543,545,547,549,551,553,555,557,559,561,563,565,567,569,571,573,575,577,579,581,583,585,587,589,591,593,595,597,599,601,603,605,607,609,611,613,615,617,619,621,623,625,627,629,631,633,635,637,639,641,643,645,647,649,651,653,655,657,659,661,663,665,667,669,671,673,675,677,679,681,683,685,687,689,691,693,695,697,699,701,703,705,707,709,711,713,715,717,719,721,723,725,727,729,731,733,735,737,739,741,743,745,747,749,751,753,755,757,759,761,763,765,767,769,771,773,775,777,779,781,783,785,787,789,791,793,795,797,799,801,803,805,807,809,811,813,815,817,819,821,823,825,827,829,831,833,835,837,839,841,843,845,847,849,851,853,855,857,859,861,863,865,867,869,871,873,875,877,879,881,883,885,887,889,891,893,895,897,899,901,903,905,907,909,911,913,915,917,919,921,923,925,927,929,931,933,935,937,939,941,943,945,947,949,951,953,955,957,959,961,963,965,967,969,971,973,975,977,979,981,983,985,987,989,991,993,995,997,999,1001,1003,1005,1007,1009,1011,1013,1015,1017,1019,1021,1023,1025,1027,1029,1031,1033,1035,1037,1039,1041,1043,1045,1047,1049,1051,1053,1055,1057,1059,1061,1063,1065,1067,1069,1071,1073,1075,1077,1079,1081,1083,1085,1087,1089,1091,1093,1095,1097,1099,1101,1103,1105,1107,1109,1111,1113,1115,1117,1119,1121,1123,1125,1127,1129,1131,1133,1135,1137,1139,1141,1143,1145,1147,1149,1151,1153,1155,1157,1159,1161,1163,1165,1167,1169,1171,1173,1175,1177,1179,1181,1183,1185,1187,1189,1191,1193,1195,1197,1199,1201,1203,1205,1207,1209,1211,1213,1215,1217,1219,1221,1223,1225,1227,1229,1231,1233,1235,1237,1239,1241,1243,1245,1247,1249,1251,1253,1255,1257,1259,1261,1263,1265,1267,1269,1271,1273,1275,1277,1279,1281,1283,1285,1287,1289,1291,1293,1295,1297,1299,1301,1303,1305,1307,1309,1311,1313,1315,1317,1319,1321,1323,1325,1327,1329,1331,1333,1335,1337,1339,1341,1343,1345,1347,1349,1351,1353,1355,1357,1359,1361,1363,1365,1367,1369,1371,1373,1375,1377,1379,1381,1383,1385,1387,1389,1391,1393,1395,1397,1399,1401,1403,1405,1407,1409,1411,1413,1415,1417,1419,1421,1423,1425,1427,1429,1431,1433,1435,1437,1439,1441,1443,1445,1447,1449,1451,1453,1455,1457,1459,1461,1463,1465,1467,1469,1471,1473,1475,1477,1479,1481,1483,1485,1487,1489,1491,1493,1495,1497,1499,1501,1503,1505,1507,1509,1511,1513,1515,1517,1519,1521,1523,1525,1527,1529,1531,1533,1535,1537,1539,1541,1543,1545,1547,1549,1551,1553,1555,1557,1559,1561,1563,1565,1567,1569,1571,1573,1575,1577,1579,1581,1583,1585,1587,1589,1591,1593,1595,1597,1599,1601,1603,1605,1607,1609,1611,1613,1615,1617,1619,1621,1623,1625,1627,1629,1631,1633,1635,1637,1639,1641,1643,1645,1647,1649,1651,1653,1655,1657,1659,1661,1663,1665,1667,1669,1671,1673,1675,1677,1679,1681,1683,1685,1687,1689,1691,1693,1695,1697,1699,1701,1703,1705,1707,1709,1711,1713,1715,1717,1719,1721,1723,1725,1727,1729,1731,1733,1735,1737,1739,1741,1743,1745,1747,1749,1751,1753,1755,1757,1759,1761,1763,1765,1767,1769,1771,1773,1775,1777,1779,1781,1783,1785,1787,1789,1791,1793,1795,1797,1799,1801,1803,1805,1807,1809,1811,1813,1815,1817,1819,1821,1823,1825,1827,1829,1831,1833,1835,1837,1839,1841,1843,1845,1847,1849,1851,1853,1855,1857,1859,1861,1863,1865,1867,1869,1871,1873,1875,1877,1879,1881,1883,1885,1887,1889,1891,1893,1895,1897,1899,1901,1903,1905,1907,1909,1911,1913,1915,1917,1919,1921,1923,1925,1927,1929,1931,1933,1935,1937,1939,1941,1943,1945,1947,1949,1951,1953,1955,1957,1959,1961,1963,1965,1967,1969,1971,1973,1975,1977,1979,1981,1983,1985,1987,1989,1991,1993,1995,1997,1999,2001,2003,2005,2007,2009,2011,2013,2015,2017,2019,2021,2023,2025,2027,2029,2031,2033,2035,2037,2039,2041,2043,2045,2047,2049,2051,2053,2055,2057,2059,2061,2063,2065,2067,2069,2071,2073,2075,2077,2079,2081,2083,2085,2087,2089,2091,2093,2095,2097,2099,2101,2103,2105,2107,2109,2111,2113,2115,2117,2119,2121,2123,2125,2127,2129,2131,2133,2135,2137,2139,2141,2143,2145,2147,2149,2151,2153,2155,2157,2159,2161,2163,2165,2167,2169,2171,2173,2175,2177,2179,2181,2183,2185,2187,2189,2191,2193,2195,2197,2199,2201,2203,2205,2207,2209,2211,2213,2215,2217,2219,2221,2223,2225,2227,2229,2231,2233,2235,2237,2239,2241,2243,2245,2247,2249,2251,2253,2255,2257,2259,2261,2263,2265,2267,2269,2271,2273,2275,2277,2279,2281,2283,2285,2287,2289,2291,2293,2295,2297,2299,2301,2303,2305,2307,2309,2311,2313,2315,2317,2319,2321,2323,2325,2327,2329,2331,2333,2335,2337,2339,2341,2343,2345,2347,2349,2351,2353,2355,2357,2359,2361,2363,2365,2367,2369,2371,2373,2375,2377,2379,2381,2383,2385,2387,2389,2391,2393,2395,2397,2399,2401,2403,2405,2407,2409,2411,2413,2415,2417,2419,2421,2423,2425,2427,2429,2431,2433,2435,2437,2439,2441,2443,2445,2447,2449,2451,2453,2455,2457,2459,2461,2463,2465,2467,2469,2471,2473,2475,2477,2479,2481,2483,2485,2487,2489,2491,2493,2495,2497,2499,2501,2503,2505,2507,2509,2511,2513,2515,2517,2519,2521,2523,2525,2527,2529,2531,2533,2535,2537,2539,2541,2543,2545,2547,2549,2551,2553,2555,2557,2559,2561,2563,2565,2567,2569,2571,2573,2575,2577,2579,2581,2583,2585,2587,2589,2591,2593,2595,2597,2599,2601,2603,2605,2607,2609,2611,2613,2615,2617,2619,2621,2623,2625,2627,2629,2631,2633,2635,2637,2639,2641,2643,2645,2647,2649,2651,2653,2655,2657,2659,2661,2663,2665,2667,2669,2671,2673,2675,2677,2679,2681,2683,2685,2687,2689,2691,2693,2695,2697,2699,2701,2703,2705,2707,2709,2711,2713,2715,2717,2719,2721,2723,2725,2727,2729,2731,2733,2735,2737,2739,2741,2743,2745,2747,2749,2751,2753,2755,2757,2759,2761,2763,2765,2767,2769,2771,2773,2775,2777,2779,2781,2783,2785,2787,2789,2791,2793,2795,2797,2799,2801,2803,2805,2807,2809,2811,2813,2815,2817,2819,2821,2823,2825,2827,2829,2831,2833,2835,2837,2839,2841,2843,2845,2847,2849,2851,2853,2855,2857,2859,2861,2863,2865,2867,2869,2871,2873,2875,2877,2879,2881,2883,2885,2887,2889,2891,2893,2895,2897,2899,2901,2903,2905,2907,2909,2911,2913,2915,2917,2919,2921,2923,2925,2927,2929,2931,2933,2935,2937,2939,2941,2943,2945,2947,2949,2951,2953,2955,2957,2959,2961,2963,2965,2967,2969,2971,2973,2975,2977,2979,2981,2983,2985,2987,2989,2991,2993,2995,2997,2999,3001,3003,3005,3007,3009,3011,3013,3015,3017,3019,3021,3023,3025,3027,3029,3031,3033,3035,3037,3039,3041,3043,3045,3047,3049,3051,3053,3055,3057,3059,3061,3063,3065,3067,3069,3071,3073,3075,3077,3079,3081,3083,3085,3087,3089,3091,3093,3095,3097,3099,3101,3103,3105,3107,3109,3111,3113,3115,3117,3119,3121,3123,3125,3127,3129,3131,3133,3135,3137,3139,3141,3143,3145,3147,3149,3151,3153,3155,3157,3159,3161,3163,3165,3167,3169,3171,3173,3175,3177,3179,3181,3183,3185,3187,3189,3191,3193,3195,3197,3199,3201,3203,3205,3207,3209,3211,3213,3215,3217,3219,3221,3223,3225,3227,3229,3231,3233,3235,3237,3239,3241,3243,3245,3247,3249,3251,3253,3255,3257,3259,3261,3263,3265,3267,3269,3271,3273,3275,3277,3279,3281,3283,3285,3287,3289,3291,3293,3295,3297,3299,3301,3303,3305,3307,3309,3311,3313,3315,3317,3319,3321,3323,3325,3327,3329,3331,3333,3335,3337,3339,3341,3343,3345,3347,3349,3351,3353,3355,3357,3359,3361,3363,3365,3367,3369,3371,3373,3375,3377,3379,3381,3383,3385,3387,3389,3391,3393,3395,3397,3399,3401,3403,3405,3407,3409,3411,3413,3415,3417,3419,3421,3423,3425,3427,3429,3431,3433,3435,3437,3439,3441,3443,3445,3447,3449,3451,3453,3455,3457,3459,3461,3463,3465,3467,3469,3471,3473,3475,3477,3479,3481,3483,3485,3487,3489,3491,3493,3495,3497,3499,3501,3503,3505,3507,3509,3511,3513,3515,3517,3519,3521,3523,3525,3527,3529,3531,3533,3535,3537,3539,3541,3543,3545,3547,3549,3551,3553,3555,3557,3559,3561,3563,3565,3567,3569,3571,3573,3575,3577,3579,3581,3583,3585,3587,3589,3591,3593,3595,3597,3599,3601,3603,3605,3607,3609,3611,3613,3615,3617,3619,3621,3623,3625,3627,3629,3631,3633,3635,3637,3639,3641,3643,3645,3647,3649,3651,3653,3655,3657,3659,3661,3663,3665,3667,3669,3671,3673,3675,3677,3679,3681,3683,3685,3687,3689,3691,3693,3695,3697,3699,3701,3703,3705,3707,3709,3711,3713,3715,3717,3719,3721,3723,3725,3727,3729,3731,3733,3735,3737,3739,3741,3743,3745,3747,3749,3751,3753,3755,3757,3759,3761,3763,3765,3767,3769,3771,3773,3775,3777,3779,3781,3783,3785,3787,3789,3791,3793,3795,3797,3799,3801,3803,3805,3807,3809,3811,3813,3815,3817,3819,3821,3823,3825,3827,3829,3831,3833,3835,3837,3839,3841,3843,3845,3847,3849,3851,3853,3855,3857,3859,3861,3863,3865,3867,3869,3871,3873,3875,3877,3879,3881,3883,3885,3887,3889,3891,3893,3895,3897,3899,3901,3903,3905,3907,3909,3911,3913,3915,3917,3919,3921,3923,3925,3927,3929,3931,3933,3935,3937,3939,3941,3943,3945,3947,3949,3951,3953,3955,3957,3959,3961,3963,3965,3967,3969,3971,3973,3975,3977,3979,3981,3983,3985,3987,3989,3991,3993,3995,3997,3999,4001,4003,4005,4007,4009,4011,4013,4015,4017,4019,4021,4023,4025,4027,4029,4031,4033,4035,4037,4039,4041,4043,4045,4047,4049,4051,4053,4055,4057,4059,4061,4063,4065,4067,4069,4071,4073,4075,4077,4079,4081,4083,4085,4087,4089,4091,4093,4095,4097,4099,4101,4103,4105,4107,4109,4111,4113,4115,4117,4119,4121,4123,4125,4127,4129,4131,4133,4135,4137,4139,4141,4143,4145,4147,4149,4151,4153,4155,4157,4159,4161,4163,4165,4167,4169,4171,4173,4175,4177,4179,4181,4183,4185,4187,4189,4191,4193,4195,4197,4199,4201,4203,4205,4207,4209,4211,4213,4215,4217,4219,4221,4223,4225,4227,4229,4231,4233,4235,4237,4239,4241,4243,4245,4247,4249,4251,4253,4255,4257,4259,4261,4263,4265,4267,4269,4271,4273,4275,4277,4279,4281,4283,4285,4287,4289,4291,4293,4295,4297,4299,4301,4303,4305,4307,4309,4311,4313,4315,4317,4319,4321,4323,4325,4327,4329,4331,4333,4335,4337,4339,4341,4343,4345,4347,4349,4351,4353,4355,4357,4359,4361,4363,4365,4367,4369,4371,4373,4375,4377,4379,4381,4383,4385,4387,4389,4391,4393,4395,4397,4399,4401,4403,4405,4407,4409,4411,4413,4415,4417,4419,4421,4423,4425,4427,4429,4431,4433,4435,4437,4439,4441,4443,4445,4447,4449,4451,4453,4455,4457,4459,4461,4463,4465,4467,4469,4471,4473,4475,4477,4479,4481,4483,4485,4487,4489,4491,4493,4495,4497,4499,4501,4503,4505,4507,4509,4511,4513,4515,4517,4519,4521,4523,4525,4527,4529,4531,4533,4535,4537,4539,4541,4543,4545,4547,4549,4551,4553,4555,4557,4559,4561,4563,4565,4567,4569,4571,4573,4575,4577,4579,4581,4583,4585,4587,4589,4591,4593,4595,4597,4599,4601,4603,4605,4607,4609,4611,4613,4615,4617,4619,4621,4623,4625,4627,4629,4631,4633,4635,4637,4639,4641,4643,4645,4647,4649,4651,4653,4655,4657,4659,4661,4663,4665,4667,4669,4671,4673,4675,4677,4679,4681,4683,4685,4687,4689,4691,4693,4695,4697,4699,4701,4703,4705,4707,4709,4711,4713,4715,4717,4719,4721,4723,4725,4727,4729,4731,4733,4735,4737,4739,4741,4743,4745,4747,4749,4751,4753,4755,4757,4759,4761,4763,4765,4767,4769,4771,4773,4775,4777,4779,4781,4783,4785,4787,4789,4791,4793,4795,4797,4799,4801,4803,4805,4807,4809,4811,4813,4815,4817,4819,4821,4823,4825,4827,4829,4831,4833,4835,4837,4839,4841,4843,4845,4847,4849,4851,4853,4855,4857,4859,4861,4863,4865,4867,4869,4871,4873,4875,4877,4879,4881,4883,4885,4887,4889,4891,4893,4895,4897,4899,4901,4903,4905,4907,4909,4911,4913,4915,4917,4919,4921,4923,4925,4927,4929,4931,4933,4935,4937,4939,4941,4943,4945,4947,4949,4951,4953,4955,4957,4959,4961,4963,4965,4967,4969,4971,4973,4975,4977,4979,4981,4983,4985,4987,4989,4991,4993,4995,4997,4999,5001,5003,5005,5007,5009,5011,5013,5015,5017,5019,5021,5023,5025,5027,5029,5031,5033,5035,5037,5039,5041,5043,5045,5047,5049,5051,5053,5055,5057,5059,5061,5063,5065,5067,5069,5071,5073,5075,5077,5079,5081,5083,5085,5087,5089,5091,5093,5095,5097,5099,5101,5103,5105,5107,5109,5111,5113,5115,5117,5119,5121,5123,5125,5127,5129,5131,5133,5135,5137,5139,5141,5143,5145,5147,5149,5151,5153,5155,5157,5159,5161,5163,5165,5167,5169,5171,5173,5175,5177,5179,5181,5183,5185,5187,5189,5191,5193,5195,5197,5199,5201,5203,5205,5207,5209,5211,5213,5215,5217,5219,5221,5223,5225],{"categories":120},[121],"Developer Productivity",{"categories":123},[124],"Business & SaaS",{"categories":126},[76],{"categories":128},[129],"AI Automation",{"categories":131},[132],"Product Strategy",{"categories":134},[76],{"categories":136},[121],{"categories":138},[76],{"categories":140},[124],{"categories":142},[],{"categories":144},[76],{"categories":146},[76],{"categories":148},[76],{"categories":150},[129],{"categories":152},[],{"categories":154},[155],"AI News & Trends",{"categories":157},[129],{"categories":159},[76],{"categories":161},[124],{"categories":163},[129],{"categories":165},[155],{"categories":167},[129],{"categories":169},[129],{"categories":171},[76],{"categories":173},[129],{"categories":175},[76],{"categories":177},[76],{"categories":179},[76],{"categories":181},[155],{"categories":183},[76],{"categories":185},[76],{"categories":187},[],{"categories":189},[190],"Design & Frontend",{"categories":192},[193],"Data Science & Visualization",{"categories":195},[155],{"categories":197},[76],{"categories":199},[],{"categories":201},[76],{"categories":203},[129],{"categories":205},[206],"Software Engineering",{"categories":208},[76],{"categories":210},[129],{"categories":212},[76],{"categories":214},[215],"Marketing & Growth",{"categories":217},[190],{"categories":219},[76],{"categories":221},[129],{"categories":223},[76],{"categories":225},[],{"categories":227},[],{"categories":229},[190],{"categories":231},[129],{"categories":233},[121],{"categories":235},[206],{"categories":237},[190],{"categories":239},[76],{"categories":241},[206],{"categories":243},[244],"DevOps & Cloud",{"categories":246},[129],{"categories":248},[132],{"categories":250},[155],{"categories":252},[76],{"categories":254},[],{"categories":256},[76],{"categories":258},[],{"categories":260},[129],{"categories":262},[206],{"categories":264},[],{"categories":266},[206],{"categories":268},[124],{"categories":270},[],{"categories":272},[],{"categories":274},[76],{"categories":276},[76],{"categories":278},[129],{"categories":280},[76],{"categories":282},[76],{"categories":284},[129],{"categories":286},[76],{"categories":288},[76],{"categories":290},[76],{"categories":292},[],{"categories":294},[206],{"categories":296},[],{"categories":298},[],{"categories":300},[206],{"categories":302},[],{"categories":304},[206],{"categories":306},[76],{"categories":308},[76],{"categories":310},[215],{"categories":312},[190],{"categories":314},[190],{"categories":316},[76],{"categories":318},[206],{"categories":320},[129],{"categories":322},[206],{"categories":324},[76],{"categories":326},[76],{"categories":328},[129],{"categories":330},[129],{"categories":332},[193],{"categories":334},[155],{"categories":336},[129],{"categories":338},[129],{"categories":340},[215],{"categories":342},[129],{"categories":344},[132],{"categories":346},[206],{"categories":348},[],{"categories":350},[129],{"categories":352},[],{"categories":354},[129],{"categories":356},[124],{"categories":358},[76],{"categories":360},[206],{"categories":362},[244],{"categories":364},[190],{"categories":366},[76],{"categories":368},[],{"categories":370},[206],{"categories":372},[76],{"categories":374},[],{"categories":376},[129],{"categories":378},[],{"categories":380},[76],{"categories":382},[],{"categories":384},[121],{"categories":386},[206],{"categories":388},[124],{"categories":390},[76],{"categories":392},[76],{"categories":394},[155],{"categories":396},[76],{"categories":398},[],{"categories":400},[76],{"categories":402},[],{"categories":404},[206],{"categories":406},[193],{"categories":408},[],{"categories":410},[76],{"categories":412},[190],{"categories":414},[],{"categories":416},[190],{"categories":418},[129],{"categories":420},[],{"categories":422},[76],{"categories":424},[76],{"categories":426},[129],{"categories":428},[155],{"categories":430},[124],{"categories":432},[76],{"categories":434},[],{"categories":436},[206],{"categories":438},[129],{"categories":440},[76],{"categories":442},[132],{"categories":444},[],{"categories":446},[76],{"categories":448},[132],{"categories":450},[129],{"categories":452},[76],{"categories":454},[129],{"categories":456},[],{"categories":458},[193],{"categories":460},[76],{"categories":462},[],{"categories":464},[121],{"categories":466},[76],{"categories":468},[124],{"categories":470},[76],{"categories":472},[129],{"categories":474},[76],{"categories":476},[76],{"categories":478},[206],{"categories":480},[76],{"categories":482},[],{"categories":484},[],{"categories":486},[76],{"categories":488},[76],{"categories":490},[76],{"categories":492},[],{"categories":494},[190],{"categories":496},[],{"categories":498},[76],{"categories":500},[],{"categories":502},[129],{"categories":504},[76],{"categories":506},[190],{"categories":508},[],{"categories":510},[76],{"categories":512},[129],{"categories":514},[76],{"categories":516},[124],{"categories":518},[129],{"categories":520},[76],{"categories":522},[76],{"categories":524},[206],{"categories":526},[190],{"categories":528},[129],{"categories":530},[],{"categories":532},[206],{"categories":534},[129],{"categories":536},[],{"categories":538},[155],{"categories":540},[],{"categories":542},[76],{"categories":544},[76],{"categories":546},[124,215],{"categories":548},[],{"categories":550},[76],{"categories":552},[76],{"categories":554},[129],{"categories":556},[],{"categories":558},[],{"categories":560},[76],{"categories":562},[190],{"categories":564},[76],{"categories":566},[],{"categories":568},[76],{"categories":570},[244],{"categories":572},[],{"categories":574},[129],{"categories":576},[155],{"categories":578},[76],{"categories":580},[190],{"categories":582},[],{"categories":584},[155],{"categories":586},[76],{"categories":588},[129],{"categories":590},[155],{"categories":592},[76],{"categories":594},[215],{"categories":596},[],{"categories":598},[129],{"categories":600},[124],{"categories":602},[206],{"categories":604},[76],{"categories":606},[129],{"categories":608},[],{"categories":610},[76,244],{"categories":612},[76],{"categories":614},[76],{"categories":616},[76],{"categories":618},[129],{"categories":620},[76,206],{"categories":622},[193],{"categories":624},[76],{"categories":626},[76],{"categories":628},[206],{"categories":630},[129],{"categories":632},[215],{"categories":634},[129],{"categories":636},[76],{"categories":638},[76],{"categories":640},[129],{"categories":642},[],{"categories":644},[76],{"categories":646},[129],{"categories":648},[76],{"categories":650},[76,124],{"categories":652},[124],{"categories":654},[],{"categories":656},[190],{"categories":658},[190],{"categories":660},[76],{"categories":662},[],{"categories":664},[],{"categories":666},[155],{"categories":668},[],{"categories":670},[121],{"categories":672},[76],{"categories":674},[206],{"categories":676},[76],{"categories":678},[190],{"categories":680},[76],{"categories":682},[129],{"categories":684},[206],{"categories":686},[155],{"categories":688},[190],{"categories":690},[],{"categories":692},[76],{"categories":694},[76],{"categories":696},[76],{"categories":698},[76],{"categories":700},[76],{"categories":702},[76],{"categories":704},[76],{"categories":706},[155],{"categories":708},[121],{"categories":710},[76],{"categories":712},[129],{"categories":714},[244],{"categories":716},[76],{"categories":718},[190],{"categories":720},[76],{"categories":722},[129],{"categories":724},[],{"categories":726},[],{"categories":728},[190],{"categories":730},[155],{"categories":732},[193],{"categories":734},[],{"categories":736},[76],{"categories":738},[76],{"categories":740},[124],{"categories":742},[76],{"categories":744},[76],{"categories":746},[76],{"categories":748},[155],{"categories":750},[76],{"categories":752},[190],{"categories":754},[],{"categories":756},[129],{"categories":758},[206],{"categories":760},[],{"categories":762},[76],{"categories":764},[76],{"categories":766},[129],{"categories":768},[206],{"categories":770},[76],{"categories":772},[193],{"categories":774},[],{"categories":776},[76],{"categories":778},[],{"categories":780},[76],{"categories":782},[],{"categories":784},[132],{"categories":786},[124],{"categories":788},[129],{"categories":790},[129],{"categories":792},[],{"categories":794},[121],{"categories":796},[76],{"categories":798},[124],{"categories":800},[155],{"categories":802},[121],{"categories":804},[],{"categories":806},[76],{"categories":808},[],{"categories":810},[],{"categories":812},[155],{"categories":814},[155],{"categories":816},[],{"categories":818},[190],{"categories":820},[206],{"categories":822},[],{"categories":824},[124],{"categories":826},[],{"categories":828},[],{"categories":830},[121],{"categories":832},[193],{"categories":834},[],{"categories":836},[215],{"categories":838},[129],{"categories":840},[124],{"categories":842},[129],{"categories":844},[124],{"categories":846},[206],{"categories":848},[],{"categories":850},[132],{"categories":852},[76],{"categories":854},[190],{"categories":856},[206],{"categories":858},[76],{"categories":860},[129],{"categories":862},[124],{"categories":864},[76],{"categories":866},[],{"categories":868},[],{"categories":870},[206],{"categories":872},[193],{"categories":874},[132],{"categories":876},[76],{"categories":878},[129],{"categories":880},[76],{"categories":882},[],{"categories":884},[155],{"categories":886},[244],{"categories":888},[],{"categories":890},[129],{"categories":892},[],{"categories":894},[121],{"categories":896},[],{"categories":898},[76],{"categories":900},[76],{"categories":902},[190],{"categories":904},[215],{"categories":906},[206],{"categories":908},[129],{"categories":910},[],{"categories":912},[206],{"categories":914},[121],{"categories":916},[],{"categories":918},[155],{"categories":920},[76,244],{"categories":922},[76],{"categories":924},[155],{"categories":926},[76],{"categories":928},[76],{"categories":930},[124],{"categories":932},[76],{"categories":934},[],{"categories":936},[76],{"categories":938},[124],{"categories":940},[76],{"categories":942},[],{"categories":944},[129],{"categories":946},[206],{"categories":948},[206],{"categories":950},[190],{"categories":952},[155],{"categories":954},[193],{"categories":956},[76],{"categories":958},[121],{"categories":960},[76],{"categories":962},[129],{"categories":964},[76],{"categories":966},[206],{"categories":968},[206],{"categories":970},[],{"categories":972},[],{"categories":974},[129],{"categories":976},[132],{"categories":978},[],{"categories":980},[76],{"categories":982},[],{"categories":984},[190],{"categories":986},[129],{"categories":988},[206],{"categories":990},[190],{"categories":992},[76],{"categories":994},[190],{"categories":996},[],{"categories":998},[],{"categories":1000},[155],{"categories":1002},[129],{"categories":1004},[129],{"categories":1006},[76],{"categories":1008},[76],{"categories":1010},[76],{"categories":1012},[124],{"categories":1014},[76],{"categories":1016},[76],{"categories":1018},[],{"categories":1020},[206],{"categories":1022},[206],{"categories":1024},[76],{"categories":1026},[206],{"categories":1028},[124],{"categories":1030},[],{"categories":1032},[76],{"categories":1034},[76],{"categories":1036},[76],{"categories":1038},[129],{"categories":1040},[121],{"categories":1042},[124],{"categories":1044},[155],{"categories":1046},[129],{"categories":1048},[215],{"categories":1050},[76],{"categories":1052},[129],{"categories":1054},[],{"categories":1056},[190],{"categories":1058},[],{"categories":1060},[76],{"categories":1062},[76],{"categories":1064},[],{"categories":1066},[206],{"categories":1068},[124],{"categories":1070},[129],{"categories":1072},[],{"categories":1074},[76],{"categories":1076},[76],{"categories":1078},[244],{"categories":1080},[193],{"categories":1082},[206],{"categories":1084},[215],{"categories":1086},[76],{"categories":1088},[190],{"categories":1090},[76],{"categories":1092},[206],{"categories":1094},[129],{"categories":1096},[],{"categories":1098},[],{"categories":1100},[129],{"categories":1102},[121],{"categories":1104},[129],{"categories":1106},[132],{"categories":1108},[124],{"categories":1110},[],{"categories":1112},[76],{"categories":1114},[132],{"categories":1116},[76],{"categories":1118},[76],{"categories":1120},[76],{"categories":1122},[76],{"categories":1124},[76],{"categories":1126},[215],{"categories":1128},[76],{"categories":1130},[76],{"categories":1132},[76],{"categories":1134},[76],{"categories":1136},[76],{"categories":1138},[190],{"categories":1140},[129],{"categories":1142},[],{"categories":1144},[],{"categories":1146},[244],{"categories":1148},[206],{"categories":1150},[],{"categories":1152},[129],{"categories":1154},[76],{"categories":1156},[190,76],{"categories":1158},[121],{"categories":1160},[],{"categories":1162},[76],{"categories":1164},[121],{"categories":1166},[190],{"categories":1168},[129],{"categories":1170},[206],{"categories":1172},[],{"categories":1174},[76],{"categories":1176},[76],{"categories":1178},[76],{"categories":1180},[],{"categories":1182},[],{"categories":1184},[76],{"categories":1186},[121],{"categories":1188},[76],{"categories":1190},[76],{"categories":1192},[],{"categories":1194},[129],{"categories":1196},[76],{"categories":1198},[132],{"categories":1200},[206],{"categories":1202},[76],{"categories":1204},[76],{"categories":1206},[129],{"categories":1208},[76],{"categories":1210},[190],{"categories":1212},[129],{"categories":1214},[244],{"categories":1216},[190],{"categories":1218},[124],{"categories":1220},[129],{"categories":1222},[76],{"categories":1224},[76],{"categories":1226},[76],{"categories":1228},[129],{"categories":1230},[206],{"categories":1232},[76],{"categories":1234},[132],{"categories":1236},[],{"categories":1238},[155],{"categories":1240},[],{"categories":1242},[132],{"categories":1244},[129],{"categories":1246},[190],{"categories":1248},[76],{"categories":1250},[76],{"categories":1252},[129],{"categories":1254},[206],{"categories":1256},[190],{"categories":1258},[129],{"categories":1260},[155],{"categories":1262},[],{"categories":1264},[76],{"categories":1266},[],{"categories":1268},[76],{"categories":1270},[76],{"categories":1272},[190],{"categories":1274},[76],{"categories":1276},[121],{"categories":1278},[155],{"categories":1280},[76],{"categories":1282},[76],{"categories":1284},[215],{"categories":1286},[76],{"categories":1288},[76],{"categories":1290},[129],{"categories":1292},[129],{"categories":1294},[129],{"categories":1296},[76],{"categories":1298},[76],{"categories":1300},[129],{"categories":1302},[76],{"categories":1304},[76],{"categories":1306},[129],{"categories":1308},[76],{"categories":1310},[76],{"categories":1312},[129],{"categories":1314},[190],{"categories":1316},[76],{"categories":1318},[76],{"categories":1320},[],{"categories":1322},[],{"categories":1324},[206],{"categories":1326},[],{"categories":1328},[121],{"categories":1330},[244],{"categories":1332},[76],{"categories":1334},[],{"categories":1336},[121],{"categories":1338},[124],{"categories":1340},[76],{"categories":1342},[215],{"categories":1344},[],{"categories":1346},[124],{"categories":1348},[124],{"categories":1350},[],{"categories":1352},[76],{"categories":1354},[76],{"categories":1356},[206],{"categories":1358},[],{"categories":1360},[],{"categories":1362},[],{"categories":1364},[],{"categories":1366},[76],{"categories":1368},[129],{"categories":1370},[244],{"categories":1372},[76],{"categories":1374},[121],{"categories":1376},[206],{"categories":1378},[76],{"categories":1380},[76],{"categories":1382},[206],{"categories":1384},[132],{"categories":1386},[76],{"categories":1388},[215],{"categories":1390},[206],{"categories":1392},[124],{"categories":1394},[76],{"categories":1396},[76],{"categories":1398},[190],{"categories":1400},[76],{"categories":1402},[76],{"categories":1404},[76],{"categories":1406},[129],{"categories":1408},[76,121],{"categories":1410},[206],{"categories":1412},[206],{"categories":1414},[190],{"categories":1416},[129],{"categories":1418},[206],{"categories":1420},[76],{"categories":1422},[76],{"categories":1424},[],{"categories":1426},[],{"categories":1428},[76],{"categories":1430},[],{"categories":1432},[76],{"categories":1434},[206],{"categories":1436},[193],{"categories":1438},[155],{"categories":1440},[190],{"categories":1442},[76],{"categories":1444},[206],{"categories":1446},[],{"categories":1448},[129],{"categories":1450},[76],{"categories":1452},[76],{"categories":1454},[76],{"categories":1456},[76],{"categories":1458},[],{"categories":1460},[129],{"categories":1462},[76],{"categories":1464},[76],{"categories":1466},[],{"categories":1468},[129],{"categories":1470},[76],{"categories":1472},[124],{"categories":1474},[76],{"categories":1476},[],{"categories":1478},[121],{"categories":1480},[76],{"categories":1482},[190],{"categories":1484},[206],{"categories":1486},[76],{"categories":1488},[121],{"categories":1490},[76],{"categories":1492},[206],{"categories":1494},[215],{"categories":1496},[129],{"categories":1498},[129],{"categories":1500},[76,190],{"categories":1502},[76],{"categories":1504},[155],{"categories":1506},[76],{"categories":1508},[129],{"categories":1510},[190],{"categories":1512},[],{"categories":1514},[206],{"categories":1516},[244],{"categories":1518},[190],{"categories":1520},[206],{"categories":1522},[76],{"categories":1524},[132],{"categories":1526},[76],{"categories":1528},[129],{"categories":1530},[],{"categories":1532},[],{"categories":1534},[],{"categories":1536},[],{"categories":1538},[132],{"categories":1540},[206],{"categories":1542},[76],{"categories":1544},[129],{"categories":1546},[129],{"categories":1548},[124],{"categories":1550},[129],{"categories":1552},[244],{"categories":1554},[76],{"categories":1556},[76],{"categories":1558},[76],{"categories":1560},[76],{"categories":1562},[129],{"categories":1564},[76],{"categories":1566},[76],{"categories":1568},[],{"categories":1570},[190],{"categories":1572},[206],{"categories":1574},[],{"categories":1576},[],{"categories":1578},[129],{"categories":1580},[],{"categories":1582},[],{"categories":1584},[215],{"categories":1586},[215],{"categories":1588},[129],{"categories":1590},[206],{"categories":1592},[],{"categories":1594},[76],{"categories":1596},[76],{"categories":1598},[206],{"categories":1600},[190],{"categories":1602},[190],{"categories":1604},[76],{"categories":1606},[129],{"categories":1608},[121],{"categories":1610},[76],{"categories":1612},[76],{"categories":1614},[190],{"categories":1616},[190],{"categories":1618},[129],{"categories":1620},[129],{"categories":1622},[76],{"categories":1624},[],{"categories":1626},[76],{"categories":1628},[],{"categories":1630},[76],{"categories":1632},[129],{"categories":1634},[155],{"categories":1636},[206],{"categories":1638},[76],{"categories":1640},[206],{"categories":1642},[121],{"categories":1644},[76],{"categories":1646},[],{"categories":1648},[129],{"categories":1650},[129],{"categories":1652},[],{"categories":1654},[206],{"categories":1656},[76],{"categories":1658},[121],{"categories":1660},[76],{"categories":1662},[121],{"categories":1664},[121],{"categories":1666},[],{"categories":1668},[206],{"categories":1670},[],{"categories":1672},[129],{"categories":1674},[155],{"categories":1676},[76],{"categories":1678},[129],{"categories":1680},[76],{"categories":1682},[129],{"categories":1684},[76],{"categories":1686},[155],{"categories":1688},[193],{"categories":1690},[76],{"categories":1692},[132],{"categories":1694},[155],{"categories":1696},[190],{"categories":1698},[],{"categories":1700},[],{"categories":1702},[76],{"categories":1704},[76],{"categories":1706},[155],{"categories":1708},[],{"categories":1710},[],{"categories":1712},[],{"categories":1714},[129],{"categories":1716},[76],{"categories":1718},[],{"categories":1720},[206],{"categories":1722},[206],{"categories":1724},[76],{"categories":1726},[193],{"categories":1728},[],{"categories":1730},[76],{"categories":1732},[76],{"categories":1734},[76],{"categories":1736},[193],{"categories":1738},[206],{"categories":1740},[],{"categories":1742},[],{"categories":1744},[129],{"categories":1746},[129],{"categories":1748},[206],{"categories":1750},[206],{"categories":1752},[129],{"categories":1754},[155],{"categories":1756},[155],{"categories":1758},[129],{"categories":1760},[129],{"categories":1762},[121],{"categories":1764},[76,244],{"categories":1766},[],{"categories":1768},[190],{"categories":1770},[206],{"categories":1772},[121],{"categories":1774},[76],{"categories":1776},[129],{"categories":1778},[190],{"categories":1780},[],{"categories":1782},[129],{"categories":1784},[76],{"categories":1786},[129],{"categories":1788},[129],{"categories":1790},[76],{"categories":1792},[215],{"categories":1794},[76],{"categories":1796},[206],{"categories":1798},[190],{"categories":1800},[76],{"categories":1802},[],{"categories":1804},[129],{"categories":1806},[190],{"categories":1808},[76],{"categories":1810},[76],{"categories":1812},[129],{"categories":1814},[129],{"categories":1816},[129],{"categories":1818},[129],{"categories":1820},[215],{"categories":1822},[193],{"categories":1824},[76],{"categories":1826},[129],{"categories":1828},[76],{"categories":1830},[],{"categories":1832},[215],{"categories":1834},[155],{"categories":1836},[206],{"categories":1838},[76],{"categories":1840},[129],{"categories":1842},[],{"categories":1844},[],{"categories":1846},[76],{"categories":1848},[129],{"categories":1850},[76],{"categories":1852},[129],{"categories":1854},[155],{"categories":1856},[206],{"categories":1858},[76],{"categories":1860},[129],{"categories":1862},[129],{"categories":1864},[],{"categories":1866},[76],{"categories":1868},[],{"categories":1870},[],{"categories":1872},[76],{"categories":1874},[76],{"categories":1876},[129],{"categories":1878},[206],{"categories":1880},[],{"categories":1882},[],{"categories":1884},[193],{"categories":1886},[76],{"categories":1888},[193],{"categories":1890},[155],{"categories":1892},[76],{"categories":1894},[76],{"categories":1896},[129],{"categories":1898},[129],{"categories":1900},[76],{"categories":1902},[129],{"categories":1904},[],{"categories":1906},[],{"categories":1908},[76],{"categories":1910},[244],{"categories":1912},[76],{"categories":1914},[],{"categories":1916},[],{"categories":1918},[190],{"categories":1920},[121],{"categories":1922},[],{"categories":1924},[],{"categories":1926},[76],{"categories":1928},[],{"categories":1930},[],{"categories":1932},[206],{"categories":1934},[155],{"categories":1936},[215],{"categories":1938},[124],{"categories":1940},[76],{"categories":1942},[76],{"categories":1944},[124],{"categories":1946},[],{"categories":1948},[190],{"categories":1950},[76],{"categories":1952},[129],{"categories":1954},[124],{"categories":1956},[76],{"categories":1958},[76],{"categories":1960},[121],{"categories":1962},[76],{"categories":1964},[],{"categories":1966},[121],{"categories":1968},[76],{"categories":1970},[215],{"categories":1972},[129],{"categories":1974},[155],{"categories":1976},[76],{"categories":1978},[124],{"categories":1980},[76],{"categories":1982},[76],{"categories":1984},[76],{"categories":1986},[129],{"categories":1988},[],{"categories":1990},[76],{"categories":1992},[206],{"categories":1994},[121],{"categories":1996},[76],{"categories":1998},[76],{"categories":2000},[],{"categories":2002},[155],{"categories":2004},[76],{"categories":2006},[76],{"categories":2008},[],{"categories":2010},[124],{"categories":2012},[124],{"categories":2014},[76],{"categories":2016},[76],{"categories":2018},[132],{"categories":2020},[76],{"categories":2022},[76],{"categories":2024},[206],{"categories":2026},[76],{"categories":2028},[],{"categories":2030},[206],{"categories":2032},[76],{"categories":2034},[],{"categories":2036},[],{"categories":2038},[76],{"categories":2040},[155],{"categories":2042},[],{"categories":2044},[244],{"categories":2046},[76],{"categories":2048},[76],{"categories":2050},[190],{"categories":2052},[],{"categories":2054},[76],{"categories":2056},[206],{"categories":2058},[76],{"categories":2060},[76],{"categories":2062},[76,244],{"categories":2064},[76],{"categories":2066},[76],{"categories":2068},[190],{"categories":2070},[129],{"categories":2072},[],{"categories":2074},[129],{"categories":2076},[129],{"categories":2078},[76],{"categories":2080},[76],{"categories":2082},[76],{"categories":2084},[76],{"categories":2086},[121],{"categories":2088},[193],{"categories":2090},[121],{"categories":2092},[206],{"categories":2094},[190],{"categories":2096},[129],{"categories":2098},[76],{"categories":2100},[],{"categories":2102},[76],{"categories":2104},[155],{"categories":2106},[76],{"categories":2108},[129],{"categories":2110},[76],{"categories":2112},[76],{"categories":2114},[124],{"categories":2116},[],{"categories":2118},[244],{"categories":2120},[76],{"categories":2122},[190],{"categories":2124},[190],{"categories":2126},[206],{"categories":2128},[129],{"categories":2130},[76],{"categories":2132},[124],{"categories":2134},[155],{"categories":2136},[76],{"categories":2138},[190],{"categories":2140},[129],{"categories":2142},[76],{"categories":2144},[76],{"categories":2146},[],{"categories":2148},[76],{"categories":2150},[76],{"categories":2152},[76],{"categories":2154},[],{"categories":2156},[],{"categories":2158},[76],{"categories":2160},[76],{"categories":2162},[76],{"categories":2164},[76],{"categories":2166},[206],{"categories":2168},[76],{"categories":2170},[76],{"categories":2172},[129],{"categories":2174},[76],{"categories":2176},[76],{"categories":2178},[76],{"categories":2180},[76],{"categories":2182},[],{"categories":2184},[193],{"categories":2186},[76],{"categories":2188},[129],{"categories":2190},[76],{"categories":2192},[],{"categories":2194},[],{"categories":2196},[76],{"categories":2198},[76],{"categories":2200},[76],{"categories":2202},[155],{"categories":2204},[],{"categories":2206},[76],{"categories":2208},[190],{"categories":2210},[76],{"categories":2212},[244],{"categories":2214},[155],{"categories":2216},[206],{"categories":2218},[206],{"categories":2220},[155],{"categories":2222},[155],{"categories":2224},[244],{"categories":2226},[],{"categories":2228},[155],{"categories":2230},[76],{"categories":2232},[121],{"categories":2234},[206],{"categories":2236},[76],{"categories":2238},[155],{"categories":2240},[],{"categories":2242},[76],{"categories":2244},[206],{"categories":2246},[193],{"categories":2248},[76],{"categories":2250},[155],{"categories":2252},[76],{"categories":2254},[206],{"categories":2256},[129],{"categories":2258},[155],{"categories":2260},[129],{"categories":2262},[244],{"categories":2264},[129],{"categories":2266},[76],{"categories":2268},[76],{"categories":2270},[206],{"categories":2272},[76],{"categories":2274},[],{"categories":2276},[124],{"categories":2278},[206],{"categories":2280},[],{"categories":2282},[],{"categories":2284},[76],{"categories":2286},[129],{"categories":2288},[76],{"categories":2290},[76],{"categories":2292},[76],{"categories":2294},[76],{"categories":2296},[],{"categories":2298},[193],{"categories":2300},[121],{"categories":2302},[129],{"categories":2304},[190],{"categories":2306},[],{"categories":2308},[76],{"categories":2310},[206],{"categories":2312},[76],{"categories":2314},[244],{"categories":2316},[244],{"categories":2318},[],{"categories":2320},[129],{"categories":2322},[155],{"categories":2324},[155],{"categories":2326},[76],{"categories":2328},[129],{"categories":2330},[],{"categories":2332},[190],{"categories":2334},[76],{"categories":2336},[76],{"categories":2338},[],{"categories":2340},[76],{"categories":2342},[],{"categories":2344},[206],{"categories":2346},[76],{"categories":2348},[206],{"categories":2350},[244],{"categories":2352},[76],{"categories":2354},[206],{"categories":2356},[124],{"categories":2358},[76],{"categories":2360},[],{"categories":2362},[129],{"categories":2364},[121],{"categories":2366},[121],{"categories":2368},[],{"categories":2370},[129],{"categories":2372},[76],{"categories":2374},[190],{"categories":2376},[76],{"categories":2378},[76],{"categories":2380},[206],{"categories":2382},[190],{"categories":2384},[76],{"categories":2386},[206],{"categories":2388},[206],{"categories":2390},[129],{"categories":2392},[],{"categories":2394},[76],{"categories":2396},[76],{"categories":2398},[129],{"categories":2400},[76],{"categories":2402},[76],{"categories":2404},[],{"categories":2406},[129],{"categories":2408},[76],{"categories":2410},[129],{"categories":2412},[129],{"categories":2414},[206],{"categories":2416},[206],{"categories":2418},[],{"categories":2420},[206],{"categories":2422},[76],{"categories":2424},[76],{"categories":2426},[129],{"categories":2428},[124],{"categories":2430},[76],{"categories":2432},[],{"categories":2434},[76],{"categories":2436},[],{"categories":2438},[76],{"categories":2440},[76],{"categories":2442},[],{"categories":2444},[76],{"categories":2446},[76],{"categories":2448},[76],{"categories":2450},[215],{"categories":2452},[155],{"categories":2454},[76],{"categories":2456},[76],{"categories":2458},[121],{"categories":2460},[76],{"categories":2462},[76],{"categories":2464},[193],{"categories":2466},[76],{"categories":2468},[155],{"categories":2470},[129],{"categories":2472},[],{"categories":2474},[76],{"categories":2476},[190],{"categories":2478},[76],{"categories":2480},[215],{"categories":2482},[76],{"categories":2484},[129],{"categories":2486},[],{"categories":2488},[],{"categories":2490},[],{"categories":2492},[121],{"categories":2494},[155],{"categories":2496},[129],{"categories":2498},[76],{"categories":2500},[76],{"categories":2502},[76],{"categories":2504},[190],{"categories":2506},[129],{"categories":2508},[76],{"categories":2510},[],{"categories":2512},[129],{"categories":2514},[129],{"categories":2516},[],{"categories":2518},[76],{"categories":2520},[129],{"categories":2522},[76],{"categories":2524},[],{"categories":2526},[76],{"categories":2528},[76],{"categories":2530},[155],{"categories":2532},[190],{"categories":2534},[129],{"categories":2536},[190],{"categories":2538},[129],{"categories":2540},[124],{"categories":2542},[],{"categories":2544},[],{"categories":2546},[76],{"categories":2548},[76],{"categories":2550},[121],{"categories":2552},[129],{"categories":2554},[155],{"categories":2556},[],{"categories":2558},[190],{"categories":2560},[],{"categories":2562},[206],{"categories":2564},[206],{"categories":2566},[190],{"categories":2568},[206],{"categories":2570},[76],{"categories":2572},[],{"categories":2574},[76],{"categories":2576},[76],{"categories":2578},[],{"categories":2580},[215],{"categories":2582},[76],{"categories":2584},[244],{"categories":2586},[206],{"categories":2588},[],{"categories":2590},[129],{"categories":2592},[76],{"categories":2594},[121],{"categories":2596},[129],{"categories":2598},[129],{"categories":2600},[76],{"categories":2602},[76],{"categories":2604},[],{"categories":2606},[121],{"categories":2608},[76],{"categories":2610},[124],{"categories":2612},[206],{"categories":2614},[190],{"categories":2616},[],{"categories":2618},[],{"categories":2620},[],{"categories":2622},[129],{"categories":2624},[206],{"categories":2626},[190],{"categories":2628},[155],{"categories":2630},[76],{"categories":2632},[155],{"categories":2634},[129],{"categories":2636},[190],{"categories":2638},[76],{"categories":2640},[],{"categories":2642},[76],{"categories":2644},[129],{"categories":2646},[190],{"categories":2648},[155],{"categories":2650},[124],{"categories":2652},[206],{"categories":2654},[76],{"categories":2656},[155],{"categories":2658},[215],{"categories":2660},[],{"categories":2662},[],{"categories":2664},[193],{"categories":2666},[129],{"categories":2668},[76,206],{"categories":2670},[155],{"categories":2672},[76],{"categories":2674},[76],{"categories":2676},[129],{"categories":2678},[76],{"categories":2680},[129],{"categories":2682},[76],{"categories":2684},[76],{"categories":2686},[],{"categories":2688},[206],{"categories":2690},[190],{"categories":2692},[76],{"categories":2694},[76],{"categories":2696},[193],{"categories":2698},[129],{"categories":2700},[215],{"categories":2702},[244],{"categories":2704},[],{"categories":2706},[76],{"categories":2708},[124],{"categories":2710},[129],{"categories":2712},[121],{"categories":2714},[129],{"categories":2716},[76],{"categories":2718},[129],{"categories":2720},[132],{"categories":2722},[206],{"categories":2724},[76],{"categories":2726},[76],{"categories":2728},[],{"categories":2730},[],{"categories":2732},[],{"categories":2734},[244],{"categories":2736},[76],{"categories":2738},[155],{"categories":2740},[76],{"categories":2742},[76],{"categories":2744},[76],{"categories":2746},[76],{"categories":2748},[],{"categories":2750},[193],{"categories":2752},[124],{"categories":2754},[129],{"categories":2756},[76],{"categories":2758},[],{"categories":2760},[76],{"categories":2762},[129],{"categories":2764},[76],{"categories":2766},[244],{"categories":2768},[],{"categories":2770},[190],{"categories":2772},[190],{"categories":2774},[],{"categories":2776},[206],{"categories":2778},[76],{"categories":2780},[190],{"categories":2782},[76],{"categories":2784},[124],{"categories":2786},[129],{"categories":2788},[76],{"categories":2790},[],{"categories":2792},[155],{"categories":2794},[76],{"categories":2796},[76],{"categories":2798},[190],{"categories":2800},[129],{"categories":2802},[155],{"categories":2804},[],{"categories":2806},[129],{"categories":2808},[129],{"categories":2810},[190],{"categories":2812},[76],{"categories":2814},[76],{"categories":2816},[76],{"categories":2818},[],{"categories":2820},[76],{"categories":2822},[76],{"categories":2824},[244],{"categories":2826},[155],{"categories":2828},[193],{"categories":2830},[193],{"categories":2832},[],{"categories":2834},[],{"categories":2836},[],{"categories":2838},[129],{"categories":2840},[129],{"categories":2842},[206],{"categories":2844},[206],{"categories":2846},[76],{"categories":2848},[76],{"categories":2850},[76],{"categories":2852},[76],{"categories":2854},[129],{"categories":2856},[],{"categories":2858},[],{"categories":2860},[76],{"categories":2862},[],{"categories":2864},[76],{"categories":2866},[129],{"categories":2868},[190],{"categories":2870},[76],{"categories":2872},[76],{"categories":2874},[],{"categories":2876},[132],{"categories":2878},[76],{"categories":2880},[190],{"categories":2882},[76],{"categories":2884},[124],{"categories":2886},[76],{"categories":2888},[215],{"categories":2890},[129],{"categories":2892},[76],{"categories":2894},[76],{"categories":2896},[129],{"categories":2898},[76],{"categories":2900},[206],{"categories":2902},[76],{"categories":2904},[190],{"categories":2906},[],{"categories":2908},[155],{"categories":2910},[129],{"categories":2912},[76],{"categories":2914},[],{"categories":2916},[155],{"categories":2918},[129],{"categories":2920},[129],{"categories":2922},[76],{"categories":2924},[76],{"categories":2926},[129],{"categories":2928},[],{"categories":2930},[124],{"categories":2932},[129],{"categories":2934},[],{"categories":2936},[206],{"categories":2938},[76],{"categories":2940},[121],{"categories":2942},[155],{"categories":2944},[244],{"categories":2946},[129],{"categories":2948},[129],{"categories":2950},[76],{"categories":2952},[129],{"categories":2954},[121],{"categories":2956},[],{"categories":2958},[76],{"categories":2960},[76],{"categories":2962},[],{"categories":2964},[],{"categories":2966},[190],{"categories":2968},[76,124],{"categories":2970},[129],{"categories":2972},[76],{"categories":2974},[],{"categories":2976},[121],{"categories":2978},[193],{"categories":2980},[124],{"categories":2982},[76],{"categories":2984},[206],{"categories":2986},[76],{"categories":2988},[129],{"categories":2990},[76],{"categories":2992},[76],{"categories":2994},[76],{"categories":2996},[155],{"categories":2998},[129],{"categories":3000},[76],{"categories":3002},[],{"categories":3004},[],{"categories":3006},[129],{"categories":3008},[76],{"categories":3010},[244],{"categories":3012},[],{"categories":3014},[76],{"categories":3016},[129],{"categories":3018},[129],{"categories":3020},[],{"categories":3022},[129],{"categories":3024},[76],{"categories":3026},[215],{"categories":3028},[76],{"categories":3030},[193],{"categories":3032},[129],{"categories":3034},[76],{"categories":3036},[244],{"categories":3038},[],{"categories":3040},[76],{"categories":3042},[215],{"categories":3044},[190],{"categories":3046},[76],{"categories":3048},[76],{"categories":3050},[],{"categories":3052},[215],{"categories":3054},[155],{"categories":3056},[76],{"categories":3058},[76],{"categories":3060},[121],{"categories":3062},[76],{"categories":3064},[],{"categories":3066},[],{"categories":3068},[190],{"categories":3070},[76],{"categories":3072},[193],{"categories":3074},[215],{"categories":3076},[129],{"categories":3078},[215],{"categories":3080},[155],{"categories":3082},[],{"categories":3084},[76],{"categories":3086},[],{"categories":3088},[76],{"categories":3090},[76],{"categories":3092},[76],{"categories":3094},[129],{"categories":3096},[76],{"categories":3098},[76],{"categories":3100},[],{"categories":3102},[76,206],{"categories":3104},[155],{"categories":3106},[129],{"categories":3108},[206],{"categories":3110},[206],{"categories":3112},[76],{"categories":3114},[121],{"categories":3116},[],{"categories":3118},[],{"categories":3120},[129],{"categories":3122},[76],{"categories":3124},[206],{"categories":3126},[121],{"categories":3128},[206],{"categories":3130},[206],{"categories":3132},[76],{"categories":3134},[215],{"categories":3136},[76],{"categories":3138},[206],{"categories":3140},[],{"categories":3142},[76],{"categories":3144},[190,76],{"categories":3146},[244],{"categories":3148},[121],{"categories":3150},[],{"categories":3152},[76],{"categories":3154},[124],{"categories":3156},[124],{"categories":3158},[76],{"categories":3160},[76],{"categories":3162},[76],{"categories":3164},[206],{"categories":3166},[129],{"categories":3168},[76],{"categories":3170},[76],{"categories":3172},[155],{"categories":3174},[215],{"categories":3176},[190],{"categories":3178},[76],{"categories":3180},[76],{"categories":3182},[76],{"categories":3184},[76],{"categories":3186},[121],{"categories":3188},[76],{"categories":3190},[129],{"categories":3192},[129],{"categories":3194},[206],{"categories":3196},[155],{"categories":3198},[206],{"categories":3200},[],{"categories":3202},[],{"categories":3204},[193],{"categories":3206},[76],{"categories":3208},[206],{"categories":3210},[76],{"categories":3212},[190],{"categories":3214},[76],{"categories":3216},[76],{"categories":3218},[76],{"categories":3220},[193],{"categories":3222},[76],{"categories":3224},[76],{"categories":3226},[76],{"categories":3228},[129],{"categories":3230},[129],{"categories":3232},[76,124],{"categories":3234},[],{"categories":3236},[190],{"categories":3238},[],{"categories":3240},[132],{"categories":3242},[76],{"categories":3244},[155],{"categories":3246},[121],{"categories":3248},[121],{"categories":3250},[129],{"categories":3252},[129],{"categories":3254},[129],{"categories":3256},[76],{"categories":3258},[76],{"categories":3260},[124],{"categories":3262},[206],{"categories":3264},[215],{"categories":3266},[76],{"categories":3268},[],{"categories":3270},[155],{"categories":3272},[76],{"categories":3274},[76],{"categories":3276},[76],{"categories":3278},[76],{"categories":3280},[76],{"categories":3282},[206],{"categories":3284},[155],{"categories":3286},[206],{"categories":3288},[206],{"categories":3290},[76],{"categories":3292},[76],{"categories":3294},[76],{"categories":3296},[129],{"categories":3298},[155],{"categories":3300},[76],{"categories":3302},[129],{"categories":3304},[76],{"categories":3306},[76],{"categories":3308},[76],{"categories":3310},[190],{"categories":3312},[76],{"categories":3314},[76],{"categories":3316},[76],{"categories":3318},[244],{"categories":3320},[76],{"categories":3322},[132],{"categories":3324},[76],{"categories":3326},[129],{"categories":3328},[76],{"categories":3330},[76],{"categories":3332},[155],{"categories":3334},[76],{"categories":3336},[129],{"categories":3338},[215],{"categories":3340},[76],{"categories":3342},[76],{"categories":3344},[124],{"categories":3346},[76],{"categories":3348},[76],{"categories":3350},[],{"categories":3352},[76],{"categories":3354},[206],{"categories":3356},[76],{"categories":3358},[],{"categories":3360},[],{"categories":3362},[76],{"categories":3364},[],{"categories":3366},[124],{"categories":3368},[76],{"categories":3370},[129],{"categories":3372},[155],{"categories":3374},[155],{"categories":3376},[155],{"categories":3378},[155],{"categories":3380},[],{"categories":3382},[121],{"categories":3384},[129],{"categories":3386},[155],{"categories":3388},[76],{"categories":3390},[132],{"categories":3392},[76],{"categories":3394},[121],{"categories":3396},[129],{"categories":3398},[76],{"categories":3400},[76,129],{"categories":3402},[129],{"categories":3404},[244],{"categories":3406},[155],{"categories":3408},[129],{"categories":3410},[155],{"categories":3412},[129],{"categories":3414},[76],{"categories":3416},[],{"categories":3418},[155],{"categories":3420},[215],{"categories":3422},[121],{"categories":3424},[76],{"categories":3426},[76],{"categories":3428},[],{"categories":3430},[206],{"categories":3432},[],{"categories":3434},[121],{"categories":3436},[129],{"categories":3438},[155],{"categories":3440},[76],{"categories":3442},[155],{"categories":3444},[121],{"categories":3446},[155],{"categories":3448},[155],{"categories":3450},[],{"categories":3452},[124],{"categories":3454},[129],{"categories":3456},[155],{"categories":3458},[155],{"categories":3460},[155],{"categories":3462},[155],{"categories":3464},[155],{"categories":3466},[155],{"categories":3468},[155],{"categories":3470},[155],{"categories":3472},[155],{"categories":3474},[155],{"categories":3476},[193],{"categories":3478},[121],{"categories":3480},[76],{"categories":3482},[76],{"categories":3484},[129],{"categories":3486},[129],{"categories":3488},[],{"categories":3490},[76,121],{"categories":3492},[],{"categories":3494},[129],{"categories":3496},[155],{"categories":3498},[129],{"categories":3500},[76],{"categories":3502},[76],{"categories":3504},[76],{"categories":3506},[76],{"categories":3508},[76],{"categories":3510},[129],{"categories":3512},[124],{"categories":3514},[129],{"categories":3516},[],{"categories":3518},[129],{"categories":3520},[190],{"categories":3522},[155],{"categories":3524},[76],{"categories":3526},[],{"categories":3528},[],{"categories":3530},[129],{"categories":3532},[190],{"categories":3534},[76],{"categories":3536},[],{"categories":3538},[76],{"categories":3540},[],{"categories":3542},[215],{"categories":3544},[76],{"categories":3546},[],{"categories":3548},[],{"categories":3550},[155],{"categories":3552},[121],{"categories":3554},[76],{"categories":3556},[124],{"categories":3558},[76],{"categories":3560},[76],{"categories":3562},[76],{"categories":3564},[124],{"categories":3566},[190],{"categories":3568},[],{"categories":3570},[76],{"categories":3572},[155],{"categories":3574},[],{"categories":3576},[76],{"categories":3578},[76],{"categories":3580},[190],{"categories":3582},[76],{"categories":3584},[215],{"categories":3586},[76],{"categories":3588},[244],{"categories":3590},[],{"categories":3592},[129],{"categories":3594},[215],{"categories":3596},[206],{"categories":3598},[],{"categories":3600},[76],{"categories":3602},[],{"categories":3604},[129],{"categories":3606},[190],{"categories":3608},[206],{"categories":3610},[],{"categories":3612},[124],{"categories":3614},[121],{"categories":3616},[193],{"categories":3618},[129],{"categories":3620},[190],{"categories":3622},[206],{"categories":3624},[],{"categories":3626},[],{"categories":3628},[76],{"categories":3630},[121],{"categories":3632},[76],{"categories":3634},[215],{"categories":3636},[],{"categories":3638},[129],{"categories":3640},[129],{"categories":3642},[129],{"categories":3644},[155],{"categories":3646},[206],{"categories":3648},[76],{"categories":3650},[129],{"categories":3652},[132],{"categories":3654},[76],{"categories":3656},[129],{"categories":3658},[76],{"categories":3660},[132],{"categories":3662},[215],{"categories":3664},[155],{"categories":3666},[],{"categories":3668},[215],{"categories":3670},[],{"categories":3672},[206],{"categories":3674},[129],{"categories":3676},[],{"categories":3678},[76],{"categories":3680},[76],{"categories":3682},[76],{"categories":3684},[76],{"categories":3686},[129],{"categories":3688},[124],{"categories":3690},[121],{"categories":3692},[76],{"categories":3694},[190],{"categories":3696},[206],{"categories":3698},[206],{"categories":3700},[76],{"categories":3702},[193],{"categories":3704},[129],{"categories":3706},[76],{"categories":3708},[129],{"categories":3710},[76],{"categories":3712},[124],{"categories":3714},[190],{"categories":3716},[206],{"categories":3718},[129],{"categories":3720},[76],{"categories":3722},[132],{"categories":3724},[76],{"categories":3726},[129],{"categories":3728},[76],{"categories":3730},[155],{"categories":3732},[],{"categories":3734},[121],{"categories":3736},[76],{"categories":3738},[76],{"categories":3740},[76],{"categories":3742},[206],{"categories":3744},[206],{"categories":3746},[76],{"categories":3748},[129],{"categories":3750},[76],{"categories":3752},[76],{"categories":3754},[76],{"categories":3756},[76],{"categories":3758},[],{"categories":3760},[76],{"categories":3762},[190],{"categories":3764},[124],{"categories":3766},[155],{"categories":3768},[129],{"categories":3770},[76],{"categories":3772},[76],{"categories":3774},[190],{"categories":3776},[129],{"categories":3778},[76],{"categories":3780},[215],{"categories":3782},[76],{"categories":3784},[193],{"categories":3786},[76],{"categories":3788},[76],{"categories":3790},[155],{"categories":3792},[76],{"categories":3794},[76],{"categories":3796},[129],{"categories":3798},[244],{"categories":3800},[76],{"categories":3802},[129],{"categories":3804},[193],{"categories":3806},[],{"categories":3808},[129],{"categories":3810},[206],{"categories":3812},[76],{"categories":3814},[190],{"categories":3816},[76],{"categories":3818},[121],{"categories":3820},[206],{"categories":3822},[124],{"categories":3824},[206],{"categories":3826},[76],{"categories":3828},[],{"categories":3830},[129],{"categories":3832},[129],{"categories":3834},[76],{"categories":3836},[76],{"categories":3838},[193],{"categories":3840},[],{"categories":3842},[155],{"categories":3844},[],{"categories":3846},[155],{"categories":3848},[76],{"categories":3850},[76],{"categories":3852},[129],{"categories":3854},[129],{"categories":3856},[129],{"categories":3858},[],{"categories":3860},[155],{"categories":3862},[76],{"categories":3864},[],{"categories":3866},[76],{"categories":3868},[76],{"categories":3870},[],{"categories":3872},[190],{"categories":3874},[206],{"categories":3876},[129],{"categories":3878},[76],{"categories":3880},[76],{"categories":3882},[215],{"categories":3884},[76],{"categories":3886},[76],{"categories":3888},[121],{"categories":3890},[],{"categories":3892},[76],{"categories":3894},[76],{"categories":3896},[],{"categories":3898},[121],{"categories":3900},[155],{"categories":3902},[206],{"categories":3904},[76],{"categories":3906},[76],{"categories":3908},[76],{"categories":3910},[206],{"categories":3912},[155],{"categories":3914},[190],{"categories":3916},[76],{"categories":3918},[76],{"categories":3920},[76],{"categories":3922},[155],{"categories":3924},[190],{"categories":3926},[76],{"categories":3928},[155],{"categories":3930},[190],{"categories":3932},[76],{"categories":3934},[155],{"categories":3936},[129],{"categories":3938},[129],{"categories":3940},[129],{"categories":3942},[206],{"categories":3944},[155],{"categories":3946},[129],{"categories":3948},[129],{"categories":3950},[76],{"categories":3952},[206],{"categories":3954},[190],{"categories":3956},[76],{"categories":3958},[],{"categories":3960},[129],{"categories":3962},[],{"categories":3964},[],{"categories":3966},[],{"categories":3968},[129],{"categories":3970},[124],{"categories":3972},[129],{"categories":3974},[76],{"categories":3976},[129],{"categories":3978},[121],{"categories":3980},[129],{"categories":3982},[124],{"categories":3984},[215],{"categories":3986},[129],{"categories":3988},[],{"categories":3990},[129],{"categories":3992},[],{"categories":3994},[121],{"categories":3996},[129],{"categories":3998},[],{"categories":4000},[129],{"categories":4002},[76],{"categories":4004},[76],{"categories":4006},[155],{"categories":4008},[76],{"categories":4010},[76],{"categories":4012},[129],{"categories":4014},[76],{"categories":4016},[76],{"categories":4018},[155],{"categories":4020},[129],{"categories":4022},[206],{"categories":4024},[190],{"categories":4026},[121],{"categories":4028},[76],{"categories":4030},[],{"categories":4032},[129],{"categories":4034},[190],{"categories":4036},[244],{"categories":4038},[155],{"categories":4040},[76],{"categories":4042},[190],{"categories":4044},[76],{"categories":4046},[121],{"categories":4048},[],{"categories":4050},[129],{"categories":4052},[76],{"categories":4054},[76],{"categories":4056},[129],{"categories":4058},[76],{"categories":4060},[190],{"categories":4062},[],{"categories":4064},[129],{"categories":4066},[132],{"categories":4068},[155],{"categories":4070},[129],{"categories":4072},[124],{"categories":4074},[],{"categories":4076},[76],{"categories":4078},[132],{"categories":4080},[76],{"categories":4082},[129],{"categories":4084},[155],{"categories":4086},[121],{"categories":4088},[244],{"categories":4090},[76],{"categories":4092},[76],{"categories":4094},[76],{"categories":4096},[155],{"categories":4098},[124],{"categories":4100},[76],{"categories":4102},[190],{"categories":4104},[155],{"categories":4106},[244],{"categories":4108},[76],{"categories":4110},[129],{"categories":4112},[],{"categories":4114},[],{"categories":4116},[76],{"categories":4118},[244],{"categories":4120},[193],{"categories":4122},[129],{"categories":4124},[129],{"categories":4126},[76],{"categories":4128},[155],{"categories":4130},[76],{"categories":4132},[121],{"categories":4134},[76],{"categories":4136},[190],{"categories":4138},[129],{"categories":4140},[129],{"categories":4142},[76],{"categories":4144},[215],{"categories":4146},[76],{"categories":4148},[129],{"categories":4150},[],{"categories":4152},[76],{"categories":4154},[76],{"categories":4156},[76],{"categories":4158},[155],{"categories":4160},[121],{"categories":4162},[],{"categories":4164},[76],{"categories":4166},[76],{"categories":4168},[206],{"categories":4170},[190],{"categories":4172},[76],{"categories":4174},[76,129],{"categories":4176},[215,124],{"categories":4178},[76],{"categories":4180},[76],{"categories":4182},[76],{"categories":4184},[],{"categories":4186},[129],{"categories":4188},[],{"categories":4190},[206],{"categories":4192},[76],{"categories":4194},[206],{"categories":4196},[],{"categories":4198},[129],{"categories":4200},[76],{"categories":4202},[155],{"categories":4204},[76],{"categories":4206},[],{"categories":4208},[129],{"categories":4210},[76],{"categories":4212},[],{"categories":4214},[190],{"categories":4216},[76],{"categories":4218},[129],{"categories":4220},[76],{"categories":4222},[76],{"categories":4224},[121],{"categories":4226},[129],{"categories":4228},[76],{"categories":4230},[],{"categories":4232},[244],{"categories":4234},[215],{"categories":4236},[124],{"categories":4238},[124],{"categories":4240},[76],{"categories":4242},[121],{"categories":4244},[121],{"categories":4246},[76],{"categories":4248},[129],{"categories":4250},[76],{"categories":4252},[76],{"categories":4254},[76],{"categories":4256},[206],{"categories":4258},[76],{"categories":4260},[121],{"categories":4262},[129],{"categories":4264},[76],{"categories":4266},[215],{"categories":4268},[155],{"categories":4270},[76],{"categories":4272},[76],{"categories":4274},[129],{"categories":4276},[76],{"categories":4278},[],{"categories":4280},[206],{"categories":4282},[],{"categories":4284},[206],{"categories":4286},[129],{"categories":4288},[121],{"categories":4290},[],{"categories":4292},[193],{"categories":4294},[244],{"categories":4296},[76],{"categories":4298},[206],{"categories":4300},[76],{"categories":4302},[],{"categories":4304},[155],{"categories":4306},[129],{"categories":4308},[206],{"categories":4310},[190],{"categories":4312},[76],{"categories":4314},[129],{"categories":4316},[206],{"categories":4318},[129],{"categories":4320},[155],{"categories":4322},[76],{"categories":4324},[121],{"categories":4326},[155],{"categories":4328},[206],{"categories":4330},[76],{"categories":4332},[190],{"categories":4334},[124],{"categories":4336},[76],{"categories":4338},[76],{"categories":4340},[76],{"categories":4342},[76],{"categories":4344},[76],{"categories":4346},[129],{"categories":4348},[76],{"categories":4350},[129],{"categories":4352},[76],{"categories":4354},[76],{"categories":4356},[121],{"categories":4358},[76],{"categories":4360},[129],{"categories":4362},[129],{"categories":4364},[190],{"categories":4366},[129],{"categories":4368},[129],{"categories":4370},[121],{"categories":4372},[129],{"categories":4374},[190],{"categories":4376},[],{"categories":4378},[76],{"categories":4380},[193],{"categories":4382},[76],{"categories":4384},[76],{"categories":4386},[206],{"categories":4388},[],{"categories":4390},[129],{"categories":4392},[215],{"categories":4394},[76],{"categories":4396},[155],{"categories":4398},[129],{"categories":4400},[215],{"categories":4402},[129],{"categories":4404},[124],{"categories":4406},[124],{"categories":4408},[76],{"categories":4410},[76],{"categories":4412},[76],{"categories":4414},[121],{"categories":4416},[],{"categories":4418},[76],{"categories":4420},[129],{"categories":4422},[129],{"categories":4424},[76],{"categories":4426},[76],{"categories":4428},[76],{"categories":4430},[206],{"categories":4432},[],{"categories":4434},[121],{"categories":4436},[76],{"categories":4438},[76],{"categories":4440},[129],{"categories":4442},[129],{"categories":4444},[],{"categories":4446},[206],{"categories":4448},[206],{"categories":4450},[76],{"categories":4452},[215],{"categories":4454},[190],{"categories":4456},[],{"categories":4458},[76],{"categories":4460},[129],{"categories":4462},[121],{"categories":4464},[76],{"categories":4466},[206],{"categories":4468},[121],{"categories":4470},[155],{"categories":4472},[193],{"categories":4474},[155],{"categories":4476},[129],{"categories":4478},[],{"categories":4480},[155],{"categories":4482},[129],{"categories":4484},[190],{"categories":4486},[193],{"categories":4488},[76],{"categories":4490},[],{"categories":4492},[129],{"categories":4494},[155],{"categories":4496},[206],{"categories":4498},[76],{"categories":4500},[76],{"categories":4502},[124],{"categories":4504},[76],{"categories":4506},[121],{"categories":4508},[244],{"categories":4510},[121],{"categories":4512},[],{"categories":4514},[],{"categories":4516},[129],{"categories":4518},[155],{"categories":4520},[],{"categories":4522},[129],{"categories":4524},[129],{"categories":4526},[129],{"categories":4528},[],{"categories":4530},[76],{"categories":4532},[],{"categories":4534},[155],{"categories":4536},[121],{"categories":4538},[190],{"categories":4540},[76],{"categories":4542},[155],{"categories":4544},[76],{"categories":4546},[155],{"categories":4548},[],{"categories":4550},[155],{"categories":4552},[121],{"categories":4554},[129],{"categories":4556},[76],{"categories":4558},[],{"categories":4560},[206],{"categories":4562},[129],{"categories":4564},[132],{"categories":4566},[129],{"categories":4568},[121],{"categories":4570},[],{"categories":4572},[],{"categories":4574},[],{"categories":4576},[190],{"categories":4578},[129],{"categories":4580},[76],{"categories":4582},[76],{"categories":4584},[],{"categories":4586},[],{"categories":4588},[],{"categories":4590},[190],{"categories":4592},[76],{"categories":4594},[],{"categories":4596},[129],{"categories":4598},[76],{"categories":4600},[121],{"categories":4602},[],{"categories":4604},[],{"categories":4606},[190],{"categories":4608},[76],{"categories":4610},[155],{"categories":4612},[],{"categories":4614},[215],{"categories":4616},[155],{"categories":4618},[215],{"categories":4620},[193],{"categories":4622},[76],{"categories":4624},[76],{"categories":4626},[],{"categories":4628},[],{"categories":4630},[129],{"categories":4632},[],{"categories":4634},[76],{"categories":4636},[76],{"categories":4638},[],{"categories":4640},[129],{"categories":4642},[76],{"categories":4644},[76],{"categories":4646},[],{"categories":4648},[129],{"categories":4650},[76],{"categories":4652},[155],{"categories":4654},[76],{"categories":4656},[215],{"categories":4658},[124],{"categories":4660},[76],{"categories":4662},[76],{"categories":4664},[129],{"categories":4666},[193],{"categories":4668},[129],{"categories":4670},[129],{"categories":4672},[],{"categories":4674},[],{"categories":4676},[76],{"categories":4678},[],{"categories":4680},[155],{"categories":4682},[124],{"categories":4684},[],{"categories":4686},[],{"categories":4688},[190],{"categories":4690},[121],{"categories":4692},[],{"categories":4694},[124],{"categories":4696},[215],{"categories":4698},[76],{"categories":4700},[206],{"categories":4702},[121],{"categories":4704},[193],{"categories":4706},[124],{"categories":4708},[206],{"categories":4710},[206],{"categories":4712},[],{"categories":4714},[76],{"categories":4716},[],{"categories":4718},[129],{"categories":4720},[121],{"categories":4722},[190],{"categories":4724},[76],{"categories":4726},[121],{"categories":4728},[129],{"categories":4730},[244],{"categories":4732},[76],{"categories":4734},[76],{"categories":4736},[76],{"categories":4738},[121],{"categories":4740},[193],{"categories":4742},[129],{"categories":4744},[],{"categories":4746},[76],{"categories":4748},[206],{"categories":4750},[155],{"categories":4752},[206],{"categories":4754},[76],{"categories":4756},[132],{"categories":4758},[],{"categories":4760},[190],{"categories":4762},[155],{"categories":4764},[121],{"categories":4766},[129],{"categories":4768},[76],{"categories":4770},[76],{"categories":4772},[129],{"categories":4774},[76],{"categories":4776},[76],{"categories":4778},[124],{"categories":4780},[129],{"categories":4782},[129,244],{"categories":4784},[129],{"categories":4786},[206],{"categories":4788},[76],{"categories":4790},[76],{"categories":4792},[193],{"categories":4794},[129],{"categories":4796},[215],{"categories":4798},[129],{"categories":4800},[124],{"categories":4802},[],{"categories":4804},[129],{"categories":4806},[76],{"categories":4808},[124],{"categories":4810},[],{"categories":4812},[],{"categories":4814},[76],{"categories":4816},[129],{"categories":4818},[193],{"categories":4820},[215],{"categories":4822},[76],{"categories":4824},[76],{"categories":4826},[129],{"categories":4828},[],{"categories":4830},[129],{"categories":4832},[155],{"categories":4834},[129],{"categories":4836},[],{"categories":4838},[155],{"categories":4840},[206],{"categories":4842},[121],{"categories":4844},[206],{"categories":4846},[76],{"categories":4848},[129],{"categories":4850},[76],{"categories":4852},[76],{"categories":4854},[215],{"categories":4856},[206],{"categories":4858},[],{"categories":4860},[155],{"categories":4862},[76],{"categories":4864},[],{"categories":4866},[129],{"categories":4868},[76],{"categories":4870},[76],{"categories":4872},[76],{"categories":4874},[129],{"categories":4876},[76],{"categories":4878},[76],{"categories":4880},[132],{"categories":4882},[129],{"categories":4884},[76],{"categories":4886},[76],{"categories":4888},[76],{"categories":4890},[76],{"categories":4892},[76],{"categories":4894},[124],{"categories":4896},[],{"categories":4898},[132],{"categories":4900},[155],{"categories":4902},[129],{"categories":4904},[76],{"categories":4906},[206],{"categories":4908},[],{"categories":4910},[206],{"categories":4912},[206],{"categories":4914},[129],{"categories":4916},[206],{"categories":4918},[76],{"categories":4920},[76],{"categories":4922},[206],{"categories":4924},[76],{"categories":4926},[129],{"categories":4928},[155],{"categories":4930},[76],{"categories":4932},[76],{"categories":4934},[76],{"categories":4936},[124],{"categories":4938},[76],{"categories":4940},[129],{"categories":4942},[190],{"categories":4944},[],{"categories":4946},[76],{"categories":4948},[193],{"categories":4950},[129],{"categories":4952},[76],{"categories":4954},[],{"categories":4956},[76],{"categories":4958},[76],{"categories":4960},[155],{"categories":4962},[76],{"categories":4964},[76],{"categories":4966},[129],{"categories":4968},[215],{"categories":4970},[],{"categories":4972},[],{"categories":4974},[155],{"categories":4976},[206],{"categories":4978},[155],{"categories":4980},[76],{"categories":4982},[215],{"categories":4984},[76],{"categories":4986},[121],{"categories":4988},[129],{"categories":4990},[76],{"categories":4992},[129],{"categories":4994},[129],{"categories":4996},[76],{"categories":4998},[124],{"categories":5000},[],{"categories":5002},[193],{"categories":5004},[76],{"categories":5006},[],{"categories":5008},[155],{"categories":5010},[76],{"categories":5012},[193],{"categories":5014},[76],{"categories":5016},[206],{"categories":5018},[206],{"categories":5020},[206],{"categories":5022},[129],{"categories":5024},[129],{"categories":5026},[129],{"categories":5028},[76],{"categories":5030},[190],{"categories":5032},[193],{"categories":5034},[193],{"categories":5036},[],{"categories":5038},[155],{"categories":5040},[76],{"categories":5042},[76],{"categories":5044},[206],{"categories":5046},[],{"categories":5048},[155],{"categories":5050},[155],{"categories":5052},[155],{"categories":5054},[],{"categories":5056},[129],{"categories":5058},[76],{"categories":5060},[],{"categories":5062},[121],{"categories":5064},[124],{"categories":5066},[],{"categories":5068},[76],{"categories":5070},[76],{"categories":5072},[],{"categories":5074},[206],{"categories":5076},[],{"categories":5078},[],{"categories":5080},[],{"categories":5082},[],{"categories":5084},[76],{"categories":5086},[155],{"categories":5088},[],{"categories":5090},[],{"categories":5092},[76],{"categories":5094},[76],{"categories":5096},[76],{"categories":5098},[193],{"categories":5100},[76],{"categories":5102},[193],{"categories":5104},[],{"categories":5106},[193],{"categories":5108},[193],{"categories":5110},[244],{"categories":5112},[129],{"categories":5114},[206],{"categories":5116},[],{"categories":5118},[],{"categories":5120},[193],{"categories":5122},[206],{"categories":5124},[206],{"categories":5126},[206],{"categories":5128},[],{"categories":5130},[121],{"categories":5132},[206],{"categories":5134},[206],{"categories":5136},[121],{"categories":5138},[206],{"categories":5140},[124],{"categories":5142},[206],{"categories":5144},[206],{"categories":5146},[206],{"categories":5148},[193],{"categories":5150},[155],{"categories":5152},[155],{"categories":5154},[76],{"categories":5156},[206],{"categories":5158},[193],{"categories":5160},[244],{"categories":5162},[193],{"categories":5164},[193],{"categories":5166},[193],{"categories":5168},[],{"categories":5170},[124],{"categories":5172},[],{"categories":5174},[244],{"categories":5176},[206],{"categories":5178},[206],{"categories":5180},[206],{"categories":5182},[129],{"categories":5184},[155,124],{"categories":5186},[193],{"categories":5188},[],{"categories":5190},[],{"categories":5192},[193],{"categories":5194},[],{"categories":5196},[193],{"categories":5198},[155],{"categories":5200},[129],{"categories":5202},[],{"categories":5204},[206],{"categories":5206},[76],{"categories":5208},[190],{"categories":5210},[],{"categories":5212},[76],{"categories":5214},[],{"categories":5216},[155],{"categories":5218},[121],{"categories":5220},[193],{"categories":5222},[],{"categories":5224},[206],{"categories":5226},[155],[5228,5375,5480,5547],{"id":5229,"title":5230,"ai":5231,"body":5236,"categories":5331,"created_at":77,"date_modified":77,"description":69,"extension":78,"faq":77,"featured":79,"kicker_label":77,"meta":5332,"navigation":100,"path":5359,"published_at":5360,"question":77,"scraped_at":5361,"seo":5362,"sitemap":5363,"source_id":5364,"source_name":5365,"source_type":5366,"source_url":5367,"stem":5368,"tags":5369,"thumbnail_url":5370,"tldr":5371,"tweet":5372,"unknown_tags":5373,"__hash__":5374},"summaries\u002Fsummaries\u002F6e0d96342ee641a1-the-art-science-of-benchmarking-ai-agents-summary.md","The Art & Science of Benchmarking AI Agents",{"provider":7,"model":8,"input_tokens":5232,"output_tokens":5233,"processing_time_ms":5234,"cost_usd":5235},8202,995,5199,0.003543,{"type":14,"value":5237,"toc":5326},[5238,5242,5245,5271,5275,5278,5298,5302,5305],[17,5239,5241],{"id":5240},"the-science-of-effective-benchmarks","The Science of Effective Benchmarks",[22,5243,5244],{},"To build a benchmark that actually shapes the field, builders must move beyond simple accuracy metrics and focus on four empirical pillars:",[33,5246,5247,5253,5259,5265],{},[36,5248,5249,5252],{},[39,5250,5251],{},"Individual Task Quality:"," Tasks must be rigorously validated, well-posed, and tractable for experts. The author highlights GPQA for its adversarial quality control, where multi-expert protocols and incentive mechanisms ensure tasks are not just difficult, but correctly structured.",[36,5254,5255,5258],{},[39,5256,5257],{},"Distributional Diversity:"," A benchmark is only as good as its coverage. Builders should define a clear taxonomy of the domain and intentionally distribute tasks across it, including rare but critical failure modes. MMLU is cited as a gold standard for its intentional taxonomy across 57 domains.",[36,5260,5261,5264],{},[39,5262,5263],{},"Model Headroom:"," Benchmarks must remain unsaturated to effectively separate frontier models. The ARC Prize is highlighted as a model for this, as it consistently exposes the gap between human reasoning and model capabilities, reliably predicting leaps in model performance.",[36,5266,5267,5270],{},[39,5268,5269],{},"Robust Eval Methodology:"," Evaluation must capture real-world constraints beyond simple completion. The author points to ToW-Bench, which evaluates agents not just on task success, but on adherence to policy constraints (e.g., failing a flight booking if it violates class rules).",[17,5272,5274],{"id":5273},"the-art-of-shaping-the-frontier","The Art of Shaping the Frontier",[22,5276,5277],{},"Beyond empirical rigor, the most influential benchmarks act as strategic bets that guide the research community:",[33,5279,5280,5286,5292],{},[36,5281,5282,5285],{},[39,5283,5284],{},"Thesis-Driven Design:"," Great benchmarks represent a bet on where the field is going. Terminal Bench, for example, was a bet that the CLI would become a primary interface for agents—a bet that has since been validated by the industry.",[36,5287,5288,5291],{},[39,5289,5290],{},"Roadmap Generation:"," A successful benchmark spawns a family of research. SWE-bench is praised for its simplicity and its ability to inspire a new generation of coding-agent benchmarks (e.g., light, verified, multimodal versions), creating a clear path for future innovation.",[36,5293,5294,5297],{},[39,5295,5296],{},"Researcher UX:"," This is a severely underrated factor. If a benchmark is difficult to run, extend, or use for RL\u002Ffine-tuning, it will not be adopted. Building standardized harnesses (like HELM or Harbor) is essential for ensuring that the community can easily hill-climb against the benchmark.",[17,5299,5301],{"id":5300},"the-next-generation-of-benchmarks","The Next Generation of Benchmarks",[22,5303,5304],{},"To push the frontier further, the author proposes three new axes for future benchmark development:",[5306,5307,5308,5314,5320],"ol",{},[36,5309,5310,5313],{},[39,5311,5312],{},"Environment Complexity:"," Moving beyond isolated tasks to represent real-world \"messiness,\" such as organizational policies, flaky toolchains, and multi-modal context.",[36,5315,5316,5319],{},[39,5317,5318],{},"Autonomy Horizon:"," Measuring reliability over long-term, multi-week interactions where context shifts, requirements change, and state management becomes the primary challenge.",[36,5321,5322,5325],{},[39,5323,5324],{},"Output Complexity:"," Expanding evaluation beyond text to include nuanced reward signals and diverse artifacts that reflect actual professional workflows.",{"title":69,"searchDepth":70,"depth":70,"links":5327},[5328,5329,5330],{"id":5240,"depth":70,"text":5241},{"id":5273,"depth":70,"text":5274},{"id":5300,"depth":70,"text":5301},[76],{"content_references":5333,"triage":5356},[5334,5338,5341,5344,5347,5350,5353],{"type":5335,"title":5336,"url":5337,"context":91},"tool","GPQA","https:\u002F\u002Fgithub.com\u002Fidavidrein\u002Fgpqa",{"type":5335,"title":5339,"url":5340,"context":91},"ARC Prize","https:\u002F\u002Farcprize.org\u002F",{"type":5335,"title":5342,"url":5343,"context":85},"MMLU","https:\u002F\u002Fgithub.com\u002Fhendrycks\u002Ftest",{"type":5335,"title":5345,"url":5346,"context":91},"ToW-Bench","https:\u002F\u002Fgithub.com\u002Ftow-bench\u002Ftow-bench",{"type":5335,"title":5348,"url":5349,"context":91},"Terminal Bench","https:\u002F\u002Fterminal-bench.github.io\u002F",{"type":5335,"title":5351,"url":5352,"context":91},"SWE-bench","https:\u002F\u002Fwww.swebench.com\u002F",{"type":5335,"title":5354,"url":5355,"context":91},"HELM","https:\u002F\u002Fcrfm.stanford.edu\u002Fhelm\u002Flatest\u002F",{"relevance":96,"novelty":96,"quality":96,"actionability":97,"composite":5357,"reasoning":5358},3.8,"Category: AI & LLMs. The article discusses effective benchmarking for AI agents, which is crucial for builders looking to evaluate and improve AI capabilities. It provides specific empirical pillars for creating benchmarks, addressing a pain point for developers needing practical evaluation methods.","\u002Fsummaries\u002F6e0d96342ee641a1-the-art-science-of-benchmarking-ai-agents-summary","2026-06-04 16:00:06","2026-06-06 16:08:56",{"title":5230,"description":69},{"loc":5359},"6e0d96342ee641a1","AI Engineer","video","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=iNkFlCiij0U","summaries\u002F6e0d96342ee641a1-the-art-science-of-benchmarking-ai-agents-summary",[111,112,113,114],"https:\u002F\u002Fi.ytimg.com\u002Fvi\u002FiNkFlCiij0U\u002Fhqdefault.jpg","Effective AI benchmarks are not just snapshots of current performance; they are strategic tools that define future capabilities, require rigorous task quality, and prioritize researcher UX to drive field-wide progress.","This talk outlines a framework for designing AI benchmarks, drawing on lessons from reviewing over 120 grant applications at [Snorkel AI](https:\u002F\u002Fsnorkel.ai). The speaker argues that effective benchmarks require both scientific rigor—focusing on task quality, distributional diversity, and model headroom—and an artistic \"thesis\" that anticipates future capabilities rather than just measuring current ones.",[113,114],"ZEgYR3dr9isWQwq1xAh-EB-r4KoE5sMBD19yp8pCfJw",{"id":5376,"title":5377,"ai":5378,"body":5383,"categories":5458,"created_at":77,"date_modified":77,"description":69,"extension":78,"faq":77,"featured":79,"kicker_label":77,"meta":5459,"navigation":100,"path":5470,"published_at":5471,"question":77,"scraped_at":5471,"seo":5472,"sitemap":5473,"source_id":5474,"source_name":106,"source_type":107,"source_url":5465,"stem":5475,"tags":5476,"thumbnail_url":77,"tldr":5477,"tweet":77,"unknown_tags":5478,"__hash__":5479},"summaries\u002Fsummaries\u002Fea94375e47039676-defining-true-agency-agentic-vs-agentive-systems-summary.md","Defining True Agency: Agentic vs. Agentive Systems",{"provider":7,"model":8,"input_tokens":5379,"output_tokens":5380,"processing_time_ms":5381,"cost_usd":5382},6107,566,3413,0.00237575,{"type":14,"value":5384,"toc":5453},[5385,5389,5396,5403,5407,5414,5446,5450],[17,5386,5388],{"id":5387},"the-distinction-between-agentic-and-agentive-systems","The Distinction Between Agentic and Agentive Systems",[22,5390,5391,5392,5395],{},"The authors argue that the current industry trend of labeling LLM-based tools as \"agents\" is misleading. Most existing systems are ",[39,5393,5394],{},"agentic",", meaning their competence is derived from external scaffolding, hard-coded workflows, and prompt-engineered chains. These systems are designed for specific, prescribed tasks and lack internal autonomy.",[22,5397,5398,5399,5402],{},"In contrast, ",[39,5400,5401],{},"agentive"," systems possess endogenous capabilities. Their ability to reason, interact, and adapt arises from within the model architecture itself. The authors posit that genuine agency is defined by five internalized dimensions: goal, identity, decision-making, self-regulation, and learning. Without these, a system is simply a sophisticated automation tool, not an autonomous agent.",[17,5404,5406],{"id":5405},"the-gic-architecture-for-general-purpose-agents","The GIC Architecture for General-Purpose Agents",[22,5408,5409,5410,5413],{},"To move beyond current limitations, the authors propose the ",[39,5411,5412],{},"Goal-Identity-Configurator (GIC)"," architecture. This framework aims to shift AI from task-specific automation to open-world autonomy through:",[33,5415,5416,5422,5428,5434,5440],{},[36,5417,5418,5421],{},[39,5419,5420],{},"Hierarchical Goal Decomposition:"," The ability to break down high-level objectives into actionable steps internally.",[36,5423,5424,5427],{},[39,5425,5426],{},"Identity Evolution:"," Maintaining a consistent \"self\" that evolves based on experience, rather than resetting per session.",[36,5429,5430,5433],{},[39,5431,5432],{},"Simulative Reasoning:"," Grounding decision-making in a separately trained world model that allows the agent to simulate outcomes before taking action.",[36,5435,5436,5439],{},[39,5437,5438],{},"Learned Self-Regulation:"," Moving away from hard-coded guardrails toward a system that learns to regulate its own behavior.",[36,5441,5442,5445],{},[39,5443,5444],{},"Self-Directed Learning:"," Enabling the agent to learn from both real-world feedback and its own internal simulations.",[17,5447,5449],{"id":5448},"implications-for-safety-and-control","Implications for Safety and Control",[22,5451,5452],{},"The paper emphasizes that as systems move toward true agency, the traditional methods of human oversight (like simple prompt-based constraints) will become insufficient. The authors suggest that auditability and controllability must be built into the agentive architecture itself. By ensuring that goals and identities are transparent and modifiable, developers can maintain human oversight even as systems achieve higher levels of autonomous decision-making in open environments.",{"title":69,"searchDepth":70,"depth":70,"links":5454},[5455,5456,5457],{"id":5387,"depth":70,"text":5388},{"id":5405,"depth":70,"text":5406},{"id":5448,"depth":70,"text":5449},[76],{"content_references":5460,"triage":5467},[5461],{"type":5462,"title":5463,"author":5464,"url":5465,"context":5466},"paper","Critique of Agent Model","Eric Xing, Mingkai Deng, Jinyu Hou","https:\u002F\u002Farxiv.org\u002Fabs\u002F2606.23991","cited",{"relevance":97,"novelty":96,"quality":96,"actionability":70,"composite":5468,"reasoning":5469},3.25,"Category: AI & LLMs. The article discusses the distinction between agentic and agentive systems, which is relevant to AI and LLMs, but it lacks direct practical applications for product builders. While it presents a novel framework (GIC architecture) for developing more autonomous AI systems, it does not provide actionable steps or frameworks that the audience can implement immediately.","\u002Fsummaries\u002Fea94375e47039676-defining-true-agency-agentic-vs-agentive-systems-summary","2026-06-24 12:56:40",{"title":5377,"description":69},{"loc":5470},"ea94375e47039676","summaries\u002Fea94375e47039676-defining-true-agency-agentic-vs-agentive-systems-summary",[111,112,113],"Current 'AI agents' are merely engineered workflows. True agency requires internalizing goal-setting, identity, and self-regulation within the system, rather than relying on external scaffolding.",[113],"723cC8N3SpefDrn67F6CzQER4IcOZwUdfJXzlle2Y1M",{"id":5481,"title":5482,"ai":5483,"body":5488,"categories":5531,"created_at":77,"date_modified":77,"description":69,"extension":78,"faq":77,"featured":79,"kicker_label":77,"meta":5532,"navigation":100,"path":5536,"published_at":5537,"question":77,"scraped_at":5537,"seo":5538,"sitemap":5539,"source_id":5540,"source_name":106,"source_type":107,"source_url":5541,"stem":5542,"tags":5543,"thumbnail_url":77,"tldr":5544,"tweet":77,"unknown_tags":5545,"__hash__":5546},"summaries\u002Fsummaries\u002Fe1e01da94ce9dd4d-formalizing-theory-of-mind-for-ai-agents-summary.md","Formalizing Theory of Mind for AI Agents",{"provider":7,"model":8,"input_tokens":5484,"output_tokens":5485,"processing_time_ms":5486,"cost_usd":5487},4047,458,3956,0.00169875,{"type":14,"value":5489,"toc":5527},[5490,5494,5497,5501,5504,5524],[17,5491,5493],{"id":5492},"the-need-for-formalized-mentalizing","The Need for Formalized Mentalizing",[22,5495,5496],{},"Modern AI agents often struggle with social coordination because they lack a robust, internal mechanism to represent the beliefs, desires, and intentions of other agents. The authors argue that 'Theory of Mind' (ToM)—the cognitive ability to attribute mental states to oneself and others—should not be an emergent property of large-scale training but a formal, architectural component of agentic systems. By defining a 'ToM Utility,' the authors provide a framework that allows agents to explicitly compute the expected value of actions based on the predicted mental states of their counterparts.",[17,5498,5500],{"id":5499},"the-tom-utility-mechanism","The ToM Utility Mechanism",[22,5502,5503],{},"The core contribution is a formal specification of a mentalizing mechanism that integrates into existing decision-theoretic frameworks. Instead of treating other agents as stochastic elements of the environment, this model treats them as intentional actors with their own internal models. The mechanism functions by:",[5306,5505,5506,5512,5518],{},[36,5507,5508,5511],{},[39,5509,5510],{},"Recursive Modeling:"," Enabling agents to maintain nested beliefs (e.g., 'I believe that you believe X'), which is essential for complex negotiation and cooperative tasks.",[36,5513,5514,5517],{},[39,5515,5516],{},"Utility Optimization:"," Calculating an 'optimal' action by maximizing a utility function that accounts for how the agent's behavior influences the mental state of others, rather than just the physical state of the environment.",[36,5519,5520,5523],{},[39,5521,5522],{},"Updating Beliefs:"," Providing a structured way to update the agent's internal model of others based on observed actions, effectively closing the loop between prediction and observation.",[22,5525,5526],{},"This approach moves AI architecture away from purely reactive models toward proactive, social-aware agents capable of navigating multi-agent environments with higher strategic efficiency.",{"title":69,"searchDepth":70,"depth":70,"links":5528},[5529,5530],{"id":5492,"depth":70,"text":5493},{"id":5499,"depth":70,"text":5500},[76],{"content_references":5533,"triage":5534},[],{"relevance":97,"novelty":96,"quality":96,"actionability":70,"composite":5468,"reasoning":5535},"Category: AI & LLMs. The article discusses a formal mathematical specification for a Theory of Mind mechanism in AI agents, which is relevant to AI engineering. However, it lacks practical applications or frameworks that the audience can directly implement, making it less actionable.","\u002Fsummaries\u002Fe1e01da94ce9dd4d-formalizing-theory-of-mind-for-ai-agents-summary","2026-06-12 12:57:11",{"title":5482,"description":69},{"loc":5536},"e1e01da94ce9dd4d","https:\u002F\u002Farxiv.org\u002Fabs\u002F2606.12721","summaries\u002Fe1e01da94ce9dd4d-formalizing-theory-of-mind-for-ai-agents-summary",[111,112,113],"The article proposes a formal mathematical specification for a 'Theory of Mind' (ToM) mechanism, enabling AI agents to model and predict the mental states of other agents to improve collaborative decision-making.",[113],"mFEXNJG6D7Ydh0kUOpZD6CDb0fOKIEXXb8TIRTTl5kw",{"id":5548,"title":5549,"ai":5550,"body":5555,"categories":5603,"created_at":77,"date_modified":77,"description":69,"extension":78,"faq":77,"featured":79,"kicker_label":77,"meta":5604,"navigation":100,"path":5611,"published_at":5612,"question":77,"scraped_at":5612,"seo":5613,"sitemap":5614,"source_id":5615,"source_name":106,"source_type":107,"source_url":5608,"stem":5616,"tags":5617,"thumbnail_url":77,"tldr":5618,"tweet":77,"unknown_tags":5619,"__hash__":5620},"summaries\u002Fsummaries\u002Fe9dc0e089d254d6f-admem-advanced-memory-architectures-for-ai-task-so-summary.md","AdMem: Advanced Memory Architectures for AI Task-Solving Agents",{"provider":7,"model":8,"input_tokens":5551,"output_tokens":5552,"processing_time_ms":5553,"cost_usd":5554},4066,525,3575,0.001804,{"type":14,"value":5556,"toc":5598},[5557,5561,5564,5568,5571,5591,5595],[17,5558,5560],{"id":5559},"the-limitations-of-current-agent-memory","The Limitations of Current Agent Memory",[22,5562,5563],{},"Most current AI agents rely on either fixed-length context windows or basic Retrieval-Augmented Generation (RAG) to maintain state. These approaches often fail in complex, multi-step task environments because they struggle to distinguish between transient information and long-term task knowledge. AdMem (Advanced Memory) proposes a structured approach to memory management that separates working memory from long-term storage, allowing agents to maintain coherence over extended task trajectories.",[17,5565,5567],{"id":5566},"core-architecture-of-admem","Core Architecture of AdMem",[22,5569,5570],{},"AdMem functions by implementing a multi-tiered memory system that mimics cognitive processes. Instead of treating all retrieved data as equal, the system categorizes information based on its utility for the current task.",[33,5572,5573,5579,5585],{},[36,5574,5575,5578],{},[39,5576,5577],{},"Working Memory:"," Stores immediate, high-frequency state updates required for the current sub-task. This ensures the model does not lose track of local variables or immediate constraints.",[36,5580,5581,5584],{},[39,5582,5583],{},"Long-term Storage:"," Utilizes a structured index for historical task data, allowing the agent to recall successful strategies from previous sessions or similar problem domains without polluting the active context window.",[36,5586,5587,5590],{},[39,5588,5589],{},"Dynamic Retrieval:"," Unlike standard RAG, which often retrieves static chunks, AdMem employs a relevance-based filtering mechanism that prioritizes information based on the agent's current goal state, effectively reducing noise in the prompt.",[17,5592,5594],{"id":5593},"impact-on-task-solving-performance","Impact on Task-Solving Performance",[22,5596,5597],{},"By implementing this tiered architecture, agents demonstrate improved performance in long-horizon reasoning tasks. The primary benefit is the reduction of 'context drift,' where agents lose focus on the primary objective due to the accumulation of irrelevant historical data. AdMem allows for more efficient token usage by ensuring that only high-signal information is injected into the model's context, leading to both higher accuracy and lower latency in complex, multi-step workflows.",{"title":69,"searchDepth":70,"depth":70,"links":5599},[5600,5601,5602],{"id":5559,"depth":70,"text":5560},{"id":5566,"depth":70,"text":5567},{"id":5593,"depth":70,"text":5594},[76],{"content_references":5605,"triage":5609},[5606],{"type":5462,"title":5607,"url":5608,"context":88},"AdMem: Advanced Memory for Task-solving Agents","https:\u002F\u002Farxiv.org\u002Fabs\u002F2606.06787",{"relevance":95,"novelty":96,"quality":96,"actionability":97,"composite":98,"reasoning":5610},"Category: AI & LLMs. The article discusses a novel memory architecture for AI agents that addresses specific limitations in current systems, which is highly relevant for developers looking to enhance AI capabilities. It provides insights into a new approach to memory management, although it lacks detailed implementation steps for practical application.","\u002Fsummaries\u002Fe9dc0e089d254d6f-admem-advanced-memory-architectures-for-ai-task-so-summary","2026-06-08 12:56:52",{"title":5549,"description":69},{"loc":5611},"e9dc0e089d254d6f","summaries\u002Fe9dc0e089d254d6f-admem-advanced-memory-architectures-for-ai-task-so-summary",[111,112,113],"AdMem introduces a specialized memory architecture designed to improve task-solving agent performance by addressing the limitations of standard context windows and retrieval-augmented generation.",[113],"EqlyS3a6hwy1EojFp9bI_BJ4-_WvAadNFDZgBE_2UNY"]