[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"summary-a512181068703722-evaluating-llm-judge-reliability-via-subset-select-summary":3,"summaries-facets-categories":106,"summary-related-a512181068703722-evaluating-llm-judge-reliability-via-subset-select-summary":4835},{"id":4,"title":5,"ai":6,"body":13,"categories":72,"created_at":74,"date_modified":74,"description":66,"extension":75,"faq":74,"featured":76,"kicker_label":74,"meta":77,"navigation":89,"path":90,"published_at":91,"question":74,"scraped_at":91,"seo":92,"sitemap":93,"source_id":94,"source_name":95,"source_type":96,"source_url":82,"stem":97,"tags":98,"thumbnail_url":74,"tldr":103,"tweet":74,"unknown_tags":104,"__hash__":105},"summaries\u002Fsummaries\u002Fa512181068703722-evaluating-llm-judge-reliability-via-subset-select-summary.md","Evaluating LLM Judge Reliability via Subset Selection",{"provider":7,"model":8,"input_tokens":9,"output_tokens":10,"processing_time_ms":11,"cost_usd":12},"openrouter","google\u002Fgemini-3.1-flash-lite",4072,514,3211,0.001789,{"type":14,"value":15,"toc":65},"minimark",[16,21,25,29,32,35,58,62],[17,18,20],"h2",{"id":19},"the-challenge-of-llm-judge-alignment","The Challenge of LLM Judge Alignment",[22,23,24],"p",{},"Using LLMs as automated evaluators (LLM-as-a-judge) is common, but these judges often suffer from reliability issues, including positional bias, verbosity bias, and poor alignment with human judgment. The core problem is that standard evaluation datasets are often noisy or contain samples where the judge's performance is inherently unreliable. Evaluating a judge on an entire dataset without filtering leads to diluted metrics that fail to capture the judge's true capability.",[17,26,28],{"id":27},"the-metric-match-framework","The Metric Match Framework",[22,30,31],{},"Metric Match introduces a subset selection approach to refine how we measure judge reliability. Instead of evaluating a judge across an entire, heterogeneous dataset, the framework identifies a high-fidelity 'subset' of samples where the judge's performance is most stable and predictive of human preference.",[22,33,34],{},"By selecting samples that maximize the correlation between the LLM judge's output and human gold-standard labels, researchers can:",[36,37,38,46,52],"ul",{},[39,40,41,45],"li",{},[42,43,44],"strong",{},"Filter out noise:"," Remove samples where the task is ambiguous or the judge is prone to systematic bias.",[39,47,48,51],{},[42,49,50],{},"Improve sensitivity:"," Create a more precise evaluation signal that detects subtle improvements in judge performance.",[39,53,54,57],{},[42,55,56],{},"Enhance interpretability:"," Understand which types of prompts or tasks the LLM judge is actually competent at evaluating, rather than relying on a single, aggregate score that masks performance variance.",[17,59,61],{"id":60},"practical-implications-for-ai-engineering","Practical Implications for AI Engineering",[22,63,64],{},"For builders, this approach suggests that the quality of your evaluation pipeline is more important than the quantity of your test data. Rather than simply throwing more data at an LLM judge, developers should focus on curating 'golden subsets'—carefully selected examples that act as a reliable benchmark. This methodology allows for faster iteration cycles, as developers can rely on a smaller, high-signal evaluation set to determine if a prompt change or model swap actually improves the judge's alignment with human intent.",{"title":66,"searchDepth":67,"depth":67,"links":68},"",2,[69,70,71],{"id":19,"depth":67,"text":20},{"id":27,"depth":67,"text":28},{"id":60,"depth":67,"text":61},[73],"AI & LLMs",null,"md",false,{"content_references":78,"triage":84},[79],{"type":80,"title":81,"url":82,"context":83},"paper","Metric Match: A Subset Selection Approach to Evaluating LLM Judge Reliability","https:\u002F\u002Farxiv.org\u002Fabs\u002F2606.15029","cited",{"relevance":85,"novelty":86,"quality":86,"actionability":86,"composite":87,"reasoning":88},5,4,4.35,"Category: AI & LLMs. The article directly addresses the challenge of evaluating LLM judges, which is crucial for AI product builders looking to implement reliable evaluation metrics. It introduces the 'Metric Match' framework, providing actionable insights on refining evaluation pipelines, which aligns with the audience's need for practical applications in AI engineering.",true,"\u002Fsummaries\u002Fa512181068703722-evaluating-llm-judge-reliability-via-subset-select-summary","2026-06-16 12:56:55",{"title":5,"description":66},{"loc":90},"a512181068703722","arXiv cs.AI","article","summaries\u002Fa512181068703722-evaluating-llm-judge-reliability-via-subset-select-summary",[99,100,101,102],"llm","ai-tools","research","machine-learning","The 'Metric Match' approach improves LLM judge evaluation by using subset selection to identify high-fidelity data samples, ensuring that automated metrics better correlate with human preferences.",[],"2iRnWVS-F1XtffaikTw1-5ccZOse8b6uo5mlLrfpDcA",[107,110,113,115,118,121,123,125,127,129,131,133,135,137,140,142,144,146,148,150,152,154,156,158,160,162,164,166,168,171,174,176,178,180,182,184,187,189,191,193,196,198,200,202,204,206,208,210,212,214,216,218,221,223,225,227,229,231,233,235,237,239,241,243,245,247,249,251,253,255,257,259,261,263,265,267,269,271,273,275,277,279,281,283,285,287,289,291,293,295,297,299,301,303,305,307,309,311,313,315,317,319,321,323,325,327,329,331,333,335,337,339,341,343,345,347,349,351,353,355,357,359,361,363,365,367,369,371,373,375,377,379,381,383,385,387,389,391,393,395,397,399,401,403,405,407,409,411,413,415,417,419,421,423,425,427,429,431,433,435,437,439,441,443,445,447,449,451,453,455,457,459,461,463,465,467,469,471,473,475,477,479,481,483,485,487,489,491,493,495,497,499,501,503,505,507,509,511,513,515,517,519,521,523,525,527,529,531,533,535,537,539,541,543,545,547,549,551,553,555,557,559,561,563,565,567,569,571,573,575,577,579,581,583,585,587,589,591,593,595,597,599,601,603,605,607,609,611,613,615,617,619,621,623,625,627,629,631,633,635,637,639,641,643,645,647,649,651,653,655,657,659,661,663,665,667,669,671,673,675,677,679,681,683,685,687,689,691,693,695,697,699,701,703,705,707,709,711,713,715,717,719,721,723,725,727,729,731,733,735,737,739,741,743,745,747,749,751,753,755,757,759,761,763,765,767,769,771,773,775,777,779,781,783,785,787,789,791,793,795,797,799,801,803,805,807,809,811,813,815,817,819,821,823,825,827,829,831,833,835,837,839,841,843,845,847,849,851,853,855,857,859,861,863,865,867,869,871,873,875,877,879,881,883,885,887,889,891,893,895,897,899,901,903,905,907,909,911,913,915,917,919,921,923,925,927,929,931,933,935,937,939,941,943,945,947,949,951,953,955,957,959,961,963,965,967,969,971,973,975,977,979,981,983,985,987,989,991,993,995,997,999,1001,1003,1005,1007,1009,1011,1013,1015,1017,1019,1021,1023,1025,1027,1029,1031,1033,1035,1037,1039,1041,1043,1045,1047,1049,1051,1053,1055,1057,1059,1061,1063,1065,1067,1069,1071,1073,1075,1077,1079,1081,1083,1085,1087,1089,1091,1093,1095,1097,1099,1101,1103,1105,1107,1109,1111,1113,1115,1117,1119,1121,1123,1125,1127,1129,1131,1133,1135,1137,1139,1141,1143,1145,1147,1149,1151,1153,1155,1157,1159,1161,1163,1165,1167,1169,1171,1173,1175,1177,1179,1181,1183,1185,1187,1189,1191,1193,1195,1197,1199,1201,1203,1205,1207,1209,1211,1213,1215,1217,1219,1221,1223,1225,1227,1229,1231,1233,1235,1237,1239,1241,1243,1245,1247,1249,1251,1253,1255,1257,1259,1261,1263,1265,1267,1269,1271,1273,1275,1277,1279,1281,1283,1285,1287,1289,1291,1293,1295,1297,1299,1301,1303,1305,1307,1309,1311,1313,1315,1317,1319,1321,1323,1325,1327,1329,1331,1333,1335,1337,1339,1341,1343,1345,1347,1349,1351,1353,1355,1357,1359,1361,1363,1365,1367,1369,1371,1373,1375,1377,1379,1381,1383,1385,1387,1389,1391,1393,1395,1397,1399,1401,1403,1405,1407,1409,1411,1413,1415,1417,1419,1421,1423,1425,1427,1429,1431,1433,1435,1437,1439,1441,1443,1445,1447,1449,1451,1453,1455,1457,1459,1461,1463,1465,1467,1469,1471,1473,1475,1477,1479,1481,1483,1485,1487,1489,1491,1493,1495,1497,1499,1501,1503,1505,1507,1509,1511,1513,1515,1517,1519,1521,1523,1525,1527,1529,1531,1533,1535,1537,1539,1541,1543,1545,1547,1549,1551,1553,1555,1557,1559,1561,1563,1565,1567,1569,1571,1573,1575,1577,1579,1581,1583,1585,1587,1589,1591,1593,1595,1597,1599,1601,1603,1605,1607,1609,1611,1613,1615,1617,1619,1621,1623,1625,1627,1629,1631,1633,1635,1637,1639,1641,1643,1645,1647,1649,1651,1653,1655,1657,1659,1661,1663,1665,1667,1669,1671,1673,1675,1677,1679,1681,1683,1685,1687,1689,1691,1693,1695,1697,1699,1701,1703,1705,1707,1709,1711,1713,1715,1717,1719,1721,1723,1725,1727,1729,1731,1733,1735,1737,1739,1741,1743,1745,1747,1749,1751,1753,1755,1757,1759,1761,1763,1765,1767,1769,1771,1773,1775,1777,1779,1781,1783,1785,1787,1789,1791,1793,1795,1797,1799,1801,1803,1805,1807,1809,1811,1813,1815,1817,1819,1821,1823,1825,1827,1829,1831,1833,1835,1837,1839,1841,1843,1845,1847,1849,1851,1853,1855,1857,1859,1861,1863,1865,1867,1869,1871,1873,1875,1877,1879,1881,1883,1885,1887,1889,1891,1893,1895,1897,1899,1901,1903,1905,1907,1909,1911,1913,1915,1917,1919,1921,1923,1925,1927,1929,1931,1933,1935,1937,1939,1941,1943,1945,1947,1949,1951,1953,1955,1957,1959,1961,1963,1965,1967,1969,1971,1973,1975,1977,1979,1981,1983,1985,1987,1989,1991,1993,1995,1997,1999,2001,2003,2005,2007,2009,2011,2013,2015,2017,2019,2021,2023,2025,2027,2029,2031,2033,2035,2037,2039,2041,2043,2045,2047,2049,2051,2053,2055,2057,2059,2061,2063,2065,2067,2069,2071,2073,2075,2077,2079,2081,2083,2085,2087,2089,2091,2093,2095,2097,2099,2101,2103,2105,2107,2109,2111,2113,2115,2117,2119,2121,2123,2125,2127,2129,2131,2133,2135,2137,2139,2141,2143,2145,2147,2149,2151,2153,2155,2157,2159,2161,2163,2165,2167,2169,2171,2173,2175,2177,2179,2181,2183,2185,2187,2189,2191,2193,2195,2197,2199,2201,2203,2205,2207,2209,2211,2213,2215,2217,2219,2221,2223,2225,2227,2229,2231,2233,2235,2237,2239,2241,2243,2245,2247,2249,2251,2253,2255,2257,2259,2261,2263,2265,2267,2269,2271,2273,2275,2277,2279,2281,2283,2285,2287,2289,2291,2293,2295,2297,2299,2301,2303,2305,2307,2309,2311,2313,2315,2317,2319,2321,2323,2325,2327,2329,2331,2333,2335,2337,2339,2341,2343,2345,2347,2349,2351,2353,2355,2357,2359,2361,2363,2365,2367,2369,2371,2373,2375,2377,2379,2381,2383,2385,2387,2389,2391,2393,2395,2397,2399,2401,2403,2405,2407,2409,2411,2413,2415,2417,2419,2421,2423,2425,2427,2429,2431,2433,2435,2437,2439,2441,2443,2445,2447,2449,2451,2453,2455,2457,2459,2461,2463,2465,2467,2469,2471,2473,2475,2477,2479,2481,2483,2485,2487,2489,2491,2493,2495,2497,2499,2501,2503,2505,2507,2509,2511,2513,2515,2517,2519,2521,2523,2525,2527,2529,2531,2533,2535,2537,2539,2541,2543,2545,2547,2549,2551,2553,2555,2557,2559,2561,2563,2565,2567,2569,2571,2573,2575,2577,2579,2581,2583,2585,2587,2589,2591,2593,2595,2597,2599,2601,2603,2605,2607,2609,2611,2613,2615,2617,2619,2621,2623,2625,2627,2629,2631,2633,2635,2637,2639,2641,2643,2645,2647,2649,2651,2653,2655,2657,2659,2661,2663,2665,2667,2669,2671,2673,2675,2677,2679,2681,2683,2685,2687,2689,2691,2693,2695,2697,2699,2701,2703,2705,2707,2709,2711,2713,2715,2717,2719,2721,2723,2725,2727,2729,2731,2733,2735,2737,2739,2741,2743,2745,2747,2749,2751,2753,2755,2757,2759,2761,2763,2765,2767,2769,2771,2773,2775,2777,2779,2781,2783,2785,2787,2789,2791,2793,2795,2797,2799,2801,2803,2805,2807,2809,2811,2813,2815,2817,2819,2821,2823,2825,2827,2829,2831,2833,2835,2837,2839,2841,2843,2845,2847,2849,2851,2853,2855,2857,2859,2861,2863,2865,2867,2869,2871,2873,2875,2877,2879,2881,2883,2885,2887,2889,2891,2893,2895,2897,2899,2901,2903,2905,2907,2909,2911,2913,2915,2917,2919,2921,2923,2925,2927,2929,2931,2933,2935,2937,2939,2941,2943,2945,2947,2949,2951,2953,2955,2957,2959,2961,2963,2965,2967,2969,2971,2973,2975,2977,2979,2981,2983,2985,2987,2989,2991,2993,2995,2997,2999,3001,3003,3005,3007,3009,3011,3013,3015,3017,3019,3021,3023,3025,3027,3029,3031,3033,3035,3037,3039,3041,3043,3045,3047,3049,3051,3053,3055,3057,3059,3061,3063,3065,3067,3069,3071,3073,3075,3077,3079,3081,3083,3085,3087,3089,3091,3093,3095,3097,3099,3101,3103,3105,3107,3109,3111,3113,3115,3117,3119,3121,3123,3125,3127,3129,3131,3133,3135,3137,3139,3141,3143,3145,3147,3149,3151,3153,3155,3157,3159,3161,3163,3165,3167,3169,3171,3173,3175,3177,3179,3181,3183,3185,3187,3189,3191,3193,3195,3197,3199,3201,3203,3205,3207,3209,3211,3213,3215,3217,3219,3221,3223,3225,3227,3229,3231,3233,3235,3237,3239,3241,3243,3245,3247,3249,3251,3253,3255,3257,3259,3261,3263,3265,3267,3269,3271,3273,3275,3277,3279,3281,3283,3285,3287,3289,3291,3293,3295,3297,3299,3301,3303,3305,3307,3309,3311,3313,3315,3317,3319,3321,3323,3325,3327,3329,3331,3333,3335,3337,3339,3341,3343,3345,3347,3349,3351,3353,3355,3357,3359,3361,3363,3365,3367,3369,3371,3373,3375,3377,3379,3381,3383,3385,3387,3389,3391,3393,3395,3397,3399,3401,3403,3405,3407,3409,3411,3413,3415,3417,3419,3421,3423,3425,3427,3429,3431,3433,3435,3437,3439,3441,3443,3445,3447,3449,3451,3453,3455,3457,3459,3461,3463,3465,3467,3469,3471,3473,3475,3477,3479,3481,3483,3485,3487,3489,3491,3493,3495,3497,3499,3501,3503,3505,3507,3509,3511,3513,3515,3517,3519,3521,3523,3525,3527,3529,3531,3533,3535,3537,3539,3541,3543,3545,3547,3549,3551,3553,3555,3557,3559,3561,3563,3565,3567,3569,3571,3573,3575,3577,3579,3581,3583,3585,3587,3589,3591,3593,3595,3597,3599,3601,3603,3605,3607,3609,3611,3613,3615,3617,3619,3621,3623,3625,3627,3629,3631,3633,3635,3637,3639,3641,3643,3645,3647,3649,3651,3653,3655,3657,3659,3661,3663,3665,3667,3669,3671,3673,3675,3677,3679,3681,3683,3685,3687,3689,3691,3693,3695,3697,3699,3701,3703,3705,3707,3709,3711,3713,3715,3717,3719,3721,3723,3725,3727,3729,3731,3733,3735,3737,3739,3741,3743,3745,3747,3749,3751,3753,3755,3757,3759,3761,3763,3765,3767,3769,3771,3773,3775,3777,3779,3781,3783,3785,3787,3789,3791,3793,3795,3797,3799,3801,3803,3805,3807,3809,3811,3813,3815,3817,3819,3821,3823,3825,3827,3829,3831,3833,3835,3837,3839,3841,3843,3845,3847,3849,3851,3853,3855,3857,3859,3861,3863,3865,3867,3869,3871,3873,3875,3877,3879,3881,3883,3885,3887,3889,3891,3893,3895,3897,3899,3901,3903,3905,3907,3909,3911,3913,3915,3917,3919,3921,3923,3925,3927,3929,3931,3933,3935,3937,3939,3941,3943,3945,3947,3949,3951,3953,3955,3957,3959,3961,3963,3965,3967,3969,3971,3973,3975,3977,3979,3981,3983,3985,3987,3989,3991,3993,3995,3997,3999,4001,4003,4005,4007,4009,4011,4013,4015,4017,4019,4021,4023,4025,4027,4029,4031,4033,4035,4037,4039,4041,4043,4045,4047,4049,4051,4053,4055,4057,4059,4061,4063,4065,4067,4069,4071,4073,4075,4077,4079,4081,4083,4085,4087,4089,4091,4093,4095,4097,4099,4101,4103,4105,4107,4109,4111,4113,4115,4117,4119,4121,4123,4125,4127,4129,4131,4133,4135,4137,4139,4141,4143,4145,4147,4149,4151,4153,4155,4157,4159,4161,4163,4165,4167,4169,4171,4173,4175,4177,4179,4181,4183,4185,4187,4189,4191,4193,4195,4197,4199,4201,4203,4205,4207,4209,4211,4213,4215,4217,4219,4221,4223,4225,4227,4229,4231,4233,4235,4237,4239,4241,4243,4245,4247,4249,4251,4253,4255,4257,4259,4261,4263,4265,4267,4269,4271,4273,4275,4277,4279,4281,4283,4285,4287,4289,4291,4293,4295,4297,4299,4301,4303,4305,4307,4309,4311,4313,4315,4317,4319,4321,4323,4325,4327,4329,4331,4333,4335,4337,4339,4341,4343,4345,4347,4349,4351,4353,4355,4357,4359,4361,4363,4365,4367,4369,4371,4373,4375,4377,4379,4381,4383,4385,4387,4389,4391,4393,4395,4397,4399,4401,4403,4405,4407,4409,4411,4413,4415,4417,4419,4421,4423,4425,4427,4429,4431,4433,4435,4437,4439,4441,4443,4445,4447,4449,4451,4453,4455,4457,4459,4461,4463,4465,4467,4469,4471,4473,4475,4477,4479,4481,4483,4485,4487,4489,4491,4493,4495,4497,4499,4501,4503,4505,4507,4509,4511,4513,4515,4517,4519,4521,4523,4525,4527,4529,4531,4533,4535,4537,4539,4541,4543,4545,4547,4549,4551,4553,4555,4557,4559,4561,4563,4565,4567,4569,4571,4573,4575,4577,4579,4581,4583,4585,4587,4589,4591,4593,4595,4597,4599,4601,4603,4605,4607,4609,4611,4613,4615,4617,4619,4621,4623,4625,4627,4629,4631,4633,4635,4637,4639,4641,4643,4645,4647,4649,4651,4653,4655,4657,4659,4661,4663,4665,4667,4669,4671,4673,4675,4677,4679,4681,4683,4685,4687,4689,4691,4693,4695,4697,4699,4701,4703,4705,4707,4709,4711,4713,4715,4717,4719,4721,4723,4725,4727,4729,4731,4733,4735,4737,4739,4741,4743,4745,4747,4749,4751,4753,4755,4757,4759,4761,4763,4765,4767,4769,4771,4773,4775,4777,4779,4781,4783,4785,4787,4789,4791,4793,4795,4797,4799,4801,4803,4805,4807,4809,4811,4813,4815,4817,4819,4821,4823,4825,4827,4829,4831,4833],{"categories":108},[109],"Developer Productivity",{"categories":111},[112],"Business & SaaS",{"categories":114},[73],{"categories":116},[117],"AI Automation",{"categories":119},[120],"Product Strategy",{"categories":122},[73],{"categories":124},[109],{"categories":126},[73],{"categories":128},[112],{"categories":130},[],{"categories":132},[73],{"categories":134},[117],{"categories":136},[],{"categories":138},[139],"AI News & Trends",{"categories":141},[117],{"categories":143},[117],{"categories":145},[139],{"categories":147},[117],{"categories":149},[117],{"categories":151},[73],{"categories":153},[117],{"categories":155},[73],{"categories":157},[73],{"categories":159},[73],{"categories":161},[139],{"categories":163},[73],{"categories":165},[73],{"categories":167},[],{"categories":169},[170],"Design & Frontend",{"categories":172},[173],"Data Science & Visualization",{"categories":175},[139],{"categories":177},[73],{"categories":179},[],{"categories":181},[73],{"categories":183},[117],{"categories":185},[186],"Software Engineering",{"categories":188},[73],{"categories":190},[117],{"categories":192},[73],{"categories":194},[195],"Marketing & Growth",{"categories":197},[170],{"categories":199},[73],{"categories":201},[117],{"categories":203},[],{"categories":205},[],{"categories":207},[170],{"categories":209},[117],{"categories":211},[109],{"categories":213},[186],{"categories":215},[170],{"categories":217},[73],{"categories":219},[220],"DevOps & Cloud",{"categories":222},[117],{"categories":224},[139],{"categories":226},[73],{"categories":228},[],{"categories":230},[73],{"categories":232},[],{"categories":234},[117],{"categories":236},[186],{"categories":238},[],{"categories":240},[112],{"categories":242},[],{"categories":244},[],{"categories":246},[73],{"categories":248},[117],{"categories":250},[73],{"categories":252},[73],{"categories":254},[117],{"categories":256},[73],{"categories":258},[73],{"categories":260},[73],{"categories":262},[],{"categories":264},[186],{"categories":266},[],{"categories":268},[],{"categories":270},[186],{"categories":272},[],{"categories":274},[186],{"categories":276},[73],{"categories":278},[73],{"categories":280},[195],{"categories":282},[170],{"categories":284},[170],{"categories":286},[73],{"categories":288},[186],{"categories":290},[117],{"categories":292},[186],{"categories":294},[73],{"categories":296},[73],{"categories":298},[117],{"categories":300},[117],{"categories":302},[173],{"categories":304},[139],{"categories":306},[117],{"categories":308},[117],{"categories":310},[195],{"categories":312},[117],{"categories":314},[120],{"categories":316},[186],{"categories":318},[],{"categories":320},[117],{"categories":322},[],{"categories":324},[117],{"categories":326},[73],{"categories":328},[186],{"categories":330},[220],{"categories":332},[170],{"categories":334},[73],{"categories":336},[],{"categories":338},[186],{"categories":340},[73],{"categories":342},[],{"categories":344},[117],{"categories":346},[],{"categories":348},[73],{"categories":350},[],{"categories":352},[109],{"categories":354},[186],{"categories":356},[112],{"categories":358},[73],{"categories":360},[73],{"categories":362},[139],{"categories":364},[73],{"categories":366},[],{"categories":368},[73],{"categories":370},[],{"categories":372},[186],{"categories":374},[173],{"categories":376},[],{"categories":378},[73],{"categories":380},[170],{"categories":382},[],{"categories":384},[170],{"categories":386},[117],{"categories":388},[],{"categories":390},[73],{"categories":392},[73],{"categories":394},[117],{"categories":396},[139],{"categories":398},[112],{"categories":400},[73],{"categories":402},[],{"categories":404},[186],{"categories":406},[117],{"categories":408},[73],{"categories":410},[120],{"categories":412},[],{"categories":414},[73],{"categories":416},[120],{"categories":418},[117],{"categories":420},[73],{"categories":422},[117],{"categories":424},[],{"categories":426},[173],{"categories":428},[73],{"categories":430},[],{"categories":432},[109],{"categories":434},[73],{"categories":436},[112],{"categories":438},[73],{"categories":440},[117],{"categories":442},[73],{"categories":444},[73],{"categories":446},[186],{"categories":448},[73],{"categories":450},[],{"categories":452},[],{"categories":454},[73],{"categories":456},[73],{"categories":458},[],{"categories":460},[170],{"categories":462},[],{"categories":464},[73],{"categories":466},[],{"categories":468},[117],{"categories":470},[73],{"categories":472},[170],{"categories":474},[],{"categories":476},[73],{"categories":478},[117],{"categories":480},[73],{"categories":482},[112],{"categories":484},[117],{"categories":486},[73],{"categories":488},[73],{"categories":490},[170],{"categories":492},[117],{"categories":494},[],{"categories":496},[186],{"categories":498},[117],{"categories":500},[],{"categories":502},[139],{"categories":504},[],{"categories":506},[73],{"categories":508},[73],{"categories":510},[112,195],{"categories":512},[],{"categories":514},[73],{"categories":516},[117],{"categories":518},[],{"categories":520},[],{"categories":522},[73],{"categories":524},[170],{"categories":526},[73],{"categories":528},[],{"categories":530},[73],{"categories":532},[220],{"categories":534},[],{"categories":536},[139],{"categories":538},[170],{"categories":540},[],{"categories":542},[139],{"categories":544},[73],{"categories":546},[117],{"categories":548},[139],{"categories":550},[73],{"categories":552},[195],{"categories":554},[],{"categories":556},[112],{"categories":558},[186],{"categories":560},[73],{"categories":562},[117],{"categories":564},[],{"categories":566},[73,220],{"categories":568},[73],{"categories":570},[73],{"categories":572},[73],{"categories":574},[117],{"categories":576},[73,186],{"categories":578},[173],{"categories":580},[73],{"categories":582},[186],{"categories":584},[117],{"categories":586},[195],{"categories":588},[117],{"categories":590},[73],{"categories":592},[117],{"categories":594},[],{"categories":596},[117],{"categories":598},[73],{"categories":600},[73,112],{"categories":602},[112],{"categories":604},[],{"categories":606},[170],{"categories":608},[170],{"categories":610},[],{"categories":612},[],{"categories":614},[139],{"categories":616},[],{"categories":618},[109],{"categories":620},[73],{"categories":622},[186],{"categories":624},[73],{"categories":626},[170],{"categories":628},[117],{"categories":630},[186],{"categories":632},[139],{"categories":634},[170],{"categories":636},[],{"categories":638},[73],{"categories":640},[73],{"categories":642},[73],{"categories":644},[73],{"categories":646},[73],{"categories":648},[73],{"categories":650},[139],{"categories":652},[109],{"categories":654},[73],{"categories":656},[117],{"categories":658},[220],{"categories":660},[170],{"categories":662},[73],{"categories":664},[117],{"categories":666},[],{"categories":668},[],{"categories":670},[170],{"categories":672},[139],{"categories":674},[173],{"categories":676},[],{"categories":678},[73],{"categories":680},[73],{"categories":682},[112],{"categories":684},[73],{"categories":686},[73],{"categories":688},[73],{"categories":690},[139],{"categories":692},[170],{"categories":694},[],{"categories":696},[117],{"categories":698},[186],{"categories":700},[],{"categories":702},[73],{"categories":704},[73],{"categories":706},[117],{"categories":708},[186],{"categories":710},[73],{"categories":712},[173],{"categories":714},[],{"categories":716},[],{"categories":718},[73],{"categories":720},[],{"categories":722},[120],{"categories":724},[112],{"categories":726},[117],{"categories":728},[117],{"categories":730},[],{"categories":732},[109],{"categories":734},[73],{"categories":736},[112],{"categories":738},[139],{"categories":740},[109],{"categories":742},[],{"categories":744},[73],{"categories":746},[],{"categories":748},[],{"categories":750},[139],{"categories":752},[139],{"categories":754},[],{"categories":756},[170],{"categories":758},[186],{"categories":760},[],{"categories":762},[112],{"categories":764},[],{"categories":766},[],{"categories":768},[109],{"categories":770},[173],{"categories":772},[],{"categories":774},[195],{"categories":776},[117],{"categories":778},[112],{"categories":780},[117],{"categories":782},[186],{"categories":784},[],{"categories":786},[120],{"categories":788},[170],{"categories":790},[186],{"categories":792},[73],{"categories":794},[117],{"categories":796},[112],{"categories":798},[73],{"categories":800},[],{"categories":802},[],{"categories":804},[186],{"categories":806},[173],{"categories":808},[120],{"categories":810},[73],{"categories":812},[117],{"categories":814},[73],{"categories":816},[],{"categories":818},[139],{"categories":820},[220],{"categories":822},[],{"categories":824},[117],{"categories":826},[],{"categories":828},[109],{"categories":830},[],{"categories":832},[73],{"categories":834},[73],{"categories":836},[170],{"categories":838},[195],{"categories":840},[186],{"categories":842},[117],{"categories":844},[],{"categories":846},[186],{"categories":848},[109],{"categories":850},[],{"categories":852},[139],{"categories":854},[73,220],{"categories":856},[73],{"categories":858},[139],{"categories":860},[73],{"categories":862},[73],{"categories":864},[112],{"categories":866},[73],{"categories":868},[],{"categories":870},[73],{"categories":872},[112],{"categories":874},[73],{"categories":876},[],{"categories":878},[117],{"categories":880},[186],{"categories":882},[170],{"categories":884},[139],{"categories":886},[173],{"categories":888},[73],{"categories":890},[109],{"categories":892},[73],{"categories":894},[117],{"categories":896},[186],{"categories":898},[],{"categories":900},[],{"categories":902},[117],{"categories":904},[120],{"categories":906},[],{"categories":908},[73],{"categories":910},[],{"categories":912},[170],{"categories":914},[117],{"categories":916},[186],{"categories":918},[170],{"categories":920},[73],{"categories":922},[170],{"categories":924},[],{"categories":926},[],{"categories":928},[139],{"categories":930},[117],{"categories":932},[117],{"categories":934},[73],{"categories":936},[73],{"categories":938},[73],{"categories":940},[112],{"categories":942},[73],{"categories":944},[],{"categories":946},[186],{"categories":948},[186],{"categories":950},[112],{"categories":952},[],{"categories":954},[73],{"categories":956},[73],{"categories":958},[117],{"categories":960},[109],{"categories":962},[112],{"categories":964},[139],{"categories":966},[117],{"categories":968},[195],{"categories":970},[73],{"categories":972},[117],{"categories":974},[],{"categories":976},[170],{"categories":978},[],{"categories":980},[73],{"categories":982},[73],{"categories":984},[],{"categories":986},[112],{"categories":988},[117],{"categories":990},[],{"categories":992},[73],{"categories":994},[220],{"categories":996},[173],{"categories":998},[186],{"categories":1000},[195],{"categories":1002},[73],{"categories":1004},[170],{"categories":1006},[73],{"categories":1008},[186],{"categories":1010},[117],{"categories":1012},[],{"categories":1014},[],{"categories":1016},[117],{"categories":1018},[109],{"categories":1020},[117],{"categories":1022},[120],{"categories":1024},[112],{"categories":1026},[],{"categories":1028},[73],{"categories":1030},[120],{"categories":1032},[73],{"categories":1034},[73],{"categories":1036},[73],{"categories":1038},[73],{"categories":1040},[195],{"categories":1042},[73],{"categories":1044},[73],{"categories":1046},[73],{"categories":1048},[170],{"categories":1050},[117],{"categories":1052},[],{"categories":1054},[],{"categories":1056},[220],{"categories":1058},[186],{"categories":1060},[],{"categories":1062},[117],{"categories":1064},[73],{"categories":1066},[170,73],{"categories":1068},[109],{"categories":1070},[],{"categories":1072},[73],{"categories":1074},[109],{"categories":1076},[170],{"categories":1078},[117],{"categories":1080},[186],{"categories":1082},[],{"categories":1084},[73],{"categories":1086},[],{"categories":1088},[],{"categories":1090},[73],{"categories":1092},[109],{"categories":1094},[73],{"categories":1096},[],{"categories":1098},[117],{"categories":1100},[120],{"categories":1102},[186],{"categories":1104},[73],{"categories":1106},[73],{"categories":1108},[73],{"categories":1110},[170],{"categories":1112},[117],{"categories":1114},[220],{"categories":1116},[170],{"categories":1118},[112],{"categories":1120},[117],{"categories":1122},[73],{"categories":1124},[73],{"categories":1126},[73],{"categories":1128},[117],{"categories":1130},[186],{"categories":1132},[73],{"categories":1134},[120],{"categories":1136},[],{"categories":1138},[139],{"categories":1140},[],{"categories":1142},[120],{"categories":1144},[117],{"categories":1146},[170],{"categories":1148},[73],{"categories":1150},[73],{"categories":1152},[117],{"categories":1154},[186],{"categories":1156},[170],{"categories":1158},[117],{"categories":1160},[139],{"categories":1162},[],{"categories":1164},[73],{"categories":1166},[],{"categories":1168},[73],{"categories":1170},[73],{"categories":1172},[170],{"categories":1174},[73],{"categories":1176},[109],{"categories":1178},[139],{"categories":1180},[73],{"categories":1182},[73],{"categories":1184},[195],{"categories":1186},[73],{"categories":1188},[73],{"categories":1190},[117],{"categories":1192},[117],{"categories":1194},[73],{"categories":1196},[117],{"categories":1198},[117],{"categories":1200},[73],{"categories":1202},[73],{"categories":1204},[117],{"categories":1206},[170],{"categories":1208},[73],{"categories":1210},[73],{"categories":1212},[],{"categories":1214},[],{"categories":1216},[186],{"categories":1218},[],{"categories":1220},[109],{"categories":1222},[220],{"categories":1224},[73],{"categories":1226},[],{"categories":1228},[109],{"categories":1230},[112],{"categories":1232},[73],{"categories":1234},[195],{"categories":1236},[],{"categories":1238},[112],{"categories":1240},[],{"categories":1242},[73],{"categories":1244},[186],{"categories":1246},[],{"categories":1248},[],{"categories":1250},[],{"categories":1252},[],{"categories":1254},[73],{"categories":1256},[117],{"categories":1258},[220],{"categories":1260},[73],{"categories":1262},[109],{"categories":1264},[186],{"categories":1266},[73],{"categories":1268},[73],{"categories":1270},[186],{"categories":1272},[120],{"categories":1274},[73],{"categories":1276},[195],{"categories":1278},[186],{"categories":1280},[112],{"categories":1282},[73],{"categories":1284},[73],{"categories":1286},[73],{"categories":1288},[73],{"categories":1290},[117],{"categories":1292},[73,109],{"categories":1294},[186],{"categories":1296},[186],{"categories":1298},[170],{"categories":1300},[117],{"categories":1302},[186],{"categories":1304},[73],{"categories":1306},[73],{"categories":1308},[],{"categories":1310},[],{"categories":1312},[73],{"categories":1314},[],{"categories":1316},[73],{"categories":1318},[186],{"categories":1320},[173],{"categories":1322},[139],{"categories":1324},[170],{"categories":1326},[73],{"categories":1328},[186],{"categories":1330},[],{"categories":1332},[73],{"categories":1334},[73],{"categories":1336},[73],{"categories":1338},[73],{"categories":1340},[],{"categories":1342},[117],{"categories":1344},[73],{"categories":1346},[73],{"categories":1348},[],{"categories":1350},[117],{"categories":1352},[73],{"categories":1354},[112],{"categories":1356},[],{"categories":1358},[109],{"categories":1360},[73],{"categories":1362},[73],{"categories":1364},[109],{"categories":1366},[73],{"categories":1368},[186],{"categories":1370},[195],{"categories":1372},[117],{"categories":1374},[117],{"categories":1376},[73,170],{"categories":1378},[139],{"categories":1380},[73],{"categories":1382},[170],{"categories":1384},[],{"categories":1386},[186],{"categories":1388},[220],{"categories":1390},[170],{"categories":1392},[186],{"categories":1394},[73],{"categories":1396},[73],{"categories":1398},[117],{"categories":1400},[],{"categories":1402},[],{"categories":1404},[],{"categories":1406},[],{"categories":1408},[186],{"categories":1410},[73],{"categories":1412},[117],{"categories":1414},[112],{"categories":1416},[117],{"categories":1418},[220],{"categories":1420},[73],{"categories":1422},[73],{"categories":1424},[73],{"categories":1426},[117],{"categories":1428},[73],{"categories":1430},[73],{"categories":1432},[],{"categories":1434},[170],{"categories":1436},[186],{"categories":1438},[],{"categories":1440},[],{"categories":1442},[117],{"categories":1444},[],{"categories":1446},[],{"categories":1448},[195],{"categories":1450},[195],{"categories":1452},[117],{"categories":1454},[186],{"categories":1456},[],{"categories":1458},[73],{"categories":1460},[73],{"categories":1462},[186],{"categories":1464},[170],{"categories":1466},[170],{"categories":1468},[73],{"categories":1470},[117],{"categories":1472},[109],{"categories":1474},[73],{"categories":1476},[73],{"categories":1478},[170],{"categories":1480},[170],{"categories":1482},[117],{"categories":1484},[117],{"categories":1486},[73],{"categories":1488},[],{"categories":1490},[73],{"categories":1492},[],{"categories":1494},[73],{"categories":1496},[117],{"categories":1498},[139],{"categories":1500},[186],{"categories":1502},[73],{"categories":1504},[186],{"categories":1506},[109],{"categories":1508},[73],{"categories":1510},[],{"categories":1512},[117],{"categories":1514},[117],{"categories":1516},[],{"categories":1518},[73],{"categories":1520},[109],{"categories":1522},[73],{"categories":1524},[109],{"categories":1526},[109],{"categories":1528},[],{"categories":1530},[186],{"categories":1532},[],{"categories":1534},[117],{"categories":1536},[139],{"categories":1538},[73],{"categories":1540},[117],{"categories":1542},[73],{"categories":1544},[117],{"categories":1546},[73],{"categories":1548},[139],{"categories":1550},[173],{"categories":1552},[73],{"categories":1554},[120],{"categories":1556},[139],{"categories":1558},[170],{"categories":1560},[],{"categories":1562},[],{"categories":1564},[73],{"categories":1566},[73],{"categories":1568},[139],{"categories":1570},[],{"categories":1572},[],{"categories":1574},[],{"categories":1576},[117],{"categories":1578},[73],{"categories":1580},[],{"categories":1582},[186],{"categories":1584},[186],{"categories":1586},[173],{"categories":1588},[],{"categories":1590},[73],{"categories":1592},[73],{"categories":1594},[173],{"categories":1596},[186],{"categories":1598},[],{"categories":1600},[],{"categories":1602},[117],{"categories":1604},[117],{"categories":1606},[186],{"categories":1608},[117],{"categories":1610},[139],{"categories":1612},[139],{"categories":1614},[117],{"categories":1616},[117],{"categories":1618},[109],{"categories":1620},[73,220],{"categories":1622},[],{"categories":1624},[170],{"categories":1626},[186],{"categories":1628},[109],{"categories":1630},[73],{"categories":1632},[117],{"categories":1634},[170],{"categories":1636},[],{"categories":1638},[117],{"categories":1640},[117],{"categories":1642},[117],{"categories":1644},[73],{"categories":1646},[195],{"categories":1648},[73],{"categories":1650},[186],{"categories":1652},[170],{"categories":1654},[73],{"categories":1656},[],{"categories":1658},[117],{"categories":1660},[170],{"categories":1662},[73],{"categories":1664},[117],{"categories":1666},[117],{"categories":1668},[117],{"categories":1670},[195],{"categories":1672},[173],{"categories":1674},[73],{"categories":1676},[117],{"categories":1678},[73],{"categories":1680},[],{"categories":1682},[195],{"categories":1684},[139],{"categories":1686},[186],{"categories":1688},[73],{"categories":1690},[117],{"categories":1692},[],{"categories":1694},[],{"categories":1696},[73],{"categories":1698},[117],{"categories":1700},[73],{"categories":1702},[139],{"categories":1704},[73],{"categories":1706},[117],{"categories":1708},[117],{"categories":1710},[],{"categories":1712},[73],{"categories":1714},[],{"categories":1716},[],{"categories":1718},[73],{"categories":1720},[117],{"categories":1722},[],{"categories":1724},[],{"categories":1726},[173],{"categories":1728},[73],{"categories":1730},[173],{"categories":1732},[139],{"categories":1734},[73],{"categories":1736},[73],{"categories":1738},[117],{"categories":1740},[73],{"categories":1742},[117],{"categories":1744},[],{"categories":1746},[],{"categories":1748},[73],{"categories":1750},[220],{"categories":1752},[73],{"categories":1754},[],{"categories":1756},[],{"categories":1758},[109],{"categories":1760},[],{"categories":1762},[],{"categories":1764},[73],{"categories":1766},[],{"categories":1768},[],{"categories":1770},[186],{"categories":1772},[139],{"categories":1774},[195],{"categories":1776},[112],{"categories":1778},[73],{"categories":1780},[73],{"categories":1782},[112],{"categories":1784},[],{"categories":1786},[170],{"categories":1788},[73],{"categories":1790},[117],{"categories":1792},[112],{"categories":1794},[73],{"categories":1796},[73],{"categories":1798},[109],{"categories":1800},[73],{"categories":1802},[],{"categories":1804},[109],{"categories":1806},[73],{"categories":1808},[195],{"categories":1810},[117],{"categories":1812},[139],{"categories":1814},[73],{"categories":1816},[112],{"categories":1818},[73],{"categories":1820},[73],{"categories":1822},[117],{"categories":1824},[],{"categories":1826},[73],{"categories":1828},[186],{"categories":1830},[109],{"categories":1832},[73],{"categories":1834},[73],{"categories":1836},[],{"categories":1838},[139],{"categories":1840},[73],{"categories":1842},[73],{"categories":1844},[],{"categories":1846},[112],{"categories":1848},[112],{"categories":1850},[73],{"categories":1852},[73],{"categories":1854},[120],{"categories":1856},[73],{"categories":1858},[73],{"categories":1860},[],{"categories":1862},[186],{"categories":1864},[73],{"categories":1866},[],{"categories":1868},[],{"categories":1870},[73],{"categories":1872},[139],{"categories":1874},[],{"categories":1876},[220],{"categories":1878},[73],{"categories":1880},[73],{"categories":1882},[],{"categories":1884},[73],{"categories":1886},[186],{"categories":1888},[73],{"categories":1890},[73],{"categories":1892},[73,220],{"categories":1894},[73],{"categories":1896},[73],{"categories":1898},[170],{"categories":1900},[117],{"categories":1902},[],{"categories":1904},[117],{"categories":1906},[117],{"categories":1908},[73],{"categories":1910},[73],{"categories":1912},[73],{"categories":1914},[73],{"categories":1916},[109],{"categories":1918},[173],{"categories":1920},[109],{"categories":1922},[186],{"categories":1924},[170],{"categories":1926},[117],{"categories":1928},[73],{"categories":1930},[],{"categories":1932},[73],{"categories":1934},[139],{"categories":1936},[73],{"categories":1938},[117],{"categories":1940},[73],{"categories":1942},[73],{"categories":1944},[112],{"categories":1946},[],{"categories":1948},[220],{"categories":1950},[170],{"categories":1952},[170],{"categories":1954},[186],{"categories":1956},[117],{"categories":1958},[73],{"categories":1960},[112],{"categories":1962},[139],{"categories":1964},[170],{"categories":1966},[117],{"categories":1968},[73],{"categories":1970},[],{"categories":1972},[73],{"categories":1974},[73],{"categories":1976},[],{"categories":1978},[],{"categories":1980},[73],{"categories":1982},[73],{"categories":1984},[73],{"categories":1986},[186],{"categories":1988},[73],{"categories":1990},[73],{"categories":1992},[117],{"categories":1994},[73],{"categories":1996},[73],{"categories":1998},[],{"categories":2000},[173],{"categories":2002},[73],{"categories":2004},[117],{"categories":2006},[],{"categories":2008},[],{"categories":2010},[73],{"categories":2012},[73],{"categories":2014},[73],{"categories":2016},[139],{"categories":2018},[],{"categories":2020},[170],{"categories":2022},[73],{"categories":2024},[220],{"categories":2026},[139],{"categories":2028},[186],{"categories":2030},[186],{"categories":2032},[139],{"categories":2034},[139],{"categories":2036},[220],{"categories":2038},[],{"categories":2040},[139],{"categories":2042},[73],{"categories":2044},[109],{"categories":2046},[73],{"categories":2048},[139],{"categories":2050},[],{"categories":2052},[73],{"categories":2054},[186],{"categories":2056},[173],{"categories":2058},[73],{"categories":2060},[139],{"categories":2062},[73],{"categories":2064},[186],{"categories":2066},[117],{"categories":2068},[139],{"categories":2070},[117],{"categories":2072},[220],{"categories":2074},[117],{"categories":2076},[73],{"categories":2078},[73],{"categories":2080},[186],{"categories":2082},[73],{"categories":2084},[],{"categories":2086},[112],{"categories":2088},[],{"categories":2090},[],{"categories":2092},[73],{"categories":2094},[117],{"categories":2096},[73],{"categories":2098},[73],{"categories":2100},[73],{"categories":2102},[73],{"categories":2104},[],{"categories":2106},[173],{"categories":2108},[109],{"categories":2110},[117],{"categories":2112},[170],{"categories":2114},[],{"categories":2116},[73],{"categories":2118},[186],{"categories":2120},[73],{"categories":2122},[220],{"categories":2124},[220],{"categories":2126},[],{"categories":2128},[117],{"categories":2130},[139],{"categories":2132},[139],{"categories":2134},[73],{"categories":2136},[117],{"categories":2138},[],{"categories":2140},[170],{"categories":2142},[73],{"categories":2144},[73],{"categories":2146},[],{"categories":2148},[73],{"categories":2150},[],{"categories":2152},[73],{"categories":2154},[186],{"categories":2156},[220],{"categories":2158},[73],{"categories":2160},[186],{"categories":2162},[112],{"categories":2164},[73],{"categories":2166},[],{"categories":2168},[117],{"categories":2170},[109],{"categories":2172},[109],{"categories":2174},[],{"categories":2176},[73],{"categories":2178},[73],{"categories":2180},[73],{"categories":2182},[186],{"categories":2184},[170],{"categories":2186},[73],{"categories":2188},[117],{"categories":2190},[],{"categories":2192},[73],{"categories":2194},[73],{"categories":2196},[117],{"categories":2198},[73],{"categories":2200},[],{"categories":2202},[117],{"categories":2204},[73],{"categories":2206},[117],{"categories":2208},[117],{"categories":2210},[186],{"categories":2212},[],{"categories":2214},[73],{"categories":2216},[117],{"categories":2218},[112],{"categories":2220},[73],{"categories":2222},[],{"categories":2224},[73],{"categories":2226},[],{"categories":2228},[73],{"categories":2230},[73],{"categories":2232},[],{"categories":2234},[73],{"categories":2236},[73],{"categories":2238},[139],{"categories":2240},[73],{"categories":2242},[73],{"categories":2244},[109],{"categories":2246},[73],{"categories":2248},[73],{"categories":2250},[173],{"categories":2252},[139],{"categories":2254},[117],{"categories":2256},[],{"categories":2258},[73],{"categories":2260},[170],{"categories":2262},[73],{"categories":2264},[195],{"categories":2266},[73],{"categories":2268},[117],{"categories":2270},[],{"categories":2272},[],{"categories":2274},[],{"categories":2276},[109],{"categories":2278},[139],{"categories":2280},[117],{"categories":2282},[73],{"categories":2284},[73],{"categories":2286},[73],{"categories":2288},[170],{"categories":2290},[117],{"categories":2292},[],{"categories":2294},[117],{"categories":2296},[117],{"categories":2298},[],{"categories":2300},[73],{"categories":2302},[117],{"categories":2304},[73],{"categories":2306},[],{"categories":2308},[73],{"categories":2310},[73],{"categories":2312},[139],{"categories":2314},[170],{"categories":2316},[117],{"categories":2318},[170],{"categories":2320},[117],{"categories":2322},[112],{"categories":2324},[],{"categories":2326},[],{"categories":2328},[73],{"categories":2330},[109],{"categories":2332},[117],{"categories":2334},[139],{"categories":2336},[],{"categories":2338},[170],{"categories":2340},[],{"categories":2342},[186],{"categories":2344},[186],{"categories":2346},[170],{"categories":2348},[186],{"categories":2350},[73],{"categories":2352},[],{"categories":2354},[73],{"categories":2356},[73],{"categories":2358},[],{"categories":2360},[195],{"categories":2362},[73],{"categories":2364},[220],{"categories":2366},[186],{"categories":2368},[],{"categories":2370},[117],{"categories":2372},[73],{"categories":2374},[109],{"categories":2376},[117],{"categories":2378},[117],{"categories":2380},[73],{"categories":2382},[73],{"categories":2384},[],{"categories":2386},[109],{"categories":2388},[73],{"categories":2390},[112],{"categories":2392},[186],{"categories":2394},[170],{"categories":2396},[],{"categories":2398},[],{"categories":2400},[],{"categories":2402},[117],{"categories":2404},[186],{"categories":2406},[170],{"categories":2408},[139],{"categories":2410},[73],{"categories":2412},[139],{"categories":2414},[117],{"categories":2416},[170],{"categories":2418},[73],{"categories":2420},[],{"categories":2422},[73],{"categories":2424},[117],{"categories":2426},[170],{"categories":2428},[139],{"categories":2430},[112],{"categories":2432},[186],{"categories":2434},[73],{"categories":2436},[139],{"categories":2438},[195],{"categories":2440},[],{"categories":2442},[],{"categories":2444},[173],{"categories":2446},[117],{"categories":2448},[73,186],{"categories":2450},[139],{"categories":2452},[73],{"categories":2454},[73],{"categories":2456},[117],{"categories":2458},[73],{"categories":2460},[117],{"categories":2462},[73],{"categories":2464},[73],{"categories":2466},[],{"categories":2468},[186],{"categories":2470},[170],{"categories":2472},[73],{"categories":2474},[173],{"categories":2476},[117],{"categories":2478},[195],{"categories":2480},[220],{"categories":2482},[],{"categories":2484},[73],{"categories":2486},[112],{"categories":2488},[117],{"categories":2490},[109],{"categories":2492},[117],{"categories":2494},[117],{"categories":2496},[120],{"categories":2498},[186],{"categories":2500},[73],{"categories":2502},[73],{"categories":2504},[],{"categories":2506},[],{"categories":2508},[],{"categories":2510},[220],{"categories":2512},[73],{"categories":2514},[139],{"categories":2516},[73],{"categories":2518},[73],{"categories":2520},[73],{"categories":2522},[],{"categories":2524},[173],{"categories":2526},[112],{"categories":2528},[117],{"categories":2530},[],{"categories":2532},[73],{"categories":2534},[117],{"categories":2536},[73],{"categories":2538},[220],{"categories":2540},[],{"categories":2542},[170],{"categories":2544},[170],{"categories":2546},[],{"categories":2548},[186],{"categories":2550},[73],{"categories":2552},[170],{"categories":2554},[73],{"categories":2556},[112],{"categories":2558},[117],{"categories":2560},[],{"categories":2562},[139],{"categories":2564},[73],{"categories":2566},[73],{"categories":2568},[170],{"categories":2570},[117],{"categories":2572},[139],{"categories":2574},[],{"categories":2576},[117],{"categories":2578},[117],{"categories":2580},[170],{"categories":2582},[73],{"categories":2584},[73],{"categories":2586},[],{"categories":2588},[73],{"categories":2590},[73],{"categories":2592},[220],{"categories":2594},[139],{"categories":2596},[173],{"categories":2598},[173],{"categories":2600},[],{"categories":2602},[],{"categories":2604},[],{"categories":2606},[117],{"categories":2608},[117],{"categories":2610},[186],{"categories":2612},[186],{"categories":2614},[73],{"categories":2616},[73],{"categories":2618},[73],{"categories":2620},[73],{"categories":2622},[117],{"categories":2624},[],{"categories":2626},[],{"categories":2628},[73],{"categories":2630},[],{"categories":2632},[73],{"categories":2634},[117],{"categories":2636},[170],{"categories":2638},[73],{"categories":2640},[73],{"categories":2642},[],{"categories":2644},[120],{"categories":2646},[73],{"categories":2648},[170],{"categories":2650},[73],{"categories":2652},[112],{"categories":2654},[73],{"categories":2656},[195],{"categories":2658},[117],{"categories":2660},[73],{"categories":2662},[73],{"categories":2664},[117],{"categories":2666},[73],{"categories":2668},[186],{"categories":2670},[],{"categories":2672},[139],{"categories":2674},[117],{"categories":2676},[],{"categories":2678},[139],{"categories":2680},[117],{"categories":2682},[117],{"categories":2684},[73],{"categories":2686},[117],{"categories":2688},[],{"categories":2690},[112],{"categories":2692},[117],{"categories":2694},[],{"categories":2696},[186],{"categories":2698},[73],{"categories":2700},[109],{"categories":2702},[139],{"categories":2704},[220],{"categories":2706},[117],{"categories":2708},[73],{"categories":2710},[117],{"categories":2712},[109],{"categories":2714},[],{"categories":2716},[73],{"categories":2718},[],{"categories":2720},[],{"categories":2722},[170],{"categories":2724},[73,112],{"categories":2726},[117],{"categories":2728},[73],{"categories":2730},[],{"categories":2732},[109],{"categories":2734},[173],{"categories":2736},[73],{"categories":2738},[186],{"categories":2740},[73],{"categories":2742},[117],{"categories":2744},[73],{"categories":2746},[73],{"categories":2748},[73],{"categories":2750},[139],{"categories":2752},[117],{"categories":2754},[73],{"categories":2756},[],{"categories":2758},[],{"categories":2760},[117],{"categories":2762},[73],{"categories":2764},[220],{"categories":2766},[],{"categories":2768},[73],{"categories":2770},[117],{"categories":2772},[117],{"categories":2774},[],{"categories":2776},[117],{"categories":2778},[73],{"categories":2780},[195],{"categories":2782},[73],{"categories":2784},[173],{"categories":2786},[117],{"categories":2788},[73],{"categories":2790},[220],{"categories":2792},[],{"categories":2794},[73],{"categories":2796},[195],{"categories":2798},[170],{"categories":2800},[73],{"categories":2802},[73],{"categories":2804},[],{"categories":2806},[195],{"categories":2808},[139],{"categories":2810},[73],{"categories":2812},[73],{"categories":2814},[109],{"categories":2816},[73],{"categories":2818},[],{"categories":2820},[],{"categories":2822},[170],{"categories":2824},[73],{"categories":2826},[173],{"categories":2828},[195],{"categories":2830},[117],{"categories":2832},[195],{"categories":2834},[139],{"categories":2836},[],{"categories":2838},[73],{"categories":2840},[],{"categories":2842},[73],{"categories":2844},[117],{"categories":2846},[73],{"categories":2848},[73],{"categories":2850},[],{"categories":2852},[73,186],{"categories":2854},[139],{"categories":2856},[117],{"categories":2858},[186],{"categories":2860},[73],{"categories":2862},[109],{"categories":2864},[],{"categories":2866},[],{"categories":2868},[117],{"categories":2870},[73],{"categories":2872},[186],{"categories":2874},[109],{"categories":2876},[186],{"categories":2878},[186],{"categories":2880},[73],{"categories":2882},[195],{"categories":2884},[73],{"categories":2886},[186],{"categories":2888},[],{"categories":2890},[170,73],{"categories":2892},[220],{"categories":2894},[109],{"categories":2896},[],{"categories":2898},[73],{"categories":2900},[112],{"categories":2902},[112],{"categories":2904},[73],{"categories":2906},[73],{"categories":2908},[73],{"categories":2910},[186],{"categories":2912},[117],{"categories":2914},[139],{"categories":2916},[195],{"categories":2918},[170],{"categories":2920},[73],{"categories":2922},[73],{"categories":2924},[73],{"categories":2926},[73],{"categories":2928},[109],{"categories":2930},[73],{"categories":2932},[117],{"categories":2934},[117],{"categories":2936},[186],{"categories":2938},[139],{"categories":2940},[186],{"categories":2942},[],{"categories":2944},[],{"categories":2946},[173],{"categories":2948},[73],{"categories":2950},[186],{"categories":2952},[73],{"categories":2954},[170],{"categories":2956},[73],{"categories":2958},[73],{"categories":2960},[73],{"categories":2962},[173],{"categories":2964},[73],{"categories":2966},[73],{"categories":2968},[73],{"categories":2970},[117],{"categories":2972},[117],{"categories":2974},[73,112],{"categories":2976},[],{"categories":2978},[170],{"categories":2980},[],{"categories":2982},[73],{"categories":2984},[139],{"categories":2986},[109],{"categories":2988},[109],{"categories":2990},[117],{"categories":2992},[117],{"categories":2994},[117],{"categories":2996},[73],{"categories":2998},[73],{"categories":3000},[112],{"categories":3002},[186],{"categories":3004},[195],{"categories":3006},[73],{"categories":3008},[],{"categories":3010},[139],{"categories":3012},[73],{"categories":3014},[73],{"categories":3016},[73],{"categories":3018},[73],{"categories":3020},[73],{"categories":3022},[186],{"categories":3024},[139],{"categories":3026},[186],{"categories":3028},[186],{"categories":3030},[73],{"categories":3032},[73],{"categories":3034},[73],{"categories":3036},[117],{"categories":3038},[139],{"categories":3040},[73],{"categories":3042},[117],{"categories":3044},[73],{"categories":3046},[73],{"categories":3048},[170],{"categories":3050},[73],{"categories":3052},[73],{"categories":3054},[220],{"categories":3056},[73],{"categories":3058},[120],{"categories":3060},[117],{"categories":3062},[73],{"categories":3064},[73],{"categories":3066},[139],{"categories":3068},[73],{"categories":3070},[117],{"categories":3072},[195],{"categories":3074},[73],{"categories":3076},[73],{"categories":3078},[112],{"categories":3080},[73],{"categories":3082},[],{"categories":3084},[73],{"categories":3086},[186],{"categories":3088},[73],{"categories":3090},[],{"categories":3092},[],{"categories":3094},[],{"categories":3096},[112],{"categories":3098},[73],{"categories":3100},[117],{"categories":3102},[139],{"categories":3104},[139],{"categories":3106},[139],{"categories":3108},[139],{"categories":3110},[],{"categories":3112},[109],{"categories":3114},[117],{"categories":3116},[139],{"categories":3118},[73],{"categories":3120},[109],{"categories":3122},[117],{"categories":3124},[73],{"categories":3126},[73,117],{"categories":3128},[117],{"categories":3130},[220],{"categories":3132},[139],{"categories":3134},[117],{"categories":3136},[139],{"categories":3138},[117],{"categories":3140},[73],{"categories":3142},[],{"categories":3144},[139],{"categories":3146},[195],{"categories":3148},[109],{"categories":3150},[73],{"categories":3152},[73],{"categories":3154},[],{"categories":3156},[186],{"categories":3158},[],{"categories":3160},[109],{"categories":3162},[117],{"categories":3164},[139],{"categories":3166},[73],{"categories":3168},[139],{"categories":3170},[109],{"categories":3172},[139],{"categories":3174},[139],{"categories":3176},[],{"categories":3178},[112],{"categories":3180},[117],{"categories":3182},[139],{"categories":3184},[139],{"categories":3186},[139],{"categories":3188},[139],{"categories":3190},[139],{"categories":3192},[139],{"categories":3194},[139],{"categories":3196},[139],{"categories":3198},[139],{"categories":3200},[139],{"categories":3202},[173],{"categories":3204},[109],{"categories":3206},[73],{"categories":3208},[73],{"categories":3210},[117],{"categories":3212},[117],{"categories":3214},[],{"categories":3216},[73,109],{"categories":3218},[],{"categories":3220},[117],{"categories":3222},[139],{"categories":3224},[117],{"categories":3226},[73],{"categories":3228},[73],{"categories":3230},[73],{"categories":3232},[73],{"categories":3234},[73],{"categories":3236},[117],{"categories":3238},[112],{"categories":3240},[117],{"categories":3242},[],{"categories":3244},[170],{"categories":3246},[139],{"categories":3248},[73],{"categories":3250},[],{"categories":3252},[],{"categories":3254},[117],{"categories":3256},[170],{"categories":3258},[73],{"categories":3260},[],{"categories":3262},[73],{"categories":3264},[],{"categories":3266},[195],{"categories":3268},[73],{"categories":3270},[],{"categories":3272},[],{"categories":3274},[139],{"categories":3276},[109],{"categories":3278},[73],{"categories":3280},[112],{"categories":3282},[73],{"categories":3284},[73],{"categories":3286},[73],{"categories":3288},[112],{"categories":3290},[170],{"categories":3292},[],{"categories":3294},[73],{"categories":3296},[139],{"categories":3298},[],{"categories":3300},[170],{"categories":3302},[73],{"categories":3304},[195],{"categories":3306},[73],{"categories":3308},[220],{"categories":3310},[],{"categories":3312},[195],{"categories":3314},[],{"categories":3316},[73],{"categories":3318},[],{"categories":3320},[117],{"categories":3322},[186],{"categories":3324},[],{"categories":3326},[112],{"categories":3328},[109],{"categories":3330},[117],{"categories":3332},[170],{"categories":3334},[186],{"categories":3336},[],{"categories":3338},[],{"categories":3340},[73],{"categories":3342},[109],{"categories":3344},[73],{"categories":3346},[195],{"categories":3348},[],{"categories":3350},[117],{"categories":3352},[117],{"categories":3354},[117],{"categories":3356},[139],{"categories":3358},[186],{"categories":3360},[73],{"categories":3362},[117],{"categories":3364},[120],{"categories":3366},[73],{"categories":3368},[117],{"categories":3370},[73],{"categories":3372},[120],{"categories":3374},[195],{"categories":3376},[139],{"categories":3378},[],{"categories":3380},[195],{"categories":3382},[],{"categories":3384},[186],{"categories":3386},[117],{"categories":3388},[],{"categories":3390},[73],{"categories":3392},[73],{"categories":3394},[73],{"categories":3396},[117],{"categories":3398},[112],{"categories":3400},[109],{"categories":3402},[73],{"categories":3404},[170],{"categories":3406},[186],{"categories":3408},[186],{"categories":3410},[73],{"categories":3412},[173],{"categories":3414},[117],{"categories":3416},[73],{"categories":3418},[117],{"categories":3420},[73],{"categories":3422},[112],{"categories":3424},[170],{"categories":3426},[186],{"categories":3428},[117],{"categories":3430},[73],{"categories":3432},[73],{"categories":3434},[117],{"categories":3436},[73],{"categories":3438},[139],{"categories":3440},[],{"categories":3442},[109],{"categories":3444},[73],{"categories":3446},[73],{"categories":3448},[73],{"categories":3450},[117],{"categories":3452},[73],{"categories":3454},[73],{"categories":3456},[73],{"categories":3458},[],{"categories":3460},[73],{"categories":3462},[170],{"categories":3464},[112],{"categories":3466},[139],{"categories":3468},[117],{"categories":3470},[73],{"categories":3472},[73],{"categories":3474},[170],{"categories":3476},[117],{"categories":3478},[73],{"categories":3480},[195],{"categories":3482},[173],{"categories":3484},[73],{"categories":3486},[73],{"categories":3488},[139],{"categories":3490},[73],{"categories":3492},[117],{"categories":3494},[220],{"categories":3496},[73],{"categories":3498},[117],{"categories":3500},[173],{"categories":3502},[],{"categories":3504},[117],{"categories":3506},[186],{"categories":3508},[170],{"categories":3510},[73],{"categories":3512},[109],{"categories":3514},[186],{"categories":3516},[112],{"categories":3518},[186],{"categories":3520},[73],{"categories":3522},[],{"categories":3524},[117],{"categories":3526},[117],{"categories":3528},[73],{"categories":3530},[73],{"categories":3532},[173],{"categories":3534},[],{"categories":3536},[139],{"categories":3538},[],{"categories":3540},[139],{"categories":3542},[73],{"categories":3544},[73],{"categories":3546},[117],{"categories":3548},[117],{"categories":3550},[117],{"categories":3552},[],{"categories":3554},[139],{"categories":3556},[73],{"categories":3558},[],{"categories":3560},[73],{"categories":3562},[73],{"categories":3564},[],{"categories":3566},[170],{"categories":3568},[186],{"categories":3570},[117],{"categories":3572},[73],{"categories":3574},[73],{"categories":3576},[195],{"categories":3578},[73],{"categories":3580},[73],{"categories":3582},[109],{"categories":3584},[],{"categories":3586},[73],{"categories":3588},[],{"categories":3590},[109],{"categories":3592},[139],{"categories":3594},[186],{"categories":3596},[73],{"categories":3598},[73],{"categories":3600},[73],{"categories":3602},[186],{"categories":3604},[139],{"categories":3606},[170],{"categories":3608},[73],{"categories":3610},[73],{"categories":3612},[73],{"categories":3614},[139],{"categories":3616},[170],{"categories":3618},[73],{"categories":3620},[139],{"categories":3622},[170],{"categories":3624},[73],{"categories":3626},[139],{"categories":3628},[117],{"categories":3630},[117],{"categories":3632},[117],{"categories":3634},[186],{"categories":3636},[139],{"categories":3638},[117],{"categories":3640},[117],{"categories":3642},[73],{"categories":3644},[186],{"categories":3646},[170],{"categories":3648},[73],{"categories":3650},[],{"categories":3652},[117],{"categories":3654},[],{"categories":3656},[],{"categories":3658},[],{"categories":3660},[112],{"categories":3662},[117],{"categories":3664},[73],{"categories":3666},[117],{"categories":3668},[109],{"categories":3670},[117],{"categories":3672},[195],{"categories":3674},[117],{"categories":3676},[],{"categories":3678},[117],{"categories":3680},[],{"categories":3682},[109],{"categories":3684},[117],{"categories":3686},[],{"categories":3688},[117],{"categories":3690},[73],{"categories":3692},[73],{"categories":3694},[139],{"categories":3696},[73],{"categories":3698},[117],{"categories":3700},[73],{"categories":3702},[73],{"categories":3704},[139],{"categories":3706},[117],{"categories":3708},[186],{"categories":3710},[170],{"categories":3712},[109],{"categories":3714},[],{"categories":3716},[117],{"categories":3718},[170],{"categories":3720},[220],{"categories":3722},[139],{"categories":3724},[73],{"categories":3726},[170],{"categories":3728},[73],{"categories":3730},[109],{"categories":3732},[],{"categories":3734},[117],{"categories":3736},[73],{"categories":3738},[73],{"categories":3740},[117],{"categories":3742},[73],{"categories":3744},[170],{"categories":3746},[],{"categories":3748},[117],{"categories":3750},[120],{"categories":3752},[139],{"categories":3754},[117],{"categories":3756},[112],{"categories":3758},[],{"categories":3760},[73],{"categories":3762},[120],{"categories":3764},[73],{"categories":3766},[117],{"categories":3768},[139],{"categories":3770},[109],{"categories":3772},[220],{"categories":3774},[73],{"categories":3776},[73],{"categories":3778},[73],{"categories":3780},[139],{"categories":3782},[112],{"categories":3784},[73],{"categories":3786},[170],{"categories":3788},[139],{"categories":3790},[220],{"categories":3792},[73],{"categories":3794},[],{"categories":3796},[],{"categories":3798},[73],{"categories":3800},[220],{"categories":3802},[173],{"categories":3804},[117],{"categories":3806},[117],{"categories":3808},[139],{"categories":3810},[73],{"categories":3812},[109],{"categories":3814},[73],{"categories":3816},[170],{"categories":3818},[117],{"categories":3820},[117],{"categories":3822},[73],{"categories":3824},[195],{"categories":3826},[73],{"categories":3828},[117],{"categories":3830},[],{"categories":3832},[73],{"categories":3834},[73],{"categories":3836},[73],{"categories":3838},[139],{"categories":3840},[109],{"categories":3842},[],{"categories":3844},[73],{"categories":3846},[73],{"categories":3848},[186],{"categories":3850},[170],{"categories":3852},[73],{"categories":3854},[73,117],{"categories":3856},[195,112],{"categories":3858},[73],{"categories":3860},[73],{"categories":3862},[],{"categories":3864},[117],{"categories":3866},[],{"categories":3868},[186],{"categories":3870},[73],{"categories":3872},[186],{"categories":3874},[],{"categories":3876},[73],{"categories":3878},[139],{"categories":3880},[73],{"categories":3882},[],{"categories":3884},[117],{"categories":3886},[73],{"categories":3888},[],{"categories":3890},[170],{"categories":3892},[73],{"categories":3894},[117],{"categories":3896},[73],{"categories":3898},[109],{"categories":3900},[117],{"categories":3902},[73],{"categories":3904},[],{"categories":3906},[220],{"categories":3908},[195],{"categories":3910},[112],{"categories":3912},[112],{"categories":3914},[73],{"categories":3916},[109],{"categories":3918},[109],{"categories":3920},[73],{"categories":3922},[117],{"categories":3924},[73],{"categories":3926},[73],{"categories":3928},[73],{"categories":3930},[186],{"categories":3932},[109],{"categories":3934},[73],{"categories":3936},[195],{"categories":3938},[139],{"categories":3940},[73],{"categories":3942},[73],{"categories":3944},[117],{"categories":3946},[73],{"categories":3948},[],{"categories":3950},[186],{"categories":3952},[],{"categories":3954},[186],{"categories":3956},[117],{"categories":3958},[109],{"categories":3960},[],{"categories":3962},[220],{"categories":3964},[73],{"categories":3966},[186],{"categories":3968},[],{"categories":3970},[139],{"categories":3972},[117],{"categories":3974},[186],{"categories":3976},[73],{"categories":3978},[117],{"categories":3980},[186],{"categories":3982},[117],{"categories":3984},[139],{"categories":3986},[109],{"categories":3988},[139],{"categories":3990},[186],{"categories":3992},[73],{"categories":3994},[170],{"categories":3996},[112],{"categories":3998},[73],{"categories":4000},[73],{"categories":4002},[73],{"categories":4004},[73],{"categories":4006},[73],{"categories":4008},[117],{"categories":4010},[73],{"categories":4012},[117],{"categories":4014},[73],{"categories":4016},[73],{"categories":4018},[109],{"categories":4020},[73],{"categories":4022},[117],{"categories":4024},[170],{"categories":4026},[117],{"categories":4028},[117],{"categories":4030},[109],{"categories":4032},[117],{"categories":4034},[170],{"categories":4036},[],{"categories":4038},[73],{"categories":4040},[173],{"categories":4042},[73],{"categories":4044},[73],{"categories":4046},[186],{"categories":4048},[],{"categories":4050},[117],{"categories":4052},[195],{"categories":4054},[73],{"categories":4056},[139],{"categories":4058},[195],{"categories":4060},[117],{"categories":4062},[112],{"categories":4064},[112],{"categories":4066},[73],{"categories":4068},[73],{"categories":4070},[73],{"categories":4072},[109],{"categories":4074},[],{"categories":4076},[73],{"categories":4078},[117],{"categories":4080},[117],{"categories":4082},[73],{"categories":4084},[186],{"categories":4086},[],{"categories":4088},[109],{"categories":4090},[73],{"categories":4092},[73],{"categories":4094},[117],{"categories":4096},[117],{"categories":4098},[],{"categories":4100},[186],{"categories":4102},[186],{"categories":4104},[195],{"categories":4106},[170],{"categories":4108},[],{"categories":4110},[73],{"categories":4112},[117],{"categories":4114},[109],{"categories":4116},[73],{"categories":4118},[186],{"categories":4120},[109],{"categories":4122},[139],{"categories":4124},[139],{"categories":4126},[],{"categories":4128},[139],{"categories":4130},[117],{"categories":4132},[170],{"categories":4134},[173],{"categories":4136},[73],{"categories":4138},[],{"categories":4140},[117],{"categories":4142},[139],{"categories":4144},[186],{"categories":4146},[73],{"categories":4148},[112],{"categories":4150},[73],{"categories":4152},[109],{"categories":4154},[220],{"categories":4156},[109],{"categories":4158},[],{"categories":4160},[],{"categories":4162},[117],{"categories":4164},[139],{"categories":4166},[],{"categories":4168},[117],{"categories":4170},[117],{"categories":4172},[117],{"categories":4174},[],{"categories":4176},[73],{"categories":4178},[],{"categories":4180},[139],{"categories":4182},[109],{"categories":4184},[170],{"categories":4186},[73],{"categories":4188},[139],{"categories":4190},[73],{"categories":4192},[139],{"categories":4194},[],{"categories":4196},[139],{"categories":4198},[109],{"categories":4200},[117],{"categories":4202},[73],{"categories":4204},[],{"categories":4206},[186],{"categories":4208},[117],{"categories":4210},[120],{"categories":4212},[117],{"categories":4214},[109],{"categories":4216},[],{"categories":4218},[],{"categories":4220},[],{"categories":4222},[170],{"categories":4224},[117],{"categories":4226},[73],{"categories":4228},[73],{"categories":4230},[],{"categories":4232},[],{"categories":4234},[],{"categories":4236},[170],{"categories":4238},[],{"categories":4240},[117],{"categories":4242},[73],{"categories":4244},[109],{"categories":4246},[],{"categories":4248},[],{"categories":4250},[170],{"categories":4252},[73],{"categories":4254},[139],{"categories":4256},[],{"categories":4258},[195],{"categories":4260},[139],{"categories":4262},[195],{"categories":4264},[173],{"categories":4266},[73],{"categories":4268},[73],{"categories":4270},[],{"categories":4272},[],{"categories":4274},[117],{"categories":4276},[],{"categories":4278},[73],{"categories":4280},[],{"categories":4282},[117],{"categories":4284},[73],{"categories":4286},[],{"categories":4288},[117],{"categories":4290},[73],{"categories":4292},[139],{"categories":4294},[73],{"categories":4296},[195],{"categories":4298},[112],{"categories":4300},[73],{"categories":4302},[73],{"categories":4304},[173],{"categories":4306},[117],{"categories":4308},[117],{"categories":4310},[],{"categories":4312},[],{"categories":4314},[73],{"categories":4316},[],{"categories":4318},[139],{"categories":4320},[112],{"categories":4322},[],{"categories":4324},[],{"categories":4326},[170],{"categories":4328},[109],{"categories":4330},[],{"categories":4332},[112],{"categories":4334},[195],{"categories":4336},[73],{"categories":4338},[186],{"categories":4340},[109],{"categories":4342},[173],{"categories":4344},[112],{"categories":4346},[186],{"categories":4348},[186],{"categories":4350},[],{"categories":4352},[73],{"categories":4354},[],{"categories":4356},[117],{"categories":4358},[109],{"categories":4360},[170],{"categories":4362},[109],{"categories":4364},[117],{"categories":4366},[220],{"categories":4368},[73],{"categories":4370},[73],{"categories":4372},[109],{"categories":4374},[117],{"categories":4376},[],{"categories":4378},[73],{"categories":4380},[186],{"categories":4382},[139],{"categories":4384},[186],{"categories":4386},[73],{"categories":4388},[],{"categories":4390},[170],{"categories":4392},[139],{"categories":4394},[109],{"categories":4396},[117],{"categories":4398},[73],{"categories":4400},[73],{"categories":4402},[117],{"categories":4404},[73],{"categories":4406},[112],{"categories":4408},[117],{"categories":4410},[117,220],{"categories":4412},[117],{"categories":4414},[186],{"categories":4416},[73],{"categories":4418},[73],{"categories":4420},[173],{"categories":4422},[117],{"categories":4424},[195],{"categories":4426},[117],{"categories":4428},[112],{"categories":4430},[],{"categories":4432},[117],{"categories":4434},[73],{"categories":4436},[112],{"categories":4438},[],{"categories":4440},[],{"categories":4442},[73],{"categories":4444},[117],{"categories":4446},[173],{"categories":4448},[195],{"categories":4450},[73],{"categories":4452},[73],{"categories":4454},[117],{"categories":4456},[],{"categories":4458},[139],{"categories":4460},[],{"categories":4462},[139],{"categories":4464},[186],{"categories":4466},[109],{"categories":4468},[186],{"categories":4470},[73],{"categories":4472},[117],{"categories":4474},[73],{"categories":4476},[73],{"categories":4478},[195],{"categories":4480},[186],{"categories":4482},[],{"categories":4484},[139],{"categories":4486},[73],{"categories":4488},[],{"categories":4490},[73],{"categories":4492},[73],{"categories":4494},[73],{"categories":4496},[117],{"categories":4498},[73],{"categories":4500},[120],{"categories":4502},[117],{"categories":4504},[73],{"categories":4506},[73],{"categories":4508},[73],{"categories":4510},[73],{"categories":4512},[73],{"categories":4514},[112],{"categories":4516},[],{"categories":4518},[120],{"categories":4520},[139],{"categories":4522},[117],{"categories":4524},[73],{"categories":4526},[186],{"categories":4528},[],{"categories":4530},[186],{"categories":4532},[186],{"categories":4534},[117],{"categories":4536},[186],{"categories":4538},[73],{"categories":4540},[73],{"categories":4542},[186],{"categories":4544},[73],{"categories":4546},[117],{"categories":4548},[139],{"categories":4550},[73],{"categories":4552},[73],{"categories":4554},[73],{"categories":4556},[112],{"categories":4558},[73],{"categories":4560},[117],{"categories":4562},[170],{"categories":4564},[],{"categories":4566},[173],{"categories":4568},[117],{"categories":4570},[73],{"categories":4572},[],{"categories":4574},[73],{"categories":4576},[73],{"categories":4578},[139],{"categories":4580},[73],{"categories":4582},[117],{"categories":4584},[195],{"categories":4586},[],{"categories":4588},[],{"categories":4590},[139],{"categories":4592},[139],{"categories":4594},[73],{"categories":4596},[195],{"categories":4598},[73],{"categories":4600},[109],{"categories":4602},[117],{"categories":4604},[73],{"categories":4606},[117],{"categories":4608},[117],{"categories":4610},[73],{"categories":4612},[112],{"categories":4614},[],{"categories":4616},[173],{"categories":4618},[],{"categories":4620},[139],{"categories":4622},[73],{"categories":4624},[173],{"categories":4626},[73],{"categories":4628},[186],{"categories":4630},[186],{"categories":4632},[186],{"categories":4634},[117],{"categories":4636},[117],{"categories":4638},[170],{"categories":4640},[173],{"categories":4642},[173],{"categories":4644},[],{"categories":4646},[139],{"categories":4648},[73],{"categories":4650},[73],{"categories":4652},[186],{"categories":4654},[],{"categories":4656},[139],{"categories":4658},[139],{"categories":4660},[139],{"categories":4662},[],{"categories":4664},[117],{"categories":4666},[73],{"categories":4668},[],{"categories":4670},[109],{"categories":4672},[112],{"categories":4674},[],{"categories":4676},[73],{"categories":4678},[73],{"categories":4680},[],{"categories":4682},[186],{"categories":4684},[],{"categories":4686},[],{"categories":4688},[],{"categories":4690},[],{"categories":4692},[73],{"categories":4694},[139],{"categories":4696},[],{"categories":4698},[],{"categories":4700},[73],{"categories":4702},[73],{"categories":4704},[73],{"categories":4706},[173],{"categories":4708},[73],{"categories":4710},[173],{"categories":4712},[],{"categories":4714},[173],{"categories":4716},[173],{"categories":4718},[220],{"categories":4720},[117],{"categories":4722},[186],{"categories":4724},[],{"categories":4726},[],{"categories":4728},[173],{"categories":4730},[186],{"categories":4732},[186],{"categories":4734},[186],{"categories":4736},[],{"categories":4738},[109],{"categories":4740},[186],{"categories":4742},[186],{"categories":4744},[109],{"categories":4746},[186],{"categories":4748},[112],{"categories":4750},[186],{"categories":4752},[186],{"categories":4754},[186],{"categories":4756},[173],{"categories":4758},[139],{"categories":4760},[139],{"categories":4762},[73],{"categories":4764},[186],{"categories":4766},[173],{"categories":4768},[220],{"categories":4770},[173],{"categories":4772},[173],{"categories":4774},[173],{"categories":4776},[],{"categories":4778},[112],{"categories":4780},[],{"categories":4782},[220],{"categories":4784},[186],{"categories":4786},[186],{"categories":4788},[186],{"categories":4790},[117],{"categories":4792},[139,112],{"categories":4794},[173],{"categories":4796},[],{"categories":4798},[],{"categories":4800},[173],{"categories":4802},[],{"categories":4804},[173],{"categories":4806},[139],{"categories":4808},[117],{"categories":4810},[],{"categories":4812},[186],{"categories":4814},[73],{"categories":4816},[170],{"categories":4818},[],{"categories":4820},[73],{"categories":4822},[],{"categories":4824},[139],{"categories":4826},[109],{"categories":4828},[173],{"categories":4830},[],{"categories":4832},[186],{"categories":4834},[139],[4836,4894,4964,5027],{"id":4837,"title":4838,"ai":4839,"body":4844,"categories":4872,"created_at":74,"date_modified":74,"description":66,"extension":75,"faq":74,"featured":76,"kicker_label":74,"meta":4873,"navigation":89,"path":4884,"published_at":4885,"question":74,"scraped_at":4885,"seo":4886,"sitemap":4887,"source_id":4888,"source_name":95,"source_type":96,"source_url":4878,"stem":4889,"tags":4890,"thumbnail_url":74,"tldr":4891,"tweet":74,"unknown_tags":4892,"__hash__":4893},"summaries\u002Fsummaries\u002F55d35914f986d7ef-predicting-query-level-rejection-risk-in-clinical-summary.md","Predicting Query-Level Rejection Risk in Clinical LLM Systems",{"provider":7,"model":8,"input_tokens":4840,"output_tokens":4841,"processing_time_ms":4842,"cost_usd":4843},4082,489,3092,0.001754,{"type":14,"value":4845,"toc":4867},[4846,4850,4853,4857,4860,4864],[17,4847,4849],{"id":4848},"moving-beyond-static-benchmarks","Moving Beyond Static Benchmarks",[22,4851,4852],{},"Traditional LLM evaluation relies on static datasets that fail to capture the dynamic, high-stakes nature of clinical environments. This research introduces a 'deployment-centered' evaluation framework that shifts focus from aggregate model performance to query-level risk assessment. By predicting the likelihood of a model's response being rejected by human clinicians, developers can implement a safety layer that intercepts potentially harmful or inaccurate outputs before they are delivered.",[17,4854,4856],{"id":4855},"the-rejection-risk-framework","The Rejection Risk Framework",[22,4858,4859],{},"The core of this approach is a secondary classifier trained to predict 'rejection risk'—the probability that a human expert would deem an LLM-generated response unsafe or clinically inappropriate. This model acts as a gatekeeper. By analyzing the input query and the generated response, the system assigns a risk score. If the score exceeds a predefined threshold, the system triggers a fallback mechanism, such as routing the query to a human specialist or providing a standardized safety disclaimer.",[17,4861,4863],{"id":4862},"practical-implementation-and-trade-offs","Practical Implementation and Trade-offs",[22,4865,4866],{},"Implementing this framework requires a careful balance between safety and utility. A conservative threshold for rejection increases safety but risks 'over-rejection,' where helpful responses are unnecessarily blocked, potentially frustrating users and increasing the workload for human reviewers. The authors emphasize that deployment-centered evaluation must be calibrated based on the specific clinical context. For instance, a system assisting with administrative tasks can tolerate higher risk than one providing diagnostic support. This approach moves the industry toward more robust, production-ready AI systems that prioritize patient safety through real-time monitoring rather than relying solely on pre-deployment testing.",{"title":66,"searchDepth":67,"depth":67,"links":4868},[4869,4870,4871],{"id":4848,"depth":67,"text":4849},{"id":4855,"depth":67,"text":4856},{"id":4862,"depth":67,"text":4863},[73],{"content_references":4874,"triage":4880},[4875],{"type":80,"title":4876,"author":4877,"url":4878,"context":4879},"Deployment-Centered Evaluation: Predicting Query-Level Rejection Risk in a Clinical LLM System","Not specified","https:\u002F\u002Farxiv.org\u002Fabs\u002F2606.12702","reviewed",{"relevance":85,"novelty":86,"quality":86,"actionability":4881,"composite":4882,"reasoning":4883},3,4.15,"Category: AI & LLMs. The article presents a novel framework for evaluating LLMs in clinical settings, addressing a specific pain point of ensuring safety in AI outputs. It offers insights into practical implementation, though it lacks detailed step-by-step guidance for direct application.","\u002Fsummaries\u002F55d35914f986d7ef-predicting-query-level-rejection-risk-in-clinical-summary","2026-06-12 12:57:11",{"title":4838,"description":66},{"loc":4884},"55d35914f986d7ef","summaries\u002F55d35914f986d7ef-predicting-query-level-rejection-risk-in-clinical-summary",[99,100,101,102],"A framework for deployment-centered evaluation that identifies high-risk clinical queries, allowing systems to proactively reject unsafe or unreliable LLM outputs before they reach the user.",[],"PHH98tDn-vbNmOtUwGUMqXo6c_BXIddGwgbIshcLNjo",{"id":4895,"title":4896,"ai":4897,"body":4902,"categories":4945,"created_at":74,"date_modified":74,"description":66,"extension":75,"faq":74,"featured":76,"kicker_label":74,"meta":4946,"navigation":89,"path":4954,"published_at":4955,"question":74,"scraped_at":4955,"seo":4956,"sitemap":4957,"source_id":4958,"source_name":95,"source_type":96,"source_url":4950,"stem":4959,"tags":4960,"thumbnail_url":74,"tldr":4961,"tweet":74,"unknown_tags":4962,"__hash__":4963},"summaries\u002Fsummaries\u002Faac6d59c67bef265-generating-realistic-mobility-anomalies-with-llms-summary.md","Generating Realistic Mobility Anomalies with LLMs and Kinematics",{"provider":7,"model":8,"input_tokens":4898,"output_tokens":4899,"processing_time_ms":4900,"cost_usd":4901},4077,546,3641,0.00183825,{"type":14,"value":4903,"toc":4940},[4904,4908,4911,4915,4918,4933,4937],[17,4905,4907],{"id":4906},"bridging-semantic-intent-and-physical-reality","Bridging Semantic Intent and Physical Reality",[22,4909,4910],{},"Traditional anomaly generation methods often struggle to balance the need for complex, intent-driven behavior with the physical limitations of real-world mobility systems. This paper introduces a novel framework that uses Large Language Models (LLMs) to define high-level behavioral anomalies—such as erratic driving patterns or navigation errors—while simultaneously applying a kinematic constraint layer to ensure the resulting trajectories are physically executable.",[17,4912,4914],{"id":4913},"the-two-layer-generation-architecture","The Two-Layer Generation Architecture",[22,4916,4917],{},"The proposed system operates through a dual-process pipeline:",[4919,4920,4921,4927],"ol",{},[39,4922,4923,4926],{},[42,4924,4925],{},"Semantic Layer (LLM):"," The LLM acts as the behavioral engine, generating natural language descriptions or intent-based sequences that define the 'what' and 'why' of the anomaly. This allows for the creation of diverse, non-repetitive, and contextually rich scenarios that simple stochastic noise models cannot replicate.",[39,4928,4929,4932],{},[42,4930,4931],{},"Kinematic Constraint Layer:"," To prevent the LLM from suggesting physically impossible maneuvers (e.g., instantaneous velocity changes or impossible turning radii), a secondary constraint layer processes the LLM's output. This layer maps the high-level intent into valid coordinate-based trajectories that adhere to the specific physics of the mobility platform (e.g., car, drone, or robot).",[17,4934,4936],{"id":4935},"impact-on-anomaly-detection","Impact on Anomaly Detection",[22,4938,4939],{},"By generating synthetic data that is both semantically complex and physically valid, this approach significantly improves the training and evaluation of anomaly detection systems. It allows researchers to stress-test detection models against 'edge-case' behaviors that are rare in real-world datasets but critical for safety-critical systems. The framework effectively reduces the 'reality gap' often found in synthetic mobility data, providing a more robust foundation for training autonomous agents to recognize and respond to unexpected environmental or behavioral deviations.",{"title":66,"searchDepth":67,"depth":67,"links":4941},[4942,4943,4944],{"id":4906,"depth":67,"text":4907},{"id":4913,"depth":67,"text":4914},{"id":4935,"depth":67,"text":4936},[73],{"content_references":4947,"triage":4951},[4948],{"type":80,"title":4949,"url":4950,"context":83},"Mobility Anomaly Generation using LLM-Driven Behavior with Kinematic Constraints","https:\u002F\u002Farxiv.org\u002Fabs\u002F2606.10314",{"relevance":4881,"novelty":86,"quality":86,"actionability":67,"composite":4952,"reasoning":4953},3.25,"Category: AI & LLMs. The article discusses a novel framework for generating mobility anomalies using LLMs, which aligns with the audience's interest in AI engineering. However, it lacks direct actionable insights or practical applications for product builders, focusing more on theoretical advancements in anomaly generation.","\u002Fsummaries\u002Faac6d59c67bef265-generating-realistic-mobility-anomalies-with-llms-summary","2026-06-10 12:57:08",{"title":4896,"description":66},{"loc":4954},"aac6d59c67bef265","summaries\u002Faac6d59c67bef265-generating-realistic-mobility-anomalies-with-llms-summary",[99,102,100,101],"This research proposes a framework for generating realistic mobility anomalies by combining the semantic reasoning capabilities of LLMs with strict physical kinematic constraints, ensuring generated data is both complex and physically plausible.",[],"Ja3vqB6aQTiMuSO6RJdXHiyTEpi0dI-0kHxa6rMe18Q",{"id":4965,"title":4966,"ai":4967,"body":4972,"categories":5009,"created_at":74,"date_modified":74,"description":66,"extension":75,"faq":74,"featured":76,"kicker_label":74,"meta":5010,"navigation":89,"path":5017,"published_at":5018,"question":74,"scraped_at":5018,"seo":5019,"sitemap":5020,"source_id":5021,"source_name":95,"source_type":96,"source_url":5014,"stem":5022,"tags":5023,"thumbnail_url":74,"tldr":5024,"tweet":74,"unknown_tags":5025,"__hash__":5026},"summaries\u002Fsummaries\u002F205204db989ecb3c-the-failure-of-llm-judges-in-context-dependent-saf-summary.md","The Failure of LLM-Judges in Context-Dependent Safety Evaluation",{"provider":7,"model":8,"input_tokens":4968,"output_tokens":4969,"processing_time_ms":4970,"cost_usd":4971},4090,516,3367,0.0017965,{"type":14,"value":4973,"toc":5005},[4974,4978,4981,4985,4988,5002],[17,4975,4977],{"id":4976},"the-mismatch-between-universal-evaluators-and-contextual-safety","The Mismatch Between Universal Evaluators and Contextual Safety",[22,4979,4980],{},"Modern safety evaluation often relies on \"LLM-judges\"—using a stronger model to grade the outputs of a target model. However, this research highlights a fundamental flaw: safety is inherently contextual, while LLM-judges are trained on broad, generalized datasets that impose rigid, universal priors. When an evaluator is asked to judge safety, it defaults to these baked-in biases rather than adapting to the specific domain, user intent, or situational constraints of the prompt. This creates a \"prior-drift\" where the judge penalizes safe, contextually appropriate behavior because it deviates from the judge's static definition of safety.",[17,4982,4984],{"id":4983},"the-risks-of-rigid-evaluation-priors","The Risks of Rigid Evaluation Priors",[22,4986,4987],{},"Because LLM-judges lack the ability to dynamically adjust their safety thresholds, they frequently exhibit two failure modes:",[4919,4989,4990,4996],{},[39,4991,4992,4995],{},[42,4993,4994],{},"Over-refusal (False Positives):"," The judge flags benign content as unsafe because the content touches on sensitive topics (e.g., medical, legal, or creative writing) that the judge has been conditioned to treat as high-risk, regardless of the actual safety of the response.",[39,4997,4998,5001],{},[42,4999,5000],{},"Under-detection (False Negatives):"," In highly specialized domains, the judge may fail to recognize subtle, context-specific harms because its training data lacks the depth required to understand the nuances of that specific field.",[22,5003,5004],{},"This rigidity makes LLM-judges unreliable for production systems where safety requirements vary significantly by user persona and application. Relying on these judges as a \"ground truth\" creates a feedback loop that reinforces the model's existing biases rather than improving its ability to handle complex, real-world safety scenarios.",{"title":66,"searchDepth":67,"depth":67,"links":5006},[5007,5008],{"id":4976,"depth":67,"text":4977},{"id":4983,"depth":67,"text":4984},[73],{"content_references":5011,"triage":5015},[5012],{"type":80,"title":5013,"url":5014,"context":83},"Safety is Contextual, LLM-Judges Are Not: Navigating the Rigid Priors of Evaluators","https:\u002F\u002Farxiv.org\u002Fabs\u002F2606.07874",{"relevance":4881,"novelty":86,"quality":86,"actionability":67,"composite":4952,"reasoning":5016},"Category: AI & LLMs. The article discusses the limitations of LLM-judges in safety evaluations, which is relevant to AI engineering and the practical implications of using AI tools in production. While it offers new insights into the challenges of context-dependent evaluations, it lacks specific actionable steps for product builders to address these issues.","\u002Fsummaries\u002F205204db989ecb3c-the-failure-of-llm-judges-in-context-dependent-saf-summary","2026-06-09 12:58:19",{"title":4966,"description":66},{"loc":5017},"205204db989ecb3c","summaries\u002F205204db989ecb3c-the-failure-of-llm-judges-in-context-dependent-saf-summary",[99,100,101,102],"LLM-judges suffer from rigid, universal priors that fail to account for the nuance of context, leading to unreliable safety assessments in specialized or edge-case scenarios.",[],"rO-1bw0v6cUxIV_w8FT9QjjylDxmzB5LBV8t_Ktd29I",{"id":5028,"title":5029,"ai":5030,"body":5035,"categories":5063,"created_at":74,"date_modified":74,"description":66,"extension":75,"faq":74,"featured":76,"kicker_label":74,"meta":5064,"navigation":89,"path":5074,"published_at":5075,"question":74,"scraped_at":5075,"seo":5076,"sitemap":5077,"source_id":5078,"source_name":95,"source_type":96,"source_url":5079,"stem":5080,"tags":5081,"thumbnail_url":74,"tldr":5082,"tweet":74,"unknown_tags":5083,"__hash__":5084},"summaries\u002Fsummaries\u002F4497601ed03ef24f-omnimem-efficient-memory-compression-for-streaming-summary.md","OmniMem: Efficient Memory Compression for Streaming Audio-Visual LLMs",{"provider":7,"model":8,"input_tokens":5031,"output_tokens":5032,"processing_time_ms":5033,"cost_usd":5034},4133,471,2913,0.00173975,{"type":14,"value":5036,"toc":5058},[5037,5041,5044,5048,5051,5055],[17,5038,5040],{"id":5039},"the-challenge-of-streaming-audio-visual-memory","The Challenge of Streaming Audio-Visual Memory",[22,5042,5043],{},"Streaming audio-visual Large Language Models (LLMs) face a significant bottleneck: the massive computational and memory overhead required to process continuous, high-dimensional input streams. As these models process longer sequences, the memory footprint grows linearly, often leading to latency issues or the need to discard historical context. Traditional compression methods often struggle to maintain the fidelity of these inputs, leading to information loss that degrades model performance over time.",[17,5045,5047],{"id":5046},"perturbation-aware-compression","Perturbation-Aware Compression",[22,5049,5050],{},"OmniMem addresses this by implementing a perturbation-aware memory compression strategy. Instead of standard lossy compression, which may treat all input data as equally important, this approach explicitly accounts for the sensitivity of the model to input noise. By training the compression mechanism to be aware of how perturbations in the latent space affect downstream performance, the model can more effectively prune redundant information while preserving critical features necessary for accurate audio-visual reasoning.",[17,5052,5054],{"id":5053},"performance-and-implementation","Performance and Implementation",[22,5056,5057],{},"This technique allows for significantly reduced memory usage in streaming environments, enabling models to maintain longer context windows without the typical performance degradation associated with aggressive compression. The implementation, integrated with the SALMONN framework, demonstrates that it is possible to achieve a balance between computational efficiency and model accuracy in complex multimodal tasks. This is particularly relevant for real-time applications where the model must maintain a coherent understanding of long-duration audio and visual events.",{"title":66,"searchDepth":67,"depth":67,"links":5059},[5060,5061,5062],{"id":5039,"depth":67,"text":5040},{"id":5046,"depth":67,"text":5047},{"id":5053,"depth":67,"text":5054},[73],{"content_references":5065,"triage":5071},[5066],{"type":5067,"title":5068,"url":5069,"context":5070},"tool","SALMONN","https:\u002F\u002Fgithub.com\u002Fbytedance\u002FSALMONN\u002Ftree\u002Fomni_mem","recommended",{"relevance":86,"novelty":86,"quality":86,"actionability":4881,"composite":5072,"reasoning":5073},3.8,"Category: AI & LLMs. The article discusses a novel memory compression technique for streaming audio-visual LLMs, addressing a specific pain point of memory efficiency in AI applications. It provides insights into a new approach that could be applicable in production settings, though it lacks detailed implementation steps for immediate action.","\u002Fsummaries\u002F4497601ed03ef24f-omnimem-efficient-memory-compression-for-streaming-summary","2026-06-09 12:58:15",{"title":5029,"description":66},{"loc":5074},"4497601ed03ef24f","https:\u002F\u002Farxiv.org\u002Fabs\u002F2606.07577","summaries\u002F4497601ed03ef24f-omnimem-efficient-memory-compression-for-streaming-summary",[99,100,102,101],"OmniMem introduces a perturbation-aware compression technique to maintain long-term memory efficiency in streaming audio-visual LLMs without sacrificing performance.",[],"nTBsF-KC9w4XSWVI8Blq7QotqFVO07Z71HD661WCEnQ"]