[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"summary-89df0446e415c993-diffusiongemma-parallel-text-generation-via-diffus-summary":3,"summaries-facets-categories":110,"summary-related-89df0446e415c993-diffusiongemma-parallel-text-generation-via-diffus-summary":4687},{"id":4,"title":5,"ai":6,"body":13,"categories":75,"created_at":77,"date_modified":77,"description":69,"extension":78,"faq":77,"featured":79,"kicker_label":77,"meta":80,"navigation":92,"path":93,"published_at":94,"question":77,"scraped_at":94,"seo":95,"sitemap":96,"source_id":97,"source_name":98,"source_type":99,"source_url":100,"stem":101,"tags":102,"thumbnail_url":77,"tldr":107,"tweet":77,"unknown_tags":108,"__hash__":109},"summaries\u002Fsummaries\u002F89df0446e415c993-diffusiongemma-parallel-text-generation-via-diffus-summary.md","DiffusionGemma: Parallel Text Generation via Diffusion",{"provider":7,"model":8,"input_tokens":9,"output_tokens":10,"processing_time_ms":11,"cost_usd":12},"openrouter","google\u002Fgemini-3.1-flash-lite",9607,615,4079,0.001500625,{"type":14,"value":15,"toc":68},"minimark",[16,21,25,29,32,61,65],[17,18,20],"h2",{"id":19},"parallel-decoding-via-text-diffusion","Parallel Decoding via Text Diffusion",[22,23,24],"p",{},"DiffusionGemma departs from the standard autoregressive paradigm—where tokens are generated sequentially, one at a time—by utilizing text diffusion. Inspired by image generation models, it begins with a canvas of random placeholder tokens and iteratively refines them in parallel. This approach allows the model to finalize approximately 15–20 tokens per forward pass, significantly increasing throughput on dedicated GPUs.",[17,26,28],{"id":27},"architecture-and-performance","Architecture and Performance",[22,30,31],{},"Built on the Gemma 4 26B-A4B backbone, the model is a Mixture of Experts (MoE) architecture that activates only 3.8B parameters during inference. Key technical features include:",[33,34,35,43,49,55],"ul",{},[36,37,38,42],"li",{},[39,40,41],"strong",{},"Bidirectional Attention:"," Unlike autoregressive models restricted to causal (backward-looking) attention, DiffusionGemma uses bidirectional attention during denoising, allowing tokens to attend to the entire sequence.",[36,44,45,48],{},[39,46,47],{},"Self-Correction:"," The model can re-noise and refine low-confidence tokens during the denoising process, a capability impossible in standard autoregressive decoding where tokens are committed once generated.",[36,50,51,54],{},[39,52,53],{},"Hardware Utilization:"," By shifting the bottleneck from memory bandwidth to compute, the model achieves 1000+ tokens per second on an NVIDIA H100 and 700+ tokens per second on an NVIDIA GeForce RTX 5090.",[36,56,57,60],{},[39,58,59],{},"Hybrid Inference:"," For longer sequences, it employs 'Block Autoregressive Diffusion,' where 256-token blocks are denoised in parallel and then committed to the KV cache before starting a new canvas.",[17,62,64],{"id":63},"trade-offs-and-use-cases","Trade-offs and Use Cases",[22,66,67],{},"Google explicitly positions DiffusionGemma for local, low-latency, single-user workloads like in-line editing and rapid iteration. It is not intended to replace standard autoregressive models for high-quality production tasks, as its overall output quality is lower. Furthermore, the speed advantages diminish in high-concurrency cloud environments where autoregressive models already saturate compute resources efficiently. When quantized, the model fits within 18GB of VRAM, making it accessible for high-end consumer hardware.",{"title":69,"searchDepth":70,"depth":70,"links":71},"",2,[72,73,74],{"id":19,"depth":70,"text":20},{"id":27,"depth":70,"text":28},{"id":63,"depth":70,"text":64},[76],"AI & LLMs",null,"md",false,{"content_references":81,"triage":87},[82],{"type":83,"title":84,"url":85,"context":86},"tool","DiffusionGemma 26B-A4B-it","https:\u002F\u002Fhuggingface.co\u002Fgoogle\u002Fdiffusiongemma-26B-A4B-it","mentioned",{"relevance":88,"novelty":89,"quality":88,"actionability":89,"composite":90,"reasoning":91},4,3,3.6,"Category: AI & LLMs. The article discusses a new model, DiffusionGemma, which offers a novel approach to text generation, addressing a specific audience pain point regarding performance and efficiency in AI workflows. It provides technical insights and potential use cases, but lacks detailed actionable steps for implementation.",true,"\u002Fsummaries\u002F89df0446e415c993-diffusiongemma-parallel-text-generation-via-diffus-summary","2026-06-11 12:57:14",{"title":5,"description":69},{"loc":93},"89df0446e415c993","MarkTechPost","article","https:\u002F\u002Fwww.marktechpost.com\u002F2026\u002F06\u002F10\u002Fgoogle-ai-releases-diffusiongemma-a-26b-moe-open-model-using-text-diffusion-for-up-to-4x-faster-generation\u002F","summaries\u002F89df0446e415c993-diffusiongemma-parallel-text-generation-via-diffus-summary",[103,104,105,106],"llm","ai-tools","machine-learning","python","Google's DiffusionGemma is a 26B MoE model that uses text diffusion instead of autoregressive decoding, enabling up to 4x faster generation for local, interactive workflows.",[],"OL0OihGMYCueQkJpZPFWtH3pz-h8zXIoCVFe0j46zGI",[111,114,117,119,122,125,127,129,131,133,135,137,140,142,144,146,148,150,152,154,156,158,160,162,164,166,169,172,174,176,178,180,183,185,187,189,192,194,196,198,200,202,204,206,208,210,212,214,217,219,221,223,225,227,229,231,233,235,237,239,241,243,245,247,249,251,253,255,257,259,261,263,265,267,269,271,273,275,277,279,281,283,285,287,289,291,293,295,297,299,301,303,305,307,309,311,313,315,317,319,321,323,325,327,329,331,333,335,337,339,341,343,345,347,349,351,353,355,357,359,361,363,365,367,369,371,373,375,377,379,381,383,385,387,389,391,393,395,397,399,401,403,405,407,409,411,413,415,417,419,421,423,425,427,429,431,433,435,437,439,441,443,445,447,449,451,453,455,457,459,461,463,465,467,469,471,473,475,477,479,481,483,485,487,489,491,493,495,497,499,501,503,505,507,509,511,513,515,517,519,521,523,525,527,529,531,533,535,537,539,541,543,545,547,549,551,553,555,557,559,561,563,565,567,569,571,573,575,577,579,581,583,585,587,589,591,593,595,597,599,601,603,605,607,609,611,613,615,617,619,621,623,625,627,629,631,633,635,637,639,641,643,645,647,649,651,653,655,657,659,661,663,665,667,669,671,673,675,677,679,681,683,685,687,689,691,693,695,697,699,701,703,705,707,709,711,713,715,717,719,721,723,725,727,729,731,733,735,737,739,741,743,745,747,749,751,753,755,757,759,761,763,765,767,769,771,773,775,777,779,781,783,785,787,789,791,793,795,797,799,801,803,805,807,809,811,813,815,817,819,821,823,825,827,829,831,833,835,837,839,841,843,845,847,849,851,853,855,857,859,861,863,865,867,869,871,873,875,877,879,881,883,885,887,889,891,893,895,897,899,901,903,905,907,909,911,913,915,917,919,921,923,925,927,929,931,933,935,937,939,941,943,945,947,949,951,953,955,957,959,961,963,965,967,969,971,973,975,977,979,981,983,985,987,989,991,993,995,997,999,1001,1003,1005,1007,1009,1011,1013,1015,1017,1019,1021,1023,1025,1027,1029,1031,1033,1035,1037,1039,1041,1043,1045,1047,1049,1051,1053,1055,1057,1059,1061,1063,1065,1067,1069,1071,1073,1075,1077,1079,1081,1083,1085,1087,1089,1091,1093,1095,1097,1099,1101,1103,1105,1107,1109,1111,1113,1115,1117,1119,1121,1123,1125,1127,1129,1131,1133,1135,1137,1139,1141,1143,1145,1147,1149,1151,1153,1155,1157,1159,1161,1163,1165,1167,1169,1171,1173,1175,1177,1179,1181,1183,1185,1187,1189,1191,1193,1195,1197,1199,1201,1203,1205,1207,1209,1211,1213,1215,1217,1219,1221,1223,1225,1227,1229,1231,1233,1235,1237,1239,1241,1243,1245,1247,1249,1251,1253,1255,1257,1259,1261,1263,1265,1267,1269,1271,1273,1275,1277,1279,1281,1283,1285,1287,1289,1291,1293,1295,1297,1299,1301,1303,1305,1307,1309,1311,1313,1315,1317,1319,1321,1323,1325,1327,1329,1331,1333,1335,1337,1339,1341,1343,1345,1347,1349,1351,1353,1355,1357,1359,1361,1363,1365,1367,1369,1371,1373,1375,1377,1379,1381,1383,1385,1387,1389,1391,1393,1395,1397,1399,1401,1403,1405,1407,1409,1411,1413,1415,1417,1419,1421,1423,1425,1427,1429,1431,1433,1435,1437,1439,1441,1443,1445,1447,1449,1451,1453,1455,1457,1459,1461,1463,1465,1467,1469,1471,1473,1475,1477,1479,1481,1483,1485,1487,1489,1491,1493,1495,1497,1499,1501,1503,1505,1507,1509,1511,1513,1515,1517,1519,1521,1523,1525,1527,1529,1531,1533,1535,1537,1539,1541,1543,1545,1547,1549,1551,1553,1555,1557,1559,1561,1563,1565,1567,1569,1571,1573,1575,1577,1579,1581,1583,1585,1587,1589,1591,1593,1595,1597,1599,1601,1603,1605,1607,1609,1611,1613,1615,1617,1619,1621,1623,1625,1627,1629,1631,1633,1635,1637,1639,1641,1643,1645,1647,1649,1651,1653,1655,1657,1659,1661,1663,1665,1667,1669,1671,1673,1675,1677,1679,1681,1683,1685,1687,1689,1691,1693,1695,1697,1699,1701,1703,1705,1707,1709,1711,1713,1715,1717,1719,1721,1723,1725,1727,1729,1731,1733,1735,1737,1739,1741,1743,1745,1747,1749,1751,1753,1755,1757,1759,1761,1763,1765,1767,1769,1771,1773,1775,1777,1779,1781,1783,1785,1787,1789,1791,1793,1795,1797,1799,1801,1803,1805,1807,1809,1811,1813,1815,1817,1819,1821,1823,1825,1827,1829,1831,1833,1835,1837,1839,1841,1843,1845,1847,1849,1851,1853,1855,1857,1859,1861,1863,1865,1867,1869,1871,1873,1875,1877,1879,1881,1883,1885,1887,1889,1891,1893,1895,1897,1899,1901,1903,1905,1907,1909,1911,1913,1915,1917,1919,1921,1923,1925,1927,1929,1931,1933,1935,1937,1939,1941,1943,1945,1947,1949,1951,1953,1955,1957,1959,1961,1963,1965,1967,1969,1971,1973,1975,1977,1979,1981,1983,1985,1987,1989,1991,1993,1995,1997,1999,2001,2003,2005,2007,2009,2011,2013,2015,2017,2019,2021,2023,2025,2027,2029,2031,2033,2035,2037,2039,2041,2043,2045,2047,2049,2051,2053,2055,2057,2059,2061,2063,2065,2067,2069,2071,2073,2075,2077,2079,2081,2083,2085,2087,2089,2091,2093,2095,2097,2099,2101,2103,2105,2107,2109,2111,2113,2115,2117,2119,2121,2123,2125,2127,2129,2131,2133,2135,2137,2139,2141,2143,2145,2147,2149,2151,2153,2155,2157,2159,2161,2163,2165,2167,2169,2171,2173,2175,2177,2179,2181,2183,2185,2187,2189,2191,2193,2195,2197,2199,2201,2203,2205,2207,2209,2211,2213,2215,2217,2219,2221,2223,2225,2227,2229,2231,2233,2235,2237,2239,2241,2243,2245,2247,2249,2251,2253,2255,2257,2259,2261,2263,2265,2267,2269,2271,2273,2275,2277,2279,2281,2283,2285,2287,2289,2291,2293,2295,2297,2299,2301,2303,2305,2307,2309,2311,2313,2315,2317,2319,2321,2323,2325,2327,2329,2331,2333,2335,2337,2339,2341,2343,2345,2347,2349,2351,2353,2355,2357,2359,2361,2363,2365,2367,2369,2371,2373,2375,2377,2379,2381,2383,2385,2387,2389,2391,2393,2395,2397,2399,2401,2403,2405,2407,2409,2411,2413,2415,2417,2419,2421,2423,2425,2427,2429,2431,2433,2435,2437,2439,2441,2443,2445,2447,2449,2451,2453,2455,2457,2459,2461,2463,2465,2467,2469,2471,2473,2475,2477,2479,2481,2483,2485,2487,2489,2491,2493,2495,2497,2499,2501,2503,2505,2507,2509,2511,2513,2515,2517,2519,2521,2523,2525,2527,2529,2531,2533,2535,2537,2539,2541,2543,2545,2547,2549,2551,2553,2555,2557,2559,2561,2563,2565,2567,2569,2571,2573,2575,2577,2579,2581,2583,2585,2587,2589,2591,2593,2595,2597,2599,2601,2603,2605,2607,2609,2611,2613,2615,2617,2619,2621,2623,2625,2627,2629,2631,2633,2635,2637,2639,2641,2643,2645,2647,2649,2651,2653,2655,2657,2659,2661,2663,2665,2667,2669,2671,2673,2675,2677,2679,2681,2683,2685,2687,2689,2691,2693,2695,2697,2699,2701,2703,2705,2707,2709,2711,2713,2715,2717,2719,2721,2723,2725,2727,2729,2731,2733,2735,2737,2739,2741,2743,2745,2747,2749,2751,2753,2755,2757,2759,2761,2763,2765,2767,2769,2771,2773,2775,2777,2779,2781,2783,2785,2787,2789,2791,2793,2795,2797,2799,2801,2803,2805,2807,2809,2811,2813,2815,2817,2819,2821,2823,2825,2827,2829,2831,2833,2835,2837,2839,2841,2843,2845,2847,2849,2851,2853,2855,2857,2859,2861,2863,2865,2867,2869,2871,2873,2875,2877,2879,2881,2883,2885,2887,2889,2891,2893,2895,2897,2899,2901,2903,2905,2907,2909,2911,2913,2915,2917,2919,2921,2923,2925,2927,2929,2931,2933,2935,2937,2939,2941,2943,2945,2947,2949,2951,2953,2955,2957,2959,2961,2963,2965,2967,2969,2971,2973,2975,2977,2979,2981,2983,2985,2987,2989,2991,2993,2995,2997,2999,3001,3003,3005,3007,3009,3011,3013,3015,3017,3019,3021,3023,3025,3027,3029,3031,3033,3035,3037,3039,3041,3043,3045,3047,3049,3051,3053,3055,3057,3059,3061,3063,3065,3067,3069,3071,3073,3075,3077,3079,3081,3083,3085,3087,3089,3091,3093,3095,3097,3099,3101,3103,3105,3107,3109,3111,3113,3115,3117,3119,3121,3123,3125,3127,3129,3131,3133,3135,3137,3139,3141,3143,3145,3147,3149,3151,3153,3155,3157,3159,3161,3163,3165,3167,3169,3171,3173,3175,3177,3179,3181,3183,3185,3187,3189,3191,3193,3195,3197,3199,3201,3203,3205,3207,3209,3211,3213,3215,3217,3219,3221,3223,3225,3227,3229,3231,3233,3235,3237,3239,3241,3243,3245,3247,3249,3251,3253,3255,3257,3259,3261,3263,3265,3267,3269,3271,3273,3275,3277,3279,3281,3283,3285,3287,3289,3291,3293,3295,3297,3299,3301,3303,3305,3307,3309,3311,3313,3315,3317,3319,3321,3323,3325,3327,3329,3331,3333,3335,3337,3339,3341,3343,3345,3347,3349,3351,3353,3355,3357,3359,3361,3363,3365,3367,3369,3371,3373,3375,3377,3379,3381,3383,3385,3387,3389,3391,3393,3395,3397,3399,3401,3403,3405,3407,3409,3411,3413,3415,3417,3419,3421,3423,3425,3427,3429,3431,3433,3435,3437,3439,3441,3443,3445,3447,3449,3451,3453,3455,3457,3459,3461,3463,3465,3467,3469,3471,3473,3475,3477,3479,3481,3483,3485,3487,3489,3491,3493,3495,3497,3499,3501,3503,3505,3507,3509,3511,3513,3515,3517,3519,3521,3523,3525,3527,3529,3531,3533,3535,3537,3539,3541,3543,3545,3547,3549,3551,3553,3555,3557,3559,3561,3563,3565,3567,3569,3571,3573,3575,3577,3579,3581,3583,3585,3587,3589,3591,3593,3595,3597,3599,3601,3603,3605,3607,3609,3611,3613,3615,3617,3619,3621,3623,3625,3627,3629,3631,3633,3635,3637,3639,3641,3643,3645,3647,3649,3651,3653,3655,3657,3659,3661,3663,3665,3667,3669,3671,3673,3675,3677,3679,3681,3683,3685,3687,3689,3691,3693,3695,3697,3699,3701,3703,3705,3707,3709,3711,3713,3715,3717,3719,3721,3723,3725,3727,3729,3731,3733,3735,3737,3739,3741,3743,3745,3747,3749,3751,3753,3755,3757,3759,3761,3763,3765,3767,3769,3771,3773,3775,3777,3779,3781,3783,3785,3787,3789,3791,3793,3795,3797,3799,3801,3803,3805,3807,3809,3811,3813,3815,3817,3819,3821,3823,3825,3827,3829,3831,3833,3835,3837,3839,3841,3843,3845,3847,3849,3851,3853,3855,3857,3859,3861,3863,3865,3867,3869,3871,3873,3875,3877,3879,3881,3883,3885,3887,3889,3891,3893,3895,3897,3899,3901,3903,3905,3907,3909,3911,3913,3915,3917,3919,3921,3923,3925,3927,3929,3931,3933,3935,3937,3939,3941,3943,3945,3947,3949,3951,3953,3955,3957,3959,3961,3963,3965,3967,3969,3971,3973,3975,3977,3979,3981,3983,3985,3987,3989,3991,3993,3995,3997,3999,4001,4003,4005,4007,4009,4011,4013,4015,4017,4019,4021,4023,4025,4027,4029,4031,4033,4035,4037,4039,4041,4043,4045,4047,4049,4051,4053,4055,4057,4059,4061,4063,4065,4067,4069,4071,4073,4075,4077,4079,4081,4083,4085,4087,4089,4091,4093,4095,4097,4099,4101,4103,4105,4107,4109,4111,4113,4115,4117,4119,4121,4123,4125,4127,4129,4131,4133,4135,4137,4139,4141,4143,4145,4147,4149,4151,4153,4155,4157,4159,4161,4163,4165,4167,4169,4171,4173,4175,4177,4179,4181,4183,4185,4187,4189,4191,4193,4195,4197,4199,4201,4203,4205,4207,4209,4211,4213,4215,4217,4219,4221,4223,4225,4227,4229,4231,4233,4235,4237,4239,4241,4243,4245,4247,4249,4251,4253,4255,4257,4259,4261,4263,4265,4267,4269,4271,4273,4275,4277,4279,4281,4283,4285,4287,4289,4291,4293,4295,4297,4299,4301,4303,4305,4307,4309,4311,4313,4315,4317,4319,4321,4323,4325,4327,4329,4331,4333,4335,4337,4339,4341,4343,4345,4347,4349,4351,4353,4355,4357,4359,4361,4363,4365,4367,4369,4371,4373,4375,4377,4379,4381,4383,4385,4387,4389,4391,4393,4395,4397,4399,4401,4403,4405,4407,4409,4411,4413,4415,4417,4419,4421,4423,4425,4427,4429,4431,4433,4435,4437,4439,4441,4443,4445,4447,4449,4451,4453,4455,4457,4459,4461,4463,4465,4467,4469,4471,4473,4475,4477,4479,4481,4483,4485,4487,4489,4491,4493,4495,4497,4499,4501,4503,4505,4507,4509,4511,4513,4515,4517,4519,4521,4523,4525,4527,4529,4531,4533,4535,4537,4539,4541,4543,4545,4547,4549,4551,4553,4555,4557,4559,4561,4563,4565,4567,4569,4571,4573,4575,4577,4579,4581,4583,4585,4587,4589,4591,4593,4595,4597,4599,4601,4603,4605,4607,4609,4611,4613,4615,4617,4619,4621,4623,4625,4627,4629,4631,4633,4635,4637,4639,4641,4643,4645,4647,4649,4651,4653,4655,4657,4659,4661,4663,4665,4667,4669,4671,4673,4675,4677,4679,4681,4683,4685],{"categories":112},[113],"Developer Productivity",{"categories":115},[116],"Business & SaaS",{"categories":118},[76],{"categories":120},[121],"AI Automation",{"categories":123},[124],"Product Strategy",{"categories":126},[76],{"categories":128},[113],{"categories":130},[116],{"categories":132},[],{"categories":134},[76],{"categories":136},[],{"categories":138},[139],"AI News & Trends",{"categories":141},[121],{"categories":143},[121],{"categories":145},[139],{"categories":147},[121],{"categories":149},[121],{"categories":151},[121],{"categories":153},[76],{"categories":155},[76],{"categories":157},[76],{"categories":159},[139],{"categories":161},[76],{"categories":163},[76],{"categories":165},[],{"categories":167},[168],"Design & Frontend",{"categories":170},[171],"Data Science & Visualization",{"categories":173},[139],{"categories":175},[76],{"categories":177},[],{"categories":179},[76],{"categories":181},[182],"Software Engineering",{"categories":184},[76],{"categories":186},[121],{"categories":188},[76],{"categories":190},[191],"Marketing & Growth",{"categories":193},[168],{"categories":195},[76],{"categories":197},[121],{"categories":199},[],{"categories":201},[],{"categories":203},[168],{"categories":205},[121],{"categories":207},[113],{"categories":209},[182],{"categories":211},[168],{"categories":213},[76],{"categories":215},[216],"DevOps & Cloud",{"categories":218},[121],{"categories":220},[139],{"categories":222},[76],{"categories":224},[],{"categories":226},[],{"categories":228},[121],{"categories":230},[182],{"categories":232},[],{"categories":234},[116],{"categories":236},[],{"categories":238},[],{"categories":240},[76],{"categories":242},[121],{"categories":244},[76],{"categories":246},[76],{"categories":248},[121],{"categories":250},[76],{"categories":252},[76],{"categories":254},[76],{"categories":256},[],{"categories":258},[182],{"categories":260},[],{"categories":262},[],{"categories":264},[182],{"categories":266},[],{"categories":268},[182],{"categories":270},[76],{"categories":272},[76],{"categories":274},[191],{"categories":276},[168],{"categories":278},[168],{"categories":280},[76],{"categories":282},[182],{"categories":284},[121],{"categories":286},[182],{"categories":288},[76],{"categories":290},[76],{"categories":292},[121],{"categories":294},[121],{"categories":296},[171],{"categories":298},[139],{"categories":300},[121],{"categories":302},[121],{"categories":304},[191],{"categories":306},[121],{"categories":308},[124],{"categories":310},[182],{"categories":312},[],{"categories":314},[121],{"categories":316},[],{"categories":318},[121],{"categories":320},[182],{"categories":322},[216],{"categories":324},[168],{"categories":326},[76],{"categories":328},[],{"categories":330},[182],{"categories":332},[76],{"categories":334},[],{"categories":336},[121],{"categories":338},[],{"categories":340},[76],{"categories":342},[],{"categories":344},[113],{"categories":346},[182],{"categories":348},[116],{"categories":350},[76],{"categories":352},[76],{"categories":354},[139],{"categories":356},[76],{"categories":358},[],{"categories":360},[76],{"categories":362},[],{"categories":364},[182],{"categories":366},[171],{"categories":368},[],{"categories":370},[76],{"categories":372},[168],{"categories":374},[],{"categories":376},[168],{"categories":378},[121],{"categories":380},[],{"categories":382},[76],{"categories":384},[76],{"categories":386},[121],{"categories":388},[139],{"categories":390},[116],{"categories":392},[76],{"categories":394},[],{"categories":396},[182],{"categories":398},[121],{"categories":400},[76],{"categories":402},[124],{"categories":404},[],{"categories":406},[76],{"categories":408},[124],{"categories":410},[121],{"categories":412},[76],{"categories":414},[121],{"categories":416},[],{"categories":418},[171],{"categories":420},[76],{"categories":422},[],{"categories":424},[113],{"categories":426},[76],{"categories":428},[116],{"categories":430},[76],{"categories":432},[121],{"categories":434},[76],{"categories":436},[76],{"categories":438},[182],{"categories":440},[76],{"categories":442},[],{"categories":444},[],{"categories":446},[76],{"categories":448},[76],{"categories":450},[],{"categories":452},[168],{"categories":454},[],{"categories":456},[76],{"categories":458},[],{"categories":460},[121],{"categories":462},[76],{"categories":464},[168],{"categories":466},[],{"categories":468},[76],{"categories":470},[76],{"categories":472},[116],{"categories":474},[121],{"categories":476},[76],{"categories":478},[76],{"categories":480},[168],{"categories":482},[121],{"categories":484},[],{"categories":486},[121],{"categories":488},[],{"categories":490},[139],{"categories":492},[],{"categories":494},[76],{"categories":496},[116,191],{"categories":498},[],{"categories":500},[76],{"categories":502},[121],{"categories":504},[],{"categories":506},[],{"categories":508},[168],{"categories":510},[76],{"categories":512},[],{"categories":514},[76],{"categories":516},[216],{"categories":518},[],{"categories":520},[139],{"categories":522},[168],{"categories":524},[],{"categories":526},[139],{"categories":528},[76],{"categories":530},[121],{"categories":532},[139],{"categories":534},[76],{"categories":536},[191],{"categories":538},[],{"categories":540},[116],{"categories":542},[182],{"categories":544},[76],{"categories":546},[121],{"categories":548},[],{"categories":550},[76,216],{"categories":552},[76],{"categories":554},[76],{"categories":556},[76],{"categories":558},[121],{"categories":560},[76,182],{"categories":562},[171],{"categories":564},[76],{"categories":566},[182],{"categories":568},[191],{"categories":570},[121],{"categories":572},[76],{"categories":574},[121],{"categories":576},[],{"categories":578},[121],{"categories":580},[76],{"categories":582},[76,116],{"categories":584},[116],{"categories":586},[],{"categories":588},[168],{"categories":590},[168],{"categories":592},[],{"categories":594},[],{"categories":596},[139],{"categories":598},[],{"categories":600},[113],{"categories":602},[76],{"categories":604},[182],{"categories":606},[76],{"categories":608},[168],{"categories":610},[121],{"categories":612},[182],{"categories":614},[139],{"categories":616},[168],{"categories":618},[],{"categories":620},[76],{"categories":622},[76],{"categories":624},[76],{"categories":626},[76],{"categories":628},[76],{"categories":630},[76],{"categories":632},[139],{"categories":634},[113],{"categories":636},[76],{"categories":638},[121],{"categories":640},[216],{"categories":642},[168],{"categories":644},[76],{"categories":646},[121],{"categories":648},[],{"categories":650},[],{"categories":652},[168],{"categories":654},[139],{"categories":656},[171],{"categories":658},[],{"categories":660},[76],{"categories":662},[76],{"categories":664},[116],{"categories":666},[76],{"categories":668},[76],{"categories":670},[76],{"categories":672},[139],{"categories":674},[168],{"categories":676},[],{"categories":678},[121],{"categories":680},[182],{"categories":682},[],{"categories":684},[76],{"categories":686},[76],{"categories":688},[121],{"categories":690},[182],{"categories":692},[76],{"categories":694},[],{"categories":696},[],{"categories":698},[76],{"categories":700},[],{"categories":702},[124],{"categories":704},[116],{"categories":706},[121],{"categories":708},[121],{"categories":710},[],{"categories":712},[113],{"categories":714},[76],{"categories":716},[116],{"categories":718},[139],{"categories":720},[113],{"categories":722},[],{"categories":724},[76],{"categories":726},[],{"categories":728},[],{"categories":730},[139],{"categories":732},[139],{"categories":734},[],{"categories":736},[168],{"categories":738},[182],{"categories":740},[],{"categories":742},[116],{"categories":744},[],{"categories":746},[],{"categories":748},[113],{"categories":750},[],{"categories":752},[191],{"categories":754},[121],{"categories":756},[116],{"categories":758},[121],{"categories":760},[182],{"categories":762},[],{"categories":764},[124],{"categories":766},[168],{"categories":768},[182],{"categories":770},[76],{"categories":772},[121],{"categories":774},[116],{"categories":776},[76],{"categories":778},[],{"categories":780},[],{"categories":782},[182],{"categories":784},[171],{"categories":786},[124],{"categories":788},[76],{"categories":790},[121],{"categories":792},[76],{"categories":794},[],{"categories":796},[139],{"categories":798},[216],{"categories":800},[],{"categories":802},[121],{"categories":804},[],{"categories":806},[113],{"categories":808},[],{"categories":810},[76],{"categories":812},[76],{"categories":814},[168],{"categories":816},[191],{"categories":818},[182],{"categories":820},[121],{"categories":822},[],{"categories":824},[182],{"categories":826},[113],{"categories":828},[],{"categories":830},[139],{"categories":832},[76,216],{"categories":834},[76],{"categories":836},[139],{"categories":838},[76],{"categories":840},[76],{"categories":842},[116],{"categories":844},[76],{"categories":846},[],{"categories":848},[76],{"categories":850},[116],{"categories":852},[76],{"categories":854},[],{"categories":856},[121],{"categories":858},[182],{"categories":860},[168],{"categories":862},[139],{"categories":864},[171],{"categories":866},[76],{"categories":868},[113],{"categories":870},[76],{"categories":872},[121],{"categories":874},[182],{"categories":876},[],{"categories":878},[],{"categories":880},[121],{"categories":882},[124],{"categories":884},[],{"categories":886},[76],{"categories":888},[],{"categories":890},[168],{"categories":892},[121],{"categories":894},[182],{"categories":896},[168],{"categories":898},[76],{"categories":900},[168],{"categories":902},[],{"categories":904},[],{"categories":906},[139],{"categories":908},[121],{"categories":910},[121],{"categories":912},[76],{"categories":914},[76],{"categories":916},[76],{"categories":918},[116],{"categories":920},[76],{"categories":922},[],{"categories":924},[182],{"categories":926},[182],{"categories":928},[116],{"categories":930},[],{"categories":932},[76],{"categories":934},[76],{"categories":936},[121],{"categories":938},[113],{"categories":940},[116],{"categories":942},[139],{"categories":944},[121],{"categories":946},[191],{"categories":948},[76],{"categories":950},[121],{"categories":952},[],{"categories":954},[168],{"categories":956},[],{"categories":958},[76],{"categories":960},[76],{"categories":962},[],{"categories":964},[116],{"categories":966},[121],{"categories":968},[],{"categories":970},[76],{"categories":972},[216],{"categories":974},[171],{"categories":976},[182],{"categories":978},[191],{"categories":980},[76],{"categories":982},[168],{"categories":984},[76],{"categories":986},[182],{"categories":988},[121],{"categories":990},[],{"categories":992},[],{"categories":994},[121],{"categories":996},[113],{"categories":998},[121],{"categories":1000},[124],{"categories":1002},[116],{"categories":1004},[],{"categories":1006},[76],{"categories":1008},[124],{"categories":1010},[76],{"categories":1012},[76],{"categories":1014},[76],{"categories":1016},[76],{"categories":1018},[191],{"categories":1020},[76],{"categories":1022},[76],{"categories":1024},[76],{"categories":1026},[168],{"categories":1028},[121],{"categories":1030},[],{"categories":1032},[],{"categories":1034},[216],{"categories":1036},[182],{"categories":1038},[],{"categories":1040},[121],{"categories":1042},[76],{"categories":1044},[168,76],{"categories":1046},[113],{"categories":1048},[],{"categories":1050},[76],{"categories":1052},[113],{"categories":1054},[168],{"categories":1056},[121],{"categories":1058},[182],{"categories":1060},[],{"categories":1062},[76],{"categories":1064},[],{"categories":1066},[],{"categories":1068},[76],{"categories":1070},[113],{"categories":1072},[76],{"categories":1074},[],{"categories":1076},[121],{"categories":1078},[124],{"categories":1080},[76],{"categories":1082},[76],{"categories":1084},[76],{"categories":1086},[168],{"categories":1088},[121],{"categories":1090},[216],{"categories":1092},[168],{"categories":1094},[116],{"categories":1096},[121],{"categories":1098},[76],{"categories":1100},[76],{"categories":1102},[76],{"categories":1104},[121],{"categories":1106},[182],{"categories":1108},[76],{"categories":1110},[124],{"categories":1112},[],{"categories":1114},[139],{"categories":1116},[],{"categories":1118},[124],{"categories":1120},[121],{"categories":1122},[168],{"categories":1124},[76],{"categories":1126},[76],{"categories":1128},[121],{"categories":1130},[182],{"categories":1132},[168],{"categories":1134},[121],{"categories":1136},[139],{"categories":1138},[],{"categories":1140},[76],{"categories":1142},[],{"categories":1144},[76],{"categories":1146},[76],{"categories":1148},[168],{"categories":1150},[76],{"categories":1152},[113],{"categories":1154},[139],{"categories":1156},[76],{"categories":1158},[76],{"categories":1160},[191],{"categories":1162},[76],{"categories":1164},[76],{"categories":1166},[121],{"categories":1168},[121],{"categories":1170},[76],{"categories":1172},[121],{"categories":1174},[121],{"categories":1176},[76],{"categories":1178},[76],{"categories":1180},[121],{"categories":1182},[168],{"categories":1184},[76],{"categories":1186},[76],{"categories":1188},[],{"categories":1190},[],{"categories":1192},[182],{"categories":1194},[],{"categories":1196},[113],{"categories":1198},[216],{"categories":1200},[76],{"categories":1202},[],{"categories":1204},[113],{"categories":1206},[116],{"categories":1208},[76],{"categories":1210},[191],{"categories":1212},[],{"categories":1214},[116],{"categories":1216},[],{"categories":1218},[76],{"categories":1220},[182],{"categories":1222},[],{"categories":1224},[],{"categories":1226},[],{"categories":1228},[],{"categories":1230},[76],{"categories":1232},[121],{"categories":1234},[216],{"categories":1236},[76],{"categories":1238},[113],{"categories":1240},[182],{"categories":1242},[76],{"categories":1244},[76],{"categories":1246},[182],{"categories":1248},[124],{"categories":1250},[76],{"categories":1252},[191],{"categories":1254},[116],{"categories":1256},[76],{"categories":1258},[76],{"categories":1260},[76],{"categories":1262},[76,113],{"categories":1264},[182],{"categories":1266},[182],{"categories":1268},[168],{"categories":1270},[121],{"categories":1272},[76],{"categories":1274},[76],{"categories":1276},[],{"categories":1278},[],{"categories":1280},[76],{"categories":1282},[],{"categories":1284},[182],{"categories":1286},[171],{"categories":1288},[139],{"categories":1290},[168],{"categories":1292},[76],{"categories":1294},[182],{"categories":1296},[],{"categories":1298},[76],{"categories":1300},[76],{"categories":1302},[],{"categories":1304},[121],{"categories":1306},[76],{"categories":1308},[76],{"categories":1310},[],{"categories":1312},[121],{"categories":1314},[76],{"categories":1316},[116],{"categories":1318},[],{"categories":1320},[113],{"categories":1322},[76],{"categories":1324},[113],{"categories":1326},[76],{"categories":1328},[182],{"categories":1330},[191],{"categories":1332},[121],{"categories":1334},[121],{"categories":1336},[76,168],{"categories":1338},[139],{"categories":1340},[76],{"categories":1342},[168],{"categories":1344},[],{"categories":1346},[182],{"categories":1348},[216],{"categories":1350},[168],{"categories":1352},[182],{"categories":1354},[76],{"categories":1356},[76],{"categories":1358},[121],{"categories":1360},[],{"categories":1362},[],{"categories":1364},[],{"categories":1366},[],{"categories":1368},[182],{"categories":1370},[76],{"categories":1372},[121],{"categories":1374},[121],{"categories":1376},[216],{"categories":1378},[76],{"categories":1380},[76],{"categories":1382},[76],{"categories":1384},[121],{"categories":1386},[76],{"categories":1388},[76],{"categories":1390},[],{"categories":1392},[168],{"categories":1394},[182],{"categories":1396},[],{"categories":1398},[],{"categories":1400},[121],{"categories":1402},[],{"categories":1404},[],{"categories":1406},[191],{"categories":1408},[191],{"categories":1410},[121],{"categories":1412},[182],{"categories":1414},[],{"categories":1416},[76],{"categories":1418},[76],{"categories":1420},[182],{"categories":1422},[168],{"categories":1424},[168],{"categories":1426},[76],{"categories":1428},[121],{"categories":1430},[113],{"categories":1432},[76],{"categories":1434},[76],{"categories":1436},[168],{"categories":1438},[168],{"categories":1440},[121],{"categories":1442},[121],{"categories":1444},[76],{"categories":1446},[],{"categories":1448},[76],{"categories":1450},[],{"categories":1452},[76],{"categories":1454},[121],{"categories":1456},[139],{"categories":1458},[182],{"categories":1460},[76],{"categories":1462},[113],{"categories":1464},[76],{"categories":1466},[],{"categories":1468},[121],{"categories":1470},[121],{"categories":1472},[],{"categories":1474},[76],{"categories":1476},[113],{"categories":1478},[76],{"categories":1480},[113],{"categories":1482},[113],{"categories":1484},[],{"categories":1486},[182],{"categories":1488},[],{"categories":1490},[121],{"categories":1492},[139],{"categories":1494},[76],{"categories":1496},[121],{"categories":1498},[76],{"categories":1500},[121],{"categories":1502},[76],{"categories":1504},[139],{"categories":1506},[171],{"categories":1508},[76],{"categories":1510},[124],{"categories":1512},[139],{"categories":1514},[168],{"categories":1516},[],{"categories":1518},[],{"categories":1520},[139],{"categories":1522},[],{"categories":1524},[],{"categories":1526},[],{"categories":1528},[],{"categories":1530},[182],{"categories":1532},[182],{"categories":1534},[171],{"categories":1536},[],{"categories":1538},[76],{"categories":1540},[76],{"categories":1542},[171],{"categories":1544},[182],{"categories":1546},[],{"categories":1548},[],{"categories":1550},[121],{"categories":1552},[121],{"categories":1554},[182],{"categories":1556},[121],{"categories":1558},[139],{"categories":1560},[139],{"categories":1562},[121],{"categories":1564},[121],{"categories":1566},[113],{"categories":1568},[76,216],{"categories":1570},[],{"categories":1572},[168],{"categories":1574},[182],{"categories":1576},[113],{"categories":1578},[76],{"categories":1580},[121],{"categories":1582},[168],{"categories":1584},[],{"categories":1586},[121],{"categories":1588},[121],{"categories":1590},[121],{"categories":1592},[76],{"categories":1594},[191],{"categories":1596},[76],{"categories":1598},[182],{"categories":1600},[168],{"categories":1602},[76],{"categories":1604},[],{"categories":1606},[121],{"categories":1608},[168],{"categories":1610},[76],{"categories":1612},[121],{"categories":1614},[121],{"categories":1616},[121],{"categories":1618},[191],{"categories":1620},[171],{"categories":1622},[76],{"categories":1624},[121],{"categories":1626},[76],{"categories":1628},[],{"categories":1630},[191],{"categories":1632},[139],{"categories":1634},[182],{"categories":1636},[76],{"categories":1638},[121],{"categories":1640},[],{"categories":1642},[],{"categories":1644},[76],{"categories":1646},[121],{"categories":1648},[76],{"categories":1650},[139],{"categories":1652},[76],{"categories":1654},[121],{"categories":1656},[121],{"categories":1658},[],{"categories":1660},[76],{"categories":1662},[],{"categories":1664},[],{"categories":1666},[76],{"categories":1668},[121],{"categories":1670},[],{"categories":1672},[],{"categories":1674},[171],{"categories":1676},[76],{"categories":1678},[171],{"categories":1680},[139],{"categories":1682},[76],{"categories":1684},[76],{"categories":1686},[121],{"categories":1688},[76],{"categories":1690},[121],{"categories":1692},[],{"categories":1694},[],{"categories":1696},[76],{"categories":1698},[216],{"categories":1700},[76],{"categories":1702},[],{"categories":1704},[],{"categories":1706},[113],{"categories":1708},[],{"categories":1710},[],{"categories":1712},[76],{"categories":1714},[],{"categories":1716},[],{"categories":1718},[182],{"categories":1720},[139],{"categories":1722},[191],{"categories":1724},[116],{"categories":1726},[76],{"categories":1728},[76],{"categories":1730},[116],{"categories":1732},[],{"categories":1734},[168],{"categories":1736},[121],{"categories":1738},[116],{"categories":1740},[76],{"categories":1742},[76],{"categories":1744},[113],{"categories":1746},[76],{"categories":1748},[],{"categories":1750},[113],{"categories":1752},[76],{"categories":1754},[191],{"categories":1756},[121],{"categories":1758},[139],{"categories":1760},[76],{"categories":1762},[116],{"categories":1764},[76],{"categories":1766},[76],{"categories":1768},[121],{"categories":1770},[],{"categories":1772},[76],{"categories":1774},[182],{"categories":1776},[113],{"categories":1778},[76],{"categories":1780},[76],{"categories":1782},[],{"categories":1784},[139],{"categories":1786},[76],{"categories":1788},[76],{"categories":1790},[],{"categories":1792},[116],{"categories":1794},[116],{"categories":1796},[76],{"categories":1798},[124],{"categories":1800},[76],{"categories":1802},[76],{"categories":1804},[],{"categories":1806},[182],{"categories":1808},[76],{"categories":1810},[],{"categories":1812},[],{"categories":1814},[76],{"categories":1816},[139],{"categories":1818},[],{"categories":1820},[216],{"categories":1822},[76],{"categories":1824},[76],{"categories":1826},[],{"categories":1828},[76],{"categories":1830},[182],{"categories":1832},[76],{"categories":1834},[76],{"categories":1836},[76,216],{"categories":1838},[76],{"categories":1840},[76],{"categories":1842},[168],{"categories":1844},[121],{"categories":1846},[],{"categories":1848},[121],{"categories":1850},[121],{"categories":1852},[76],{"categories":1854},[76],{"categories":1856},[76],{"categories":1858},[76],{"categories":1860},[113],{"categories":1862},[171],{"categories":1864},[113],{"categories":1866},[182],{"categories":1868},[168],{"categories":1870},[121],{"categories":1872},[76],{"categories":1874},[],{"categories":1876},[76],{"categories":1878},[139],{"categories":1880},[76],{"categories":1882},[121],{"categories":1884},[76],{"categories":1886},[76],{"categories":1888},[116],{"categories":1890},[],{"categories":1892},[216],{"categories":1894},[168],{"categories":1896},[168],{"categories":1898},[182],{"categories":1900},[121],{"categories":1902},[76],{"categories":1904},[116],{"categories":1906},[139],{"categories":1908},[168],{"categories":1910},[121],{"categories":1912},[76],{"categories":1914},[],{"categories":1916},[76],{"categories":1918},[76],{"categories":1920},[],{"categories":1922},[],{"categories":1924},[76],{"categories":1926},[76],{"categories":1928},[76],{"categories":1930},[76],{"categories":1932},[121],{"categories":1934},[76],{"categories":1936},[76],{"categories":1938},[],{"categories":1940},[171],{"categories":1942},[76],{"categories":1944},[121],{"categories":1946},[],{"categories":1948},[],{"categories":1950},[76],{"categories":1952},[76],{"categories":1954},[76],{"categories":1956},[139],{"categories":1958},[],{"categories":1960},[168],{"categories":1962},[76],{"categories":1964},[216],{"categories":1966},[139],{"categories":1968},[182],{"categories":1970},[182],{"categories":1972},[139],{"categories":1974},[139],{"categories":1976},[216],{"categories":1978},[],{"categories":1980},[139],{"categories":1982},[76],{"categories":1984},[113],{"categories":1986},[76],{"categories":1988},[139],{"categories":1990},[],{"categories":1992},[76],{"categories":1994},[182],{"categories":1996},[171],{"categories":1998},[76],{"categories":2000},[139],{"categories":2002},[76],{"categories":2004},[182],{"categories":2006},[121],{"categories":2008},[139],{"categories":2010},[216],{"categories":2012},[121],{"categories":2014},[76],{"categories":2016},[76],{"categories":2018},[76],{"categories":2020},[],{"categories":2022},[116],{"categories":2024},[],{"categories":2026},[],{"categories":2028},[76],{"categories":2030},[121],{"categories":2032},[76],{"categories":2034},[76],{"categories":2036},[76],{"categories":2038},[],{"categories":2040},[171],{"categories":2042},[113],{"categories":2044},[121],{"categories":2046},[168],{"categories":2048},[],{"categories":2050},[76],{"categories":2052},[182],{"categories":2054},[76],{"categories":2056},[216],{"categories":2058},[216],{"categories":2060},[],{"categories":2062},[121],{"categories":2064},[139],{"categories":2066},[139],{"categories":2068},[76],{"categories":2070},[121],{"categories":2072},[],{"categories":2074},[168],{"categories":2076},[76],{"categories":2078},[76],{"categories":2080},[],{"categories":2082},[76],{"categories":2084},[],{"categories":2086},[76],{"categories":2088},[182],{"categories":2090},[216],{"categories":2092},[76],{"categories":2094},[182],{"categories":2096},[116],{"categories":2098},[76],{"categories":2100},[],{"categories":2102},[121],{"categories":2104},[113],{"categories":2106},[113],{"categories":2108},[],{"categories":2110},[76],{"categories":2112},[76],{"categories":2114},[76],{"categories":2116},[182],{"categories":2118},[168],{"categories":2120},[76],{"categories":2122},[121],{"categories":2124},[],{"categories":2126},[76],{"categories":2128},[76],{"categories":2130},[121],{"categories":2132},[],{"categories":2134},[121],{"categories":2136},[76],{"categories":2138},[121],{"categories":2140},[182],{"categories":2142},[],{"categories":2144},[76],{"categories":2146},[121],{"categories":2148},[116],{"categories":2150},[],{"categories":2152},[76],{"categories":2154},[],{"categories":2156},[76],{"categories":2158},[76],{"categories":2160},[],{"categories":2162},[76],{"categories":2164},[76],{"categories":2166},[139],{"categories":2168},[76],{"categories":2170},[76],{"categories":2172},[113],{"categories":2174},[76],{"categories":2176},[171],{"categories":2178},[139],{"categories":2180},[121],{"categories":2182},[],{"categories":2184},[76],{"categories":2186},[168],{"categories":2188},[191],{"categories":2190},[76],{"categories":2192},[121],{"categories":2194},[],{"categories":2196},[],{"categories":2198},[],{"categories":2200},[113],{"categories":2202},[139],{"categories":2204},[121],{"categories":2206},[76],{"categories":2208},[76],{"categories":2210},[168],{"categories":2212},[121],{"categories":2214},[],{"categories":2216},[121],{"categories":2218},[121],{"categories":2220},[],{"categories":2222},[76],{"categories":2224},[121],{"categories":2226},[76],{"categories":2228},[],{"categories":2230},[76],{"categories":2232},[76],{"categories":2234},[139],{"categories":2236},[168],{"categories":2238},[121],{"categories":2240},[168],{"categories":2242},[121],{"categories":2244},[116],{"categories":2246},[],{"categories":2248},[],{"categories":2250},[76],{"categories":2252},[113],{"categories":2254},[139],{"categories":2256},[],{"categories":2258},[168],{"categories":2260},[],{"categories":2262},[182],{"categories":2264},[182],{"categories":2266},[168],{"categories":2268},[182],{"categories":2270},[76],{"categories":2272},[],{"categories":2274},[76],{"categories":2276},[76],{"categories":2278},[],{"categories":2280},[191],{"categories":2282},[76],{"categories":2284},[216],{"categories":2286},[182],{"categories":2288},[],{"categories":2290},[121],{"categories":2292},[76],{"categories":2294},[113],{"categories":2296},[121],{"categories":2298},[121],{"categories":2300},[76],{"categories":2302},[76],{"categories":2304},[],{"categories":2306},[113],{"categories":2308},[76],{"categories":2310},[116],{"categories":2312},[182],{"categories":2314},[168],{"categories":2316},[],{"categories":2318},[],{"categories":2320},[],{"categories":2322},[121],{"categories":2324},[182],{"categories":2326},[168],{"categories":2328},[139],{"categories":2330},[76],{"categories":2332},[139],{"categories":2334},[121],{"categories":2336},[168],{"categories":2338},[76],{"categories":2340},[],{"categories":2342},[76],{"categories":2344},[168],{"categories":2346},[139],{"categories":2348},[116],{"categories":2350},[182],{"categories":2352},[76],{"categories":2354},[139],{"categories":2356},[191],{"categories":2358},[],{"categories":2360},[],{"categories":2362},[171],{"categories":2364},[76,182],{"categories":2366},[139],{"categories":2368},[76],{"categories":2370},[76],{"categories":2372},[121],{"categories":2374},[76],{"categories":2376},[121],{"categories":2378},[76],{"categories":2380},[76],{"categories":2382},[],{"categories":2384},[182],{"categories":2386},[76],{"categories":2388},[171],{"categories":2390},[121],{"categories":2392},[191],{"categories":2394},[216],{"categories":2396},[],{"categories":2398},[76],{"categories":2400},[121],{"categories":2402},[113],{"categories":2404},[121],{"categories":2406},[121],{"categories":2408},[124],{"categories":2410},[182],{"categories":2412},[76],{"categories":2414},[76],{"categories":2416},[],{"categories":2418},[],{"categories":2420},[],{"categories":2422},[216],{"categories":2424},[76],{"categories":2426},[139],{"categories":2428},[76],{"categories":2430},[76],{"categories":2432},[76],{"categories":2434},[],{"categories":2436},[171],{"categories":2438},[116],{"categories":2440},[121],{"categories":2442},[],{"categories":2444},[76],{"categories":2446},[121],{"categories":2448},[76],{"categories":2450},[216],{"categories":2452},[],{"categories":2454},[168],{"categories":2456},[168],{"categories":2458},[],{"categories":2460},[182],{"categories":2462},[76],{"categories":2464},[168],{"categories":2466},[76],{"categories":2468},[116],{"categories":2470},[],{"categories":2472},[139],{"categories":2474},[76],{"categories":2476},[76],{"categories":2478},[168],{"categories":2480},[121],{"categories":2482},[139],{"categories":2484},[],{"categories":2486},[121],{"categories":2488},[121],{"categories":2490},[168],{"categories":2492},[76],{"categories":2494},[],{"categories":2496},[76],{"categories":2498},[76],{"categories":2500},[216],{"categories":2502},[139],{"categories":2504},[171],{"categories":2506},[171],{"categories":2508},[],{"categories":2510},[],{"categories":2512},[],{"categories":2514},[121],{"categories":2516},[121],{"categories":2518},[182],{"categories":2520},[182],{"categories":2522},[76],{"categories":2524},[76],{"categories":2526},[76],{"categories":2528},[121],{"categories":2530},[],{"categories":2532},[],{"categories":2534},[76],{"categories":2536},[],{"categories":2538},[76],{"categories":2540},[121],{"categories":2542},[76],{"categories":2544},[76],{"categories":2546},[],{"categories":2548},[124],{"categories":2550},[76],{"categories":2552},[168],{"categories":2554},[76],{"categories":2556},[116],{"categories":2558},[76],{"categories":2560},[191],{"categories":2562},[121],{"categories":2564},[76],{"categories":2566},[76],{"categories":2568},[76],{"categories":2570},[182],{"categories":2572},[],{"categories":2574},[139],{"categories":2576},[121],{"categories":2578},[],{"categories":2580},[139],{"categories":2582},[121],{"categories":2584},[121],{"categories":2586},[76],{"categories":2588},[121],{"categories":2590},[],{"categories":2592},[116],{"categories":2594},[121],{"categories":2596},[],{"categories":2598},[182],{"categories":2600},[76],{"categories":2602},[113],{"categories":2604},[139],{"categories":2606},[216],{"categories":2608},[121],{"categories":2610},[76],{"categories":2612},[121],{"categories":2614},[113],{"categories":2616},[],{"categories":2618},[76],{"categories":2620},[],{"categories":2622},[],{"categories":2624},[168],{"categories":2626},[76,116],{"categories":2628},[121],{"categories":2630},[76],{"categories":2632},[],{"categories":2634},[113],{"categories":2636},[171],{"categories":2638},[76],{"categories":2640},[182],{"categories":2642},[76],{"categories":2644},[121],{"categories":2646},[76],{"categories":2648},[76],{"categories":2650},[76],{"categories":2652},[139],{"categories":2654},[121],{"categories":2656},[76],{"categories":2658},[],{"categories":2660},[],{"categories":2662},[121],{"categories":2664},[76],{"categories":2666},[216],{"categories":2668},[],{"categories":2670},[76],{"categories":2672},[121],{"categories":2674},[121],{"categories":2676},[],{"categories":2678},[121],{"categories":2680},[76],{"categories":2682},[191],{"categories":2684},[171],{"categories":2686},[121],{"categories":2688},[76],{"categories":2690},[216],{"categories":2692},[],{"categories":2694},[76],{"categories":2696},[191],{"categories":2698},[168],{"categories":2700},[76],{"categories":2702},[76],{"categories":2704},[],{"categories":2706},[191],{"categories":2708},[139],{"categories":2710},[76],{"categories":2712},[76],{"categories":2714},[113],{"categories":2716},[76],{"categories":2718},[],{"categories":2720},[],{"categories":2722},[168],{"categories":2724},[76],{"categories":2726},[171],{"categories":2728},[191],{"categories":2730},[121],{"categories":2732},[191],{"categories":2734},[139],{"categories":2736},[],{"categories":2738},[76],{"categories":2740},[],{"categories":2742},[76],{"categories":2744},[121],{"categories":2746},[76],{"categories":2748},[76],{"categories":2750},[],{"categories":2752},[76,182],{"categories":2754},[139],{"categories":2756},[121],{"categories":2758},[182],{"categories":2760},[76],{"categories":2762},[113],{"categories":2764},[],{"categories":2766},[],{"categories":2768},[121],{"categories":2770},[76],{"categories":2772},[182],{"categories":2774},[113],{"categories":2776},[182],{"categories":2778},[182],{"categories":2780},[76],{"categories":2782},[191],{"categories":2784},[76],{"categories":2786},[182],{"categories":2788},[],{"categories":2790},[168,76],{"categories":2792},[216],{"categories":2794},[113],{"categories":2796},[],{"categories":2798},[76],{"categories":2800},[116],{"categories":2802},[116],{"categories":2804},[76],{"categories":2806},[76],{"categories":2808},[76],{"categories":2810},[182],{"categories":2812},[121],{"categories":2814},[139],{"categories":2816},[191],{"categories":2818},[168],{"categories":2820},[76],{"categories":2822},[76],{"categories":2824},[76],{"categories":2826},[76],{"categories":2828},[113],{"categories":2830},[76],{"categories":2832},[121],{"categories":2834},[121],{"categories":2836},[139],{"categories":2838},[182],{"categories":2840},[],{"categories":2842},[],{"categories":2844},[171],{"categories":2846},[182],{"categories":2848},[76],{"categories":2850},[168],{"categories":2852},[76],{"categories":2854},[76],{"categories":2856},[76],{"categories":2858},[171],{"categories":2860},[76],{"categories":2862},[76],{"categories":2864},[76],{"categories":2866},[121],{"categories":2868},[121],{"categories":2870},[76,116],{"categories":2872},[],{"categories":2874},[168],{"categories":2876},[],{"categories":2878},[76],{"categories":2880},[139],{"categories":2882},[113],{"categories":2884},[113],{"categories":2886},[121],{"categories":2888},[121],{"categories":2890},[121],{"categories":2892},[76],{"categories":2894},[76],{"categories":2896},[116],{"categories":2898},[182],{"categories":2900},[191],{"categories":2902},[76],{"categories":2904},[],{"categories":2906},[139],{"categories":2908},[76],{"categories":2910},[76],{"categories":2912},[76],{"categories":2914},[76],{"categories":2916},[76],{"categories":2918},[182],{"categories":2920},[139],{"categories":2922},[182],{"categories":2924},[182],{"categories":2926},[76],{"categories":2928},[76],{"categories":2930},[76],{"categories":2932},[121],{"categories":2934},[139],{"categories":2936},[76],{"categories":2938},[121],{"categories":2940},[76],{"categories":2942},[76],{"categories":2944},[168],{"categories":2946},[76],{"categories":2948},[76],{"categories":2950},[216],{"categories":2952},[76],{"categories":2954},[124],{"categories":2956},[121],{"categories":2958},[76],{"categories":2960},[76],{"categories":2962},[139],{"categories":2964},[121],{"categories":2966},[191],{"categories":2968},[76],{"categories":2970},[76],{"categories":2972},[116],{"categories":2974},[76],{"categories":2976},[],{"categories":2978},[76],{"categories":2980},[76],{"categories":2982},[],{"categories":2984},[],{"categories":2986},[],{"categories":2988},[116],{"categories":2990},[76],{"categories":2992},[121],{"categories":2994},[139],{"categories":2996},[139],{"categories":2998},[139],{"categories":3000},[139],{"categories":3002},[],{"categories":3004},[113],{"categories":3006},[121],{"categories":3008},[139],{"categories":3010},[76],{"categories":3012},[113],{"categories":3014},[121],{"categories":3016},[76],{"categories":3018},[76,121],{"categories":3020},[121],{"categories":3022},[216],{"categories":3024},[139],{"categories":3026},[121],{"categories":3028},[139],{"categories":3030},[121],{"categories":3032},[76],{"categories":3034},[],{"categories":3036},[139],{"categories":3038},[191],{"categories":3040},[113],{"categories":3042},[76],{"categories":3044},[76],{"categories":3046},[],{"categories":3048},[182],{"categories":3050},[],{"categories":3052},[113],{"categories":3054},[121],{"categories":3056},[139],{"categories":3058},[76],{"categories":3060},[139],{"categories":3062},[113],{"categories":3064},[139],{"categories":3066},[139],{"categories":3068},[],{"categories":3070},[116],{"categories":3072},[121],{"categories":3074},[139],{"categories":3076},[139],{"categories":3078},[139],{"categories":3080},[139],{"categories":3082},[139],{"categories":3084},[139],{"categories":3086},[139],{"categories":3088},[139],{"categories":3090},[139],{"categories":3092},[139],{"categories":3094},[171],{"categories":3096},[113],{"categories":3098},[76],{"categories":3100},[76],{"categories":3102},[121],{"categories":3104},[121],{"categories":3106},[],{"categories":3108},[76,113],{"categories":3110},[],{"categories":3112},[121],{"categories":3114},[139],{"categories":3116},[121],{"categories":3118},[76],{"categories":3120},[76],{"categories":3122},[76],{"categories":3124},[76],{"categories":3126},[76],{"categories":3128},[121],{"categories":3130},[116],{"categories":3132},[121],{"categories":3134},[],{"categories":3136},[168],{"categories":3138},[139],{"categories":3140},[76],{"categories":3142},[],{"categories":3144},[],{"categories":3146},[121],{"categories":3148},[168],{"categories":3150},[76],{"categories":3152},[],{"categories":3154},[76],{"categories":3156},[],{"categories":3158},[191],{"categories":3160},[76],{"categories":3162},[],{"categories":3164},[],{"categories":3166},[139],{"categories":3168},[113],{"categories":3170},[76],{"categories":3172},[116],{"categories":3174},[76],{"categories":3176},[76],{"categories":3178},[76],{"categories":3180},[116],{"categories":3182},[168],{"categories":3184},[],{"categories":3186},[76],{"categories":3188},[139],{"categories":3190},[],{"categories":3192},[168],{"categories":3194},[76],{"categories":3196},[191],{"categories":3198},[76],{"categories":3200},[216],{"categories":3202},[],{"categories":3204},[191],{"categories":3206},[],{"categories":3208},[76],{"categories":3210},[],{"categories":3212},[121],{"categories":3214},[182],{"categories":3216},[],{"categories":3218},[116],{"categories":3220},[113],{"categories":3222},[121],{"categories":3224},[168],{"categories":3226},[182],{"categories":3228},[],{"categories":3230},[],{"categories":3232},[76],{"categories":3234},[113],{"categories":3236},[76],{"categories":3238},[191],{"categories":3240},[],{"categories":3242},[121],{"categories":3244},[121],{"categories":3246},[121],{"categories":3248},[139],{"categories":3250},[182],{"categories":3252},[76],{"categories":3254},[121],{"categories":3256},[124],{"categories":3258},[76],{"categories":3260},[121],{"categories":3262},[76],{"categories":3264},[124],{"categories":3266},[191],{"categories":3268},[139],{"categories":3270},[],{"categories":3272},[191],{"categories":3274},[],{"categories":3276},[182],{"categories":3278},[121],{"categories":3280},[],{"categories":3282},[76],{"categories":3284},[76],{"categories":3286},[121],{"categories":3288},[116],{"categories":3290},[113],{"categories":3292},[76],{"categories":3294},[168],{"categories":3296},[182],{"categories":3298},[182],{"categories":3300},[76],{"categories":3302},[171],{"categories":3304},[121],{"categories":3306},[76],{"categories":3308},[121],{"categories":3310},[116],{"categories":3312},[168],{"categories":3314},[182],{"categories":3316},[121],{"categories":3318},[76],{"categories":3320},[76],{"categories":3322},[121],{"categories":3324},[76],{"categories":3326},[139],{"categories":3328},[],{"categories":3330},[113],{"categories":3332},[76],{"categories":3334},[76],{"categories":3336},[76],{"categories":3338},[121],{"categories":3340},[76],{"categories":3342},[76],{"categories":3344},[],{"categories":3346},[76],{"categories":3348},[168],{"categories":3350},[116],{"categories":3352},[139],{"categories":3354},[121],{"categories":3356},[76],{"categories":3358},[76],{"categories":3360},[168],{"categories":3362},[121],{"categories":3364},[76],{"categories":3366},[191],{"categories":3368},[171],{"categories":3370},[76],{"categories":3372},[139],{"categories":3374},[76],{"categories":3376},[121],{"categories":3378},[216],{"categories":3380},[76],{"categories":3382},[121],{"categories":3384},[171],{"categories":3386},[],{"categories":3388},[121],{"categories":3390},[182],{"categories":3392},[168],{"categories":3394},[76],{"categories":3396},[113],{"categories":3398},[182],{"categories":3400},[116],{"categories":3402},[182],{"categories":3404},[76],{"categories":3406},[],{"categories":3408},[121],{"categories":3410},[121],{"categories":3412},[76],{"categories":3414},[171],{"categories":3416},[],{"categories":3418},[139],{"categories":3420},[],{"categories":3422},[139],{"categories":3424},[76],{"categories":3426},[76],{"categories":3428},[121],{"categories":3430},[121],{"categories":3432},[121],{"categories":3434},[],{"categories":3436},[139],{"categories":3438},[76],{"categories":3440},[],{"categories":3442},[76],{"categories":3444},[76],{"categories":3446},[],{"categories":3448},[168],{"categories":3450},[182],{"categories":3452},[121],{"categories":3454},[76],{"categories":3456},[76],{"categories":3458},[191],{"categories":3460},[76],{"categories":3462},[76],{"categories":3464},[113],{"categories":3466},[],{"categories":3468},[76],{"categories":3470},[],{"categories":3472},[113],{"categories":3474},[139],{"categories":3476},[182],{"categories":3478},[76],{"categories":3480},[76],{"categories":3482},[76],{"categories":3484},[182],{"categories":3486},[139],{"categories":3488},[168],{"categories":3490},[76],{"categories":3492},[76],{"categories":3494},[76],{"categories":3496},[139],{"categories":3498},[168],{"categories":3500},[76],{"categories":3502},[139],{"categories":3504},[168],{"categories":3506},[139],{"categories":3508},[121],{"categories":3510},[121],{"categories":3512},[121],{"categories":3514},[182],{"categories":3516},[139],{"categories":3518},[121],{"categories":3520},[121],{"categories":3522},[76],{"categories":3524},[182],{"categories":3526},[168],{"categories":3528},[76],{"categories":3530},[],{"categories":3532},[121],{"categories":3534},[],{"categories":3536},[],{"categories":3538},[],{"categories":3540},[116],{"categories":3542},[121],{"categories":3544},[76],{"categories":3546},[121],{"categories":3548},[113],{"categories":3550},[121],{"categories":3552},[191],{"categories":3554},[121],{"categories":3556},[],{"categories":3558},[121],{"categories":3560},[],{"categories":3562},[113],{"categories":3564},[121],{"categories":3566},[],{"categories":3568},[121],{"categories":3570},[76],{"categories":3572},[76],{"categories":3574},[139],{"categories":3576},[76],{"categories":3578},[121],{"categories":3580},[76],{"categories":3582},[76],{"categories":3584},[139],{"categories":3586},[121],{"categories":3588},[182],{"categories":3590},[168],{"categories":3592},[113],{"categories":3594},[],{"categories":3596},[121],{"categories":3598},[168],{"categories":3600},[216],{"categories":3602},[139],{"categories":3604},[76],{"categories":3606},[168],{"categories":3608},[76],{"categories":3610},[113],{"categories":3612},[],{"categories":3614},[121],{"categories":3616},[76],{"categories":3618},[76],{"categories":3620},[121],{"categories":3622},[76],{"categories":3624},[168],{"categories":3626},[],{"categories":3628},[121],{"categories":3630},[124],{"categories":3632},[139],{"categories":3634},[121],{"categories":3636},[116],{"categories":3638},[],{"categories":3640},[76],{"categories":3642},[124],{"categories":3644},[76],{"categories":3646},[121],{"categories":3648},[139],{"categories":3650},[113],{"categories":3652},[216],{"categories":3654},[76],{"categories":3656},[76],{"categories":3658},[76],{"categories":3660},[139],{"categories":3662},[116],{"categories":3664},[76],{"categories":3666},[168],{"categories":3668},[139],{"categories":3670},[216],{"categories":3672},[76],{"categories":3674},[],{"categories":3676},[],{"categories":3678},[76],{"categories":3680},[216],{"categories":3682},[171],{"categories":3684},[121],{"categories":3686},[121],{"categories":3688},[139],{"categories":3690},[76],{"categories":3692},[113],{"categories":3694},[76],{"categories":3696},[168],{"categories":3698},[121],{"categories":3700},[121],{"categories":3702},[76],{"categories":3704},[191],{"categories":3706},[76],{"categories":3708},[121],{"categories":3710},[],{"categories":3712},[76],{"categories":3714},[76],{"categories":3716},[76],{"categories":3718},[139],{"categories":3720},[113],{"categories":3722},[],{"categories":3724},[76],{"categories":3726},[76],{"categories":3728},[182],{"categories":3730},[168],{"categories":3732},[76],{"categories":3734},[76,121],{"categories":3736},[191,116],{"categories":3738},[76],{"categories":3740},[76],{"categories":3742},[],{"categories":3744},[121],{"categories":3746},[],{"categories":3748},[182],{"categories":3750},[76],{"categories":3752},[],{"categories":3754},[76],{"categories":3756},[139],{"categories":3758},[76],{"categories":3760},[],{"categories":3762},[121],{"categories":3764},[76],{"categories":3766},[],{"categories":3768},[168],{"categories":3770},[76],{"categories":3772},[121],{"categories":3774},[76],{"categories":3776},[113],{"categories":3778},[121],{"categories":3780},[76],{"categories":3782},[],{"categories":3784},[216],{"categories":3786},[191],{"categories":3788},[116],{"categories":3790},[116],{"categories":3792},[76],{"categories":3794},[113],{"categories":3796},[113],{"categories":3798},[76],{"categories":3800},[121],{"categories":3802},[76],{"categories":3804},[76],{"categories":3806},[182],{"categories":3808},[113],{"categories":3810},[76],{"categories":3812},[191],{"categories":3814},[139],{"categories":3816},[76],{"categories":3818},[76],{"categories":3820},[121],{"categories":3822},[76],{"categories":3824},[],{"categories":3826},[182],{"categories":3828},[],{"categories":3830},[182],{"categories":3832},[121],{"categories":3834},[113],{"categories":3836},[],{"categories":3838},[216],{"categories":3840},[76],{"categories":3842},[182],{"categories":3844},[],{"categories":3846},[139],{"categories":3848},[121],{"categories":3850},[182],{"categories":3852},[76],{"categories":3854},[121],{"categories":3856},[182],{"categories":3858},[121],{"categories":3860},[139],{"categories":3862},[113],{"categories":3864},[139],{"categories":3866},[182],{"categories":3868},[76],{"categories":3870},[168],{"categories":3872},[76],{"categories":3874},[76],{"categories":3876},[76],{"categories":3878},[76],{"categories":3880},[76],{"categories":3882},[121],{"categories":3884},[76],{"categories":3886},[121],{"categories":3888},[76],{"categories":3890},[113],{"categories":3892},[76],{"categories":3894},[121],{"categories":3896},[168],{"categories":3898},[121],{"categories":3900},[113],{"categories":3902},[121],{"categories":3904},[168],{"categories":3906},[],{"categories":3908},[76],{"categories":3910},[171],{"categories":3912},[76],{"categories":3914},[76],{"categories":3916},[182],{"categories":3918},[],{"categories":3920},[121],{"categories":3922},[191],{"categories":3924},[76],{"categories":3926},[139],{"categories":3928},[191],{"categories":3930},[121],{"categories":3932},[116],{"categories":3934},[116],{"categories":3936},[76],{"categories":3938},[76],{"categories":3940},[76],{"categories":3942},[113],{"categories":3944},[],{"categories":3946},[76],{"categories":3948},[121],{"categories":3950},[121],{"categories":3952},[76],{"categories":3954},[182],{"categories":3956},[],{"categories":3958},[113],{"categories":3960},[76],{"categories":3962},[121],{"categories":3964},[121],{"categories":3966},[],{"categories":3968},[182],{"categories":3970},[182],{"categories":3972},[191],{"categories":3974},[168],{"categories":3976},[],{"categories":3978},[76],{"categories":3980},[121],{"categories":3982},[113],{"categories":3984},[76],{"categories":3986},[182],{"categories":3988},[113],{"categories":3990},[139],{"categories":3992},[139],{"categories":3994},[],{"categories":3996},[139],{"categories":3998},[121],{"categories":4000},[168],{"categories":4002},[171],{"categories":4004},[76],{"categories":4006},[],{"categories":4008},[139],{"categories":4010},[182],{"categories":4012},[76],{"categories":4014},[116],{"categories":4016},[76],{"categories":4018},[113],{"categories":4020},[216],{"categories":4022},[113],{"categories":4024},[],{"categories":4026},[],{"categories":4028},[121],{"categories":4030},[139],{"categories":4032},[],{"categories":4034},[121],{"categories":4036},[121],{"categories":4038},[121],{"categories":4040},[],{"categories":4042},[76],{"categories":4044},[],{"categories":4046},[139],{"categories":4048},[113],{"categories":4050},[168],{"categories":4052},[76],{"categories":4054},[139],{"categories":4056},[76],{"categories":4058},[139],{"categories":4060},[],{"categories":4062},[139],{"categories":4064},[113],{"categories":4066},[121],{"categories":4068},[76],{"categories":4070},[],{"categories":4072},[182],{"categories":4074},[121],{"categories":4076},[124],{"categories":4078},[121],{"categories":4080},[113],{"categories":4082},[],{"categories":4084},[],{"categories":4086},[],{"categories":4088},[168],{"categories":4090},[121],{"categories":4092},[76],{"categories":4094},[76],{"categories":4096},[],{"categories":4098},[],{"categories":4100},[],{"categories":4102},[168],{"categories":4104},[],{"categories":4106},[121],{"categories":4108},[76],{"categories":4110},[113],{"categories":4112},[],{"categories":4114},[],{"categories":4116},[168],{"categories":4118},[76],{"categories":4120},[139],{"categories":4122},[],{"categories":4124},[191],{"categories":4126},[139],{"categories":4128},[191],{"categories":4130},[171],{"categories":4132},[76],{"categories":4134},[76],{"categories":4136},[],{"categories":4138},[],{"categories":4140},[121],{"categories":4142},[],{"categories":4144},[76],{"categories":4146},[],{"categories":4148},[121],{"categories":4150},[76],{"categories":4152},[],{"categories":4154},[121],{"categories":4156},[76],{"categories":4158},[139],{"categories":4160},[76],{"categories":4162},[191],{"categories":4164},[76],{"categories":4166},[76],{"categories":4168},[171],{"categories":4170},[121],{"categories":4172},[121],{"categories":4174},[],{"categories":4176},[],{"categories":4178},[76],{"categories":4180},[],{"categories":4182},[139],{"categories":4184},[],{"categories":4186},[],{"categories":4188},[168],{"categories":4190},[113],{"categories":4192},[],{"categories":4194},[116],{"categories":4196},[191],{"categories":4198},[76],{"categories":4200},[182],{"categories":4202},[113],{"categories":4204},[171],{"categories":4206},[116],{"categories":4208},[182],{"categories":4210},[182],{"categories":4212},[],{"categories":4214},[76],{"categories":4216},[],{"categories":4218},[121],{"categories":4220},[113],{"categories":4222},[168],{"categories":4224},[113],{"categories":4226},[121],{"categories":4228},[216],{"categories":4230},[76],{"categories":4232},[76],{"categories":4234},[113],{"categories":4236},[121],{"categories":4238},[],{"categories":4240},[76],{"categories":4242},[182],{"categories":4244},[139],{"categories":4246},[182],{"categories":4248},[76],{"categories":4250},[],{"categories":4252},[168],{"categories":4254},[139],{"categories":4256},[113],{"categories":4258},[121],{"categories":4260},[76],{"categories":4262},[121],{"categories":4264},[76],{"categories":4266},[116],{"categories":4268},[121],{"categories":4270},[121,216],{"categories":4272},[121],{"categories":4274},[182],{"categories":4276},[76],{"categories":4278},[76],{"categories":4280},[171],{"categories":4282},[121],{"categories":4284},[191],{"categories":4286},[121],{"categories":4288},[116],{"categories":4290},[],{"categories":4292},[121],{"categories":4294},[76],{"categories":4296},[116],{"categories":4298},[],{"categories":4300},[],{"categories":4302},[76],{"categories":4304},[171],{"categories":4306},[191],{"categories":4308},[76],{"categories":4310},[76],{"categories":4312},[121],{"categories":4314},[],{"categories":4316},[139],{"categories":4318},[],{"categories":4320},[139],{"categories":4322},[182],{"categories":4324},[113],{"categories":4326},[182],{"categories":4328},[76],{"categories":4330},[121],{"categories":4332},[76],{"categories":4334},[76],{"categories":4336},[191],{"categories":4338},[182],{"categories":4340},[],{"categories":4342},[139],{"categories":4344},[76],{"categories":4346},[],{"categories":4348},[76],{"categories":4350},[76],{"categories":4352},[76],{"categories":4354},[121],{"categories":4356},[76],{"categories":4358},[124],{"categories":4360},[121],{"categories":4362},[76],{"categories":4364},[76],{"categories":4366},[76],{"categories":4368},[76],{"categories":4370},[116],{"categories":4372},[],{"categories":4374},[124],{"categories":4376},[139],{"categories":4378},[121],{"categories":4380},[76],{"categories":4382},[182],{"categories":4384},[],{"categories":4386},[182],{"categories":4388},[182],{"categories":4390},[182],{"categories":4392},[76],{"categories":4394},[76],{"categories":4396},[76],{"categories":4398},[121],{"categories":4400},[139],{"categories":4402},[76],{"categories":4404},[76],{"categories":4406},[76],{"categories":4408},[116],{"categories":4410},[76],{"categories":4412},[121],{"categories":4414},[168],{"categories":4416},[],{"categories":4418},[171],{"categories":4420},[121],{"categories":4422},[76],{"categories":4424},[],{"categories":4426},[76],{"categories":4428},[76],{"categories":4430},[139],{"categories":4432},[76],{"categories":4434},[121],{"categories":4436},[191],{"categories":4438},[],{"categories":4440},[],{"categories":4442},[139],{"categories":4444},[139],{"categories":4446},[76],{"categories":4448},[191],{"categories":4450},[76],{"categories":4452},[113],{"categories":4454},[121],{"categories":4456},[76],{"categories":4458},[121],{"categories":4460},[121],{"categories":4462},[76],{"categories":4464},[116],{"categories":4466},[],{"categories":4468},[171],{"categories":4470},[],{"categories":4472},[139],{"categories":4474},[76],{"categories":4476},[171],{"categories":4478},[76],{"categories":4480},[182],{"categories":4482},[182],{"categories":4484},[182],{"categories":4486},[121],{"categories":4488},[121],{"categories":4490},[168],{"categories":4492},[171],{"categories":4494},[171],{"categories":4496},[],{"categories":4498},[139],{"categories":4500},[76],{"categories":4502},[76],{"categories":4504},[182],{"categories":4506},[],{"categories":4508},[139],{"categories":4510},[139],{"categories":4512},[139],{"categories":4514},[],{"categories":4516},[121],{"categories":4518},[76],{"categories":4520},[],{"categories":4522},[113],{"categories":4524},[116],{"categories":4526},[],{"categories":4528},[76],{"categories":4530},[76],{"categories":4532},[],{"categories":4534},[182],{"categories":4536},[],{"categories":4538},[],{"categories":4540},[],{"categories":4542},[],{"categories":4544},[76],{"categories":4546},[139],{"categories":4548},[],{"categories":4550},[],{"categories":4552},[76],{"categories":4554},[76],{"categories":4556},[76],{"categories":4558},[171],{"categories":4560},[76],{"categories":4562},[171],{"categories":4564},[],{"categories":4566},[171],{"categories":4568},[171],{"categories":4570},[216],{"categories":4572},[121],{"categories":4574},[182],{"categories":4576},[],{"categories":4578},[],{"categories":4580},[171],{"categories":4582},[182],{"categories":4584},[182],{"categories":4586},[182],{"categories":4588},[],{"categories":4590},[113],{"categories":4592},[182],{"categories":4594},[182],{"categories":4596},[113],{"categories":4598},[182],{"categories":4600},[116],{"categories":4602},[182],{"categories":4604},[182],{"categories":4606},[182],{"categories":4608},[171],{"categories":4610},[139],{"categories":4612},[139],{"categories":4614},[76],{"categories":4616},[182],{"categories":4618},[171],{"categories":4620},[216],{"categories":4622},[171],{"categories":4624},[171],{"categories":4626},[171],{"categories":4628},[],{"categories":4630},[116],{"categories":4632},[],{"categories":4634},[216],{"categories":4636},[182],{"categories":4638},[182],{"categories":4640},[182],{"categories":4642},[121],{"categories":4644},[139,116],{"categories":4646},[171],{"categories":4648},[],{"categories":4650},[],{"categories":4652},[171],{"categories":4654},[],{"categories":4656},[171],{"categories":4658},[139],{"categories":4660},[121],{"categories":4662},[],{"categories":4664},[182],{"categories":4666},[76],{"categories":4668},[168],{"categories":4670},[],{"categories":4672},[76],{"categories":4674},[],{"categories":4676},[139],{"categories":4678},[113],{"categories":4680},[171],{"categories":4682},[],{"categories":4684},[182],{"categories":4686},[139],[4688,4811,4913,5058],{"id":4689,"title":4690,"ai":4691,"body":4696,"categories":4781,"created_at":77,"date_modified":77,"description":69,"extension":78,"faq":77,"featured":79,"kicker_label":77,"meta":4782,"navigation":92,"path":4795,"published_at":4796,"question":77,"scraped_at":4797,"seo":4798,"sitemap":4799,"source_id":4800,"source_name":4801,"source_type":4802,"source_url":4803,"stem":4804,"tags":4805,"thumbnail_url":4806,"tldr":4807,"tweet":4808,"unknown_tags":4809,"__hash__":4810},"summaries\u002Fsummaries\u002F1ac17c99e1a87b1f-scaling-transformer-training-to-5-million-tokens-summary.md","Scaling Transformer Training to 5 Million Tokens",{"provider":7,"model":8,"input_tokens":4692,"output_tokens":4693,"processing_time_ms":4694,"cost_usd":4695},6017,673,3862,0.00251375,{"type":14,"value":4697,"toc":4775},[4698,4702,4705,4709,4712,4744,4748,4751,4755],[17,4699,4701],{"id":4700},"the-memory-bottleneck-in-long-context-training","The Memory Bottleneck in Long-Context Training",[22,4703,4704],{},"Training standard transformer models with massive context windows (e.g., 3M+ tokens) faces two primary constraints: quadratic computational complexity and linear memory growth. Even on high-end hardware like an 8xH100 node, standard implementations fail because the model parameters and attention activations quickly exceed available GPU memory.",[17,4706,4708],{"id":4707},"the-stack-of-optimization-techniques","The Stack of Optimization Techniques",[22,4710,4711],{},"To reach a 3-million token context, a layered approach is required to manage memory usage:",[33,4713,4714,4720,4726,4732,4738],{},[36,4715,4716,4719],{},[39,4717,4718],{},"Fully Sharded Data Parallelism (FSDP):"," Distributes model parameters across all available GPUs to prevent memory exhaustion from the model weights alone.",[36,4721,4722,4725],{},[39,4723,4724],{},"DeepSpeed Ulysses:"," A context parallelism technique that distributes attention heads across GPUs. Instead of every GPU computing the full sequence, each GPU handles specific heads, reducing activation memory by approximately 8x.",[36,4727,4728,4731],{},[39,4729,4730],{},"Activation Checkpointing:"," Recomputes activations during the backward pass rather than storing them, providing another 8x reduction in memory usage.",[36,4733,4734,4737],{},[39,4735,4736],{},"CPU Offloading:"," Moves transformer block inputs to CPU memory when not actively needed for backpropagation, prefetching them just-in-time to minimize performance impact.",[36,4739,4740,4743],{},[39,4741,4742],{},"Chunked Sequence Training:"," Tiles element-wise operations (like loss calculations and MLPs) across the sequence length to avoid allocating massive buffers that scale linearly with the token count.",[17,4745,4747],{"id":4746},"untied-ulysses-pushing-to-5-million-tokens","Untied Ulysses: Pushing to 5 Million Tokens",[22,4749,4750],{},"To surpass the 3-million token limit, the team developed \"Untied Ulysses.\" This technique refines context parallelism by further chunking attention heads. Instead of allocating a single large buffer per head group, the system iterates through smaller chunks of heads, reusing the same memory buffers across iterations. This significantly lowers activation memory requirements with negligible impact on throughput.",[17,4752,4754],{"id":4753},"practical-implementation-advice","Practical Implementation Advice",[33,4756,4757,4763,4769],{},[36,4758,4759,4762],{},[39,4760,4761],{},"Profiling is critical:"," Use tools like the PyTorch Profiler to identify exactly where memory is being consumed, as bottlenecks often appear in unexpected places.",[36,4764,4765,4768],{},[39,4766,4767],{},"Trade-offs:"," There is a direct relationship between chunk size and throughput. Larger chunks increase memory utilization but can improve overall training speed.",[36,4770,4771,4774],{},[39,4772,4773],{},"Reinvesting Memory:"," By stacking these optimizations, you can free up memory that can be reinvested into other training stages or used to push context lengths even further.",{"title":69,"searchDepth":70,"depth":70,"links":4776},[4777,4778,4779,4780],{"id":4700,"depth":70,"text":4701},{"id":4707,"depth":70,"text":4708},{"id":4746,"depth":70,"text":4747},{"id":4753,"depth":70,"text":4754},[76],{"content_references":4783,"triage":4791},[4784,4788],{"type":83,"title":4785,"author":4786,"context":4787},"DeepSpeed Ulysses","Microsoft","cited",{"type":83,"title":4789,"context":4790},"PyTorch Profiler","recommended",{"relevance":4792,"novelty":88,"quality":88,"actionability":88,"composite":4793,"reasoning":4794},5,4.35,"Category: AI & LLMs. The article provides in-depth techniques for optimizing transformer training, directly addressing the audience's need for practical applications in AI model development. It discusses specific methods like Fully Sharded Data Parallelism and Untied Ulysses, which are actionable for developers looking to implement long-context training.","\u002Fsummaries\u002F1ac17c99e1a87b1f-scaling-transformer-training-to-5-million-tokens-summary","2026-06-08 17:00:21","2026-06-09 12:56:17",{"title":4690,"description":69},{"loc":4795},"1ac17c99e1a87b1f","AI Engineer","video","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=TUnPNY4E2fw","summaries\u002F1ac17c99e1a87b1f-scaling-transformer-training-to-5-million-tokens-summary",[103,105,106,104],"https:\u002F\u002Fi.ytimg.com\u002Fvi\u002FTUnPNY4E2fw\u002Fhqdefault.jpg","To train models with multi-million token contexts, you must stack memory-optimization techniques—including context parallelism, activation checkpointing, and a novel method called 'Untied Ulysses'—to bypass GPU memory bottlenecks.","This is a technical breakdown of the memory-optimization stack required to train models on extremely long context windows (up to 5 million tokens). The speaker details how to combine standard techniques like [DeepSpeed Ulysses](https:\u002F\u002Fgithub.com\u002Fmicrosoft\u002FDeepSpeed) and activation checkpointing with their own \"Untied Ulysses\" method to reduce memory overhead by chunking and reusing attention buffers.",[],"vdZh7ZzpnTzdTG3G79QASc2ywoHe_prr-WYngZH8xkI",{"id":4812,"title":4813,"ai":4814,"body":4819,"categories":4887,"created_at":77,"date_modified":77,"description":69,"extension":78,"faq":77,"featured":79,"kicker_label":77,"meta":4888,"navigation":92,"path":4901,"published_at":4902,"question":77,"scraped_at":4903,"seo":4904,"sitemap":4905,"source_id":4906,"source_name":98,"source_type":99,"source_url":4907,"stem":4908,"tags":4909,"thumbnail_url":77,"tldr":4910,"tweet":77,"unknown_tags":4911,"__hash__":4912},"summaries\u002Fsummaries\u002Fbeb19294561867ca-benchmarking-llm-compression-fp8-gptq-and-smoothqu-summary.md","Benchmarking LLM Compression: FP8, GPTQ, and SmoothQuant",{"provider":7,"model":8,"input_tokens":4815,"output_tokens":4816,"processing_time_ms":4817,"cost_usd":4818},10756,674,2766,0.0037,{"type":14,"value":4820,"toc":4883},[4821,4825,4833,4853,4857,4860,4880],[17,4822,4824],{"id":4823},"quantization-strategies-for-llm-efficiency","Quantization Strategies for LLM Efficiency",[22,4826,4827,4828,4832],{},"Post-training quantization (PTQ) is essential for deploying LLMs in resource-constrained environments. This tutorial demonstrates three distinct approaches using the ",[4829,4830,4831],"code",{},"llmcompressor"," library to reduce model footprint and improve inference speed while maintaining output quality:",[33,4834,4835,4841,4847],{},[36,4836,4837,4840],{},[39,4838,4839],{},"FP8 Dynamic Quantization:"," A data-free approach that compresses linear layers into 8-bit precision while keeping the language modeling head in higher precision. It is the fastest to implement and provides a baseline for efficiency gains.",[36,4842,4843,4846],{},[39,4844,4845],{},"GPTQ W4A16:"," A more aggressive compression method that reduces weights to 4-bit while maintaining 16-bit activation precision. This requires a calibration dataset (in this case, 256 samples from UltraChat) to minimize reconstruction error, resulting in significantly smaller model sizes.",[36,4848,4849,4852],{},[39,4850,4851],{},"SmoothQuant + GPTQ W8A8:"," An advanced pipeline that addresses activation outliers using SmoothQuant (smoothing strength 0.8) before applying 8-bit quantization. This combination balances accuracy recovery with the performance benefits of 8-bit operations.",[17,4854,4856],{"id":4855},"benchmarking-and-deployment-workflow","Benchmarking and Deployment Workflow",[22,4858,4859],{},"To evaluate these methods, the implementation establishes a standardized benchmarking suite that measures:",[33,4861,4862,4868,4874],{},[36,4863,4864,4867],{},[39,4865,4866],{},"Disk Size:"," Total storage footprint in GB.",[36,4869,4870,4873],{},[39,4871,4872],{},"Perplexity (PPL):"," Evaluated on the WikiText-2 dataset to ensure compression hasn't degraded model reasoning.",[36,4875,4876,4879],{},[39,4877,4878],{},"Generation Latency & Throughput:"," Measured in seconds and tokens per second (tok\u002Fs) using a consistent prompt.",[22,4881,4882],{},"The workflow emphasizes a \"save-and-test\" cycle, where each compressed model is saved as a reusable artifact. By comparing the FP16 baseline against these quantized variants, developers can make informed trade-offs between model size and inference performance, creating a repeatable pipeline for production-ready model deployment.",{"title":69,"searchDepth":70,"depth":70,"links":4884},[4885,4886],{"id":4823,"depth":70,"text":4824},{"id":4855,"depth":70,"text":4856},[76],{"content_references":4889,"triage":4898},[4890,4892,4896],{"type":83,"title":4831,"url":4891,"context":4790},"https:\u002F\u002Fgithub.com\u002Fvllm-project\u002Fllm-compressor",{"type":4893,"title":4894,"url":4895,"context":4787},"dataset","UltraChat 200k","https:\u002F\u002Fhuggingface.co\u002Fdatasets\u002FHuggingFaceH4\u002Fultrachat_200k",{"type":4893,"title":4897,"context":4787},"WikiText-2",{"relevance":4792,"novelty":88,"quality":88,"actionability":4792,"composite":4899,"reasoning":4900},4.55,"Category: AI & LLMs. The article provides a detailed practical guide on compressing LLMs, addressing a core topic of AI engineering with actionable insights on quantization strategies. It includes specific methods and a benchmarking workflow that developers can implement directly in their projects.","\u002Fsummaries\u002Fbeb19294561867ca-benchmarking-llm-compression-fp8-gptq-and-smoothqu-summary","2026-05-17 18:19:09","2026-05-17 18:48:19",{"title":4813,"description":69},{"loc":4901},"beb19294561867ca","https:\u002F\u002Fwww.marktechpost.com\u002F2026\u002F05\u002F17\u002Fa-coding-implementation-to-compress-and-benchmark-instruction-tuned-llms-with-fp8-gptq-and-smoothquant-quantization-using-llmcompressor\u002F","summaries\u002Fbeb19294561867ca-benchmarking-llm-compression-fp8-gptq-and-smoothqu-summary",[103,104,106,105],"A practical guide to compressing instruction-tuned LLMs using llmcompressor, comparing FP8 dynamic, GPTQ W4A16, and SmoothQuant W8A8 quantization strategies across size, latency, and perplexity.",[],"30L_xT8fTg-Uhmof_yAXXdldKTf6tCZLD87bHm4DkII",{"id":4914,"title":4915,"ai":4916,"body":4922,"categories":5019,"created_at":77,"date_modified":77,"description":69,"extension":78,"faq":77,"featured":79,"kicker_label":77,"meta":5020,"navigation":92,"path":5046,"published_at":77,"question":77,"scraped_at":5047,"seo":5048,"sitemap":5049,"source_id":5050,"source_name":5051,"source_type":99,"source_url":5052,"stem":5053,"tags":5054,"thumbnail_url":77,"tldr":5055,"tweet":77,"unknown_tags":5056,"__hash__":5057},"summaries\u002Fsummaries\u002Fbb2ba5cfd07cd36e-flashattention-2-4x-faster-exact-attention-on-gpus-summary.md","FlashAttention: 2-4x Faster Exact Attention on GPUs",{"provider":7,"model":4917,"input_tokens":4918,"output_tokens":4919,"processing_time_ms":4920,"cost_usd":4921},"x-ai\u002Fgrok-4.1-fast",9962,2114,53702,0.0025421,{"type":14,"value":4923,"toc":5013},[4924,4928,4931,4934,4938,4949,4960,4964,4983,5002,5006],[17,4925,4927],{"id":4926},"io-aware-kernel-design-cuts-memory-and-boosts-speed","IO-Aware Kernel Design Cuts Memory and Boosts Speed",[22,4929,4930],{},"FlashAttention computes exact attention without storing the full N^2 attention matrix or gradients, using GPU tiling to maximize SRAM usage and minimize HBM reads\u002Fwrites. This yields 2-4x end-to-end speedups in transformer training on A100 GPUs (e.g., 2.4x for GPT-2 style models) and 3-5x memory savings, enabling longer sequences like 64k tokens on single A100 vs. 16k baseline. Backward pass fuses dP computation with dV, avoiding extra softmax. FlashAttention-2 improves parallelism with better work partitioning (50-73% TFLOPS utilization on A100), supports bf16 on Ampere+, head dims to 256, causal masks aligned to bottom-right for decoder use, and sliding window attention (window_size=(left,right)).",[22,4932,4933],{},"Trade-offs: Requires Ampere+ GPUs (A100\u002FRTX30\u002F40\u002FH100); head dim >192 backward needed A100\u002FH100 originally but now works on consumer GPUs without dropout since v2.5.5. Deterministic backward option trades minor speed\u002Fmemory for reproducibility.",[17,4935,4937],{"id":4936},"installation-matches-hardware-for-peak-performance","Installation Matches Hardware for Peak Performance",[22,4939,4940,4941,4944,4945,4948],{},"Install via ",[4829,4942,4943],{},"pip install flash-attn --no-build-isolation"," (3-5 min compile with ninja on 64-core, CUDA 12+). Needs PyTorch 2.2+, packaging\u002Fpsutil\u002Fninja. Limit jobs with ",[4829,4946,4947],{},"MAX_JOBS=4"," on low-RAM machines. ROCm 6.0+ supports MI200+\u002FRDNA3\u002F4 GPUs via composable_kernel (default, fp16\u002Fbf16 fwd\u002Fbwd) or Triton backend (fp16\u002Fbf16\u002Ffp32, causal\u002FMQA\u002FGQA\u002Fpaged\u002FFP8). Use Nvidia\u002FROCm PyTorch containers for deps.",[22,4950,4951,4952,4955,4956,4959],{},"Beta FlashAttention-3 (H100\u002FH800, CUDA 12.3+, FP16\u002FBF16 fwd\u002Fbwd, FP8 fwd) via separate install; FlashAttention-4 (CuTeDSL, H100\u002FB200, ",[4829,4953,4954],{},"pip install flash-attn-4[cu13]",") for Hopper\u002FBlackwell. Huggingface kernels offer drop-in via ",[4829,4957,4958],{},"get_kernel('kernels-community\u002Fflash-attn2')",".",[17,4961,4963],{"id":4962},"usage-replaces-standard-attention-with-kv-cache-support","Usage Replaces Standard Attention with KV Cache Support",[22,4965,4966,4967,4970,4971,4974,4975,4978,4979,4982],{},"Core: ",[4829,4968,4969],{},"out = flash_attn_func(q, k, v, softmax_scale=1\u002Fmath.sqrt(d), causal=True, dropout_p=0.0)"," or ",[4829,4972,4973],{},"flash_attn_qkvpacked_func(qkv)"," for packed inputs (faster bwd). Supports MQA\u002FGQA (nheads_Q % nheads_KV == 0), ALiBi (",[4829,4976,4977],{},"alibi_slopes","), softcapping (Gemma\u002FGrok), paged KV cache (",[4829,4980,4981],{},"block_table","), variable seq lens.",[22,4984,4985,4986,4989,4990,4993,4994,4997,4998,5001],{},"Inference: ",[4829,4987,4988],{},"flash_attn_with_kvcache(q, k_cache, v_cache, k=new_k, v=new_v, rotary_cos\u002Fsin, cache_seqlens)"," updates cache inplace, applies RoPE, causal\u002Flocal masks. Example causal mask for seqlen_q=2, seqlen_k=5: attends to last 2+3 positions bottom-right aligned. Integrate in MHA via ",[4829,4991,4992],{},"flash_attn\u002Fmodules\u002Fmha.py",". Set ",[4829,4995,4996],{},"dropout_p=0.0"," eval; ",[4829,4999,5000],{},"deterministic=True"," bwd for reproducibility.",[17,5003,5005],{"id":5004},"evolutions-unlock-new-workloads","Evolutions Unlock New Workloads",[22,5007,5008,5009,5012],{},"v2.0: 2x faster rewrite, ",[4829,5010,5011],{},"flash_attn_varlen_*"," for ragged batches. v2.1+: Causal realignment, inference opts (split KV load for seqlen_q=1). v2.3+: Sliding window (Mistral 7B). v2.4+: ALiBi, deterministic bwd. v2.5+: PagedAttention. v2.6+: Softcap. v2.7+: torch.compile compat. Widely adopted (usage.md lists integrations).",{"title":69,"searchDepth":70,"depth":70,"links":5014},[5015,5016,5017,5018],{"id":4926,"depth":70,"text":4927},{"id":4936,"depth":70,"text":4937},{"id":4962,"depth":70,"text":4963},{"id":5004,"depth":70,"text":5005},[76],{"content_references":5021,"triage":5044},[5022,5027,5031,5034,5037,5041],{"type":5023,"title":5024,"author":5025,"url":5026,"context":4787},"paper","FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness","Tri Dao, Daniel Y. Fu, Stefano Ermon, Atri Rudra, Christopher Ré","https:\u002F\u002Farxiv.org\u002Fabs\u002F2205.14135",{"type":5023,"title":5028,"author":5029,"url":5030,"context":4787},"FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning","Tri Dao","https:\u002F\u002Ftridao.me\u002Fpublications\u002Fflash2\u002Fflash2.pdf",{"type":5023,"title":5032,"author":5029,"url":5033,"context":4787},"FlashAttention-3","https:\u002F\u002Ftridao.me\u002Fpublications\u002Fflash3\u002Fflash3.pdf",{"type":5023,"title":5035,"url":5036,"context":4787},"PagedAttention","https:\u002F\u002Farxiv.org\u002Fabs\u002F2309.06180",{"type":5038,"title":5039,"url":5040,"context":86},"other","IEEE Spectrum article on MLPerf 2.0","https:\u002F\u002Fspectrum.ieee.org\u002Fmlperf-rankings-2022",{"type":83,"title":5042,"url":5043,"context":4790},"huggingface\u002Fkernels","https:\u002F\u002Fgithub.com\u002Fhuggingface\u002Fkernels",{"relevance":4792,"novelty":88,"quality":88,"actionability":88,"composite":4793,"reasoning":5045},"Category: AI & LLMs. The article provides a detailed explanation of how to implement FlashAttention to improve transformer training efficiency, addressing a specific pain point for AI developers looking to optimize performance. It includes practical installation instructions and usage examples, making it actionable for the target audience.","\u002Fsummaries\u002Fbb2ba5cfd07cd36e-flashattention-2-4x-faster-exact-attention-on-gpus-summary","2026-04-16 03:01:06",{"title":4915,"description":69},{"loc":5046},"bb2ba5cfd07cd36e","__oneoff__","https:\u002F\u002Fgithub.com\u002FDao-AILab\u002Fflash-attention","summaries\u002Fbb2ba5cfd07cd36e-flashattention-2-4x-faster-exact-attention-on-gpus-summary",[103,105,106,104],"Replace PyTorch's scaled_dot_product_attention with FlashAttention kernels to cut transformer training memory by 3x+ and speed up by 2-4x via IO-aware tiling that fuses softmax and skips materializing N^2 attention matrix.",[],"p9Q0kYcZPBLc6PM17T6f5gjDVL-qvZ13UNiKPL_ijhY",{"id":5059,"title":5060,"ai":5061,"body":5066,"categories":5161,"created_at":77,"date_modified":77,"description":69,"extension":78,"faq":77,"featured":79,"kicker_label":77,"meta":5162,"navigation":92,"path":5178,"published_at":5179,"question":77,"scraped_at":5180,"seo":5181,"sitemap":5182,"source_id":5183,"source_name":5184,"source_type":99,"source_url":5185,"stem":5186,"tags":5187,"thumbnail_url":77,"tldr":5188,"tweet":77,"unknown_tags":5189,"__hash__":5190},"summaries\u002Fsummaries\u002F3082c3466d222001-ground-gemini-3-in-pdb-geometry-for-hallucination-summary.md","Ground Gemini 3 in PDB Geometry for Hallucination-Free Proteomics",{"provider":7,"model":4917,"input_tokens":5062,"output_tokens":5063,"processing_time_ms":5064,"cost_usd":5065},6594,2415,25922,0.00201945,{"type":14,"value":5067,"toc":5156},[5068,5072,5075,5142,5146,5149,5153],[17,5069,5071],{"id":5070},"build-deterministic-protein-analysis-pipeline","Build Deterministic Protein Analysis Pipeline",[22,5073,5074],{},"Parse PDB files like 6M0J (SARS-CoV-2 Spike RBD bound to human ACE2) with Biopython's Bio.PDB to extract Cα backbone coordinates, reducing noise from side chains. Differentiate chains visually: Chain A (ACE2 receptor) in red, Chain E (viral Spike RBD) in blue. Use Plotly's go.Scatter3d to create connected 3D traces of the backbone, exporting as PNG for multimodal input. Configure Gemini 3 Pro API with types.ThinkingConfig(thinking_level='HIGH') and tools like run_simulation for agentic execution. Prompt combines image and text to analyze 'Red vs. Blue' spatial conflict as a molecular gateway, translating coordinates into pathogenic risk and therapeutic targets. This grounds AI in physical geometry, bypassing probabilistic text patterns.",[5076,5077,5078,5094],"table",{},[5079,5080,5081],"thead",{},[5082,5083,5084,5088,5091],"tr",{},[5085,5086,5087],"th",{},"Component",[5085,5089,5090],{},"Responsibility",[5085,5092,5093],{},"Stack",[5095,5096,5097,5109,5120,5131],"tbody",{},[5082,5098,5099,5103,5106],{},[5100,5101,5102],"td",{},"PDB Loader",[5100,5104,5105],{},"Retrieves ground truth data",[5100,5107,5108],{},"Biopython",[5082,5110,5111,5114,5117],{},[5100,5112,5113],{},"Geometric Engine",[5100,5115,5116],{},"Maps to 3D colored chains",[5100,5118,5119],{},"Plotly",[5082,5121,5122,5125,5128],{},[5100,5123,5124],{},"Multimodal Processor",[5100,5126,5127],{},"Interprets conflict",[5100,5129,5130],{},"Gemini 3 Pro (High Thinking)",[5082,5132,5133,5136,5139],{},[5100,5134,5135],{},"Agentic Controller",[5100,5137,5138],{},"Calls simulations",[5100,5140,5141],{},"Gemini SDK",[17,5143,5145],{"id":5144},"extract-actionable-insights-from-binding-interfaces","Extract Actionable Insights from Binding Interfaces",[22,5147,5148],{},"Gemini identifies the red-blue merge as the high-affinity contact zone enabling viral membrane fusion, the key target for neutralizing antibodies and vaccines. It frames ACE2 as cellular 'gateway' and Spike RBD as 'key', emphasizing physical obstruction for immunity. For drug discovery, it highlights PPIs' flat surfaces as traditionally undruggable but spots subtle energetic hotspots via coordinate precision. This accelerates in silico design of small-molecule inhibitors that wedge into the interface, cutting wet-lab costs and carbon footprint before trials. Aligns 6M0J as training data for AlphaFold 3, enabling AI to predict 'druggable pockets' invisible in static models.",[17,5150,5152],{"id":5151},"enforce-geometric-governance-to-kill-hallucinations","Enforce Geometric Governance to Kill Hallucinations",[22,5154,5155],{},"Anchor multimodal LLMs in PDB coordinates for verifiable reasoning: AI measures Cα distances, not linguistic probabilities, creating auditable 'ground truth' trails. Visual Plotly renders allow human experts to verify contact zones. H2E framework demands this accountability, evolving agents from observers to executors via tools. Scales to Sovereign AI with local A100\u002FL4 GPUs and vLLM quantization for data privacy and low-latency in aerospace (e.g., Orion ECLSS) or proteomics. Shifts from black-box hallucinations to physics-based certainty, blueprint for safety-critical domains like molecular diagnostics.",{"title":69,"searchDepth":70,"depth":70,"links":5157},[5158,5159,5160],{"id":5070,"depth":70,"text":5071},{"id":5144,"depth":70,"text":5145},{"id":5151,"depth":70,"text":5152},[],{"content_references":5163,"triage":5176},[5164,5167,5169,5172,5174],{"type":5038,"title":5165,"url":5166,"context":4787},"ALPHAFOLD3_GEMINI3.ipynb","https:\u002F\u002Fgithub.com\u002Ffrank-morales2020\u002FMLxDL\u002Fblob\u002Fmain\u002FALPHAFOLD3_GEMINI3.ipynb",{"type":4893,"title":5168,"context":4787},"6M0J PDB structure",{"type":5038,"title":5170,"url":5171,"context":4787},"The Wall Before the Word: H2E Geometric Governance and the Future of AI Government","https:\u002F\u002Fmedium.com\u002Fai-simplified-in-plain-english\u002Fthe-wall-before-the-word-h2e-geometric-governance-and-the-future-of-ai-government-89ff82c7598a",{"type":83,"title":5173,"context":86},"AlphaFold 3",{"type":83,"title":5175,"context":4787},"Gemini 3 Pro",{"relevance":4792,"novelty":88,"quality":88,"actionability":88,"composite":4793,"reasoning":5177},"Category: AI & LLMs. The article provides a detailed approach to building a deterministic protein analysis pipeline using AI tools, which directly addresses the audience's need for practical applications in AI-powered product development. It includes specific tools like Biopython and Plotly, and actionable insights for drug discovery, making it highly relevant and actionable.","\u002Fsummaries\u002F3082c3466d222001-ground-gemini-3-in-pdb-geometry-for-hallucination-summary","2026-04-19 20:16:41","2026-04-21 15:26:18",{"title":5060,"description":69},{"loc":5178},"3082c3466d222001","AI Simplified in Plain English","https:\u002F\u002Fmedium.com\u002Fai-simplified-in-plain-english\u002Fthe-convergence-of-geometric-governance-and-multimodal-ai-in-safety-critical-proteomics-with-fa8c6ba20303?source=rss----f37ab7d4e76b---4","summaries\u002F3082c3466d222001-ground-gemini-3-in-pdb-geometry-for-hallucination-summary",[103,104,105,106],"Use Biopython and Plotly to feed 3D protein structures (Red ACE2 vs. Blue Spike RBD in 6M0J PDB) into Gemini 3 Pro's high-thinking mode, enabling deterministic analysis of binding interfaces for drug discovery and safety-critical diagnostics.",[],"o-uBIXwAi0RF4UM-9FRaIfNxARtfo32iiM51omEjd0w"]