[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"summary-gemma-4-efficient-architectures-power-top-small-op-summary":3,"summaries-facets-categories":101,"summary-related-gemma-4-efficient-architectures-power-top-small-op-summary":4507},{"id":4,"title":5,"ai":6,"body":13,"categories":66,"created_at":67,"date_modified":67,"description":59,"extension":68,"faq":67,"featured":69,"kicker_label":67,"meta":70,"navigation":82,"path":83,"published_at":84,"question":67,"scraped_at":85,"seo":86,"sitemap":87,"source_id":88,"source_name":89,"source_type":90,"source_url":91,"stem":92,"tags":93,"thumbnail_url":67,"tldr":98,"tweet":67,"unknown_tags":99,"__hash__":100},"summaries\u002Fsummaries\u002Fgemma-4-efficient-architectures-power-top-small-op-summary.md","Gemma 4: Efficient Architectures Power Top Small Open Models",{"provider":7,"model":8,"input_tokens":9,"output_tokens":10,"processing_time_ms":11,"cost_usd":12},"openrouter","x-ai\u002Fgrok-4.1-fast",6884,1873,18188,0.00229065,{"type":14,"value":15,"toc":58},"minimark",[16,21,25,28,32,35,38,42,45,48,51,55],[17,18,20],"h2",{"id":19},"model-sizes-and-capabilities-set-new-benchmarks-for-open-efficiency","Model Sizes and Capabilities Set New Benchmarks for Open Efficiency",[22,23,24],"p",{},"Gemma 4 launches four variants optimized for distinct use cases: effective 2B (2.3B active params, 5.1B representational) and 4B for on-device text\u002Fvision\u002Faudio on phones\u002Flaptops; 26B MoE (3.9B active params from 128 experts, activating 8 per pass) for efficient inference; and 31B dense for advanced reasoning. The 31B ranks #3 on global AI leaderboards, outperforming models 20x larger, with both large models in LMSYS Arena's top 6. All support 256k context, native function calling, structured JSON, and agentic workflows. Switch to Apache 2.0 license enables seamless dev cycles from prototyping to deployment, downloadable from Hugging Face\u002FKaggle\u002FOllama or cloud-hosted on AI Studio\u002FVertex.",[22,26,27],{},"Small models excel in coding, multilingual, and multimodal benchmarks, surpassing Gemma 3 by wide margins—e.g., effective 2B\u002F4B handle vision\u002Ftext\u002Faudio inputs with text outputs, ideal for speech recognition\u002Ftranslation without API costs.",[17,29,31],{"id":30},"attention-optimizations-balance-speed-and-context","Attention Optimizations Balance Speed and Context",[22,33,34],{},"Dense models (31B, effective 2B\u002F4B) use 5:1 local:global attention ratio (4:1 in 2B), with sliding windows of 512 tokens (small) or 1024 (large) in local layers, ending on a global layer attending all prior tokens. Grouped Query Attention (GQA) groups 2 queries per KV head locally (256 dim) and 8 globally (doubled to 512 dim), cutting memory costs while preserving performance—enabling efficient long-context reasoning without full recompute overhead.",[22,36,37],{},"For MoE (OURE architecture in 26B), a shared router expert (3x regular size) selects 8 from 128 small FFNN experts per pass, matching 31B performance at lower active params for scalable inference.",[17,39,41],{"id":40},"per-layer-embeddings-and-multimodality-drive-on-device-gains","Per-Layer Embeddings and Multimodality Drive On-Device Gains",[22,43,44],{},"Effective models use Per-Layer Embeddings (PLE): standard token embeddings (1536 dim in 2B, 2560 in 4B) plus 256-dim per-layer tables (35 layers in 2B, 42 in 4B) stored in flash memory, not VRAM—projected up at layer end to slash on-device memory bottlenecks and boost inference speed.",[22,46,47],{},"Vision (all models) adds variable aspect ratios\u002Fresolutions in 5 budgets (up to 1120 soft tokens), processing 16x16 patches into 3x3 grids for pooled embeddings—e.g., 280-token budget yields 2520 patches. Avoids Gemma 3's pan\u002Fscan by preserving spatial positions, suiting OCR\u002Fobject detection (high res) or text-heavy apps (low res). Encoders: 550M params (large), 150M (small).",[22,49,50],{},"Audio (effective models) uses 35M conformer encoder: raw audio → MEL spectrogram → conv downsample to n\u002F4 soft tokens, enabling translation\u002Fspeech rec without sequential processing.",[17,52,54],{"id":53},"practical-deployment-trade-offs","Practical Deployment Trade-offs",[22,56,57],{},"On-device effective models prioritize flash\u002FVRAM efficiency for local runs, trading some representational params for speed. Large models favor reasoning\u002Fcoding via dense depth or MoE sparsity. Developers allocate image tokens dynamically (e.g., high for spatial tasks), test agentic flows in cloud, then quantize for edge—yielding production-ready open systems rivaling closed giants at sub-31B scale.",{"title":59,"searchDepth":60,"depth":60,"links":61},"",2,[62,63,64,65],{"id":19,"depth":60,"text":20},{"id":30,"depth":60,"text":31},{"id":40,"depth":60,"text":41},{"id":53,"depth":60,"text":54},[],null,"md",false,{"content_references":71,"triage":77},[72],{"type":73,"title":74,"url":75,"context":76},"other","Cassidy Hardin LinkedIn Profile","https:\u002F\u002Fuk.linkedin.com\u002Fin\u002Fcassidyhardin","mentioned",{"relevance":78,"novelty":78,"quality":79,"actionability":60,"composite":80,"reasoning":81},3,4,3.05,"Category: AI & LLMs. The article discusses the capabilities and optimizations of the Gemma 4 models, which are relevant to AI engineering and model architecture. However, it lacks practical applications or frameworks that the audience can directly implement in their projects.",true,"\u002Fsummaries\u002Fgemma-4-efficient-architectures-power-top-small-op-summary","2026-04-27 23:00:06","2026-04-28 15:07:55",{"title":5,"description":59},{"loc":83},"5aa5005d4bd57d8a","AI Engineer","article","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=_A367W_qvc8","summaries\u002Fgemma-4-efficient-architectures-power-top-small-op-summary",[94,95,96,97],"llm","open-source","machine-learning","ai-llms","Gemma 4's 2B-31B models outperform priors with interleaved attention, MoE (26B activates 3.9B params), PLE for on-device, and native multimodal support, ranking top 6 on LMSYS Arena under Apache 2.0.",[97],"0hpUXP0lpqBMUNnqZpA3dh7p2rLC-2s8m4049Mqk_b8",[102,105,107,110,112,115,118,121,124,126,128,130,132,134,136,138,141,143,145,147,149,151,153,156,158,160,162,164,166,168,170,172,174,176,178,180,182,184,186,188,190,192,194,196,198,201,203,205,207,209,211,213,215,217,219,221,223,225,227,229,231,233,235,237,239,241,243,245,247,249,251,253,255,257,259,261,263,265,267,269,271,273,275,277,279,281,283,285,287,289,291,293,295,297,299,301,303,305,307,309,311,313,315,317,319,321,323,325,327,329,331,333,335,337,339,341,343,345,347,349,351,353,355,357,359,361,363,365,367,369,371,373,375,377,379,381,383,385,387,389,391,393,395,397,399,401,403,405,407,409,411,413,415,417,419,421,423,425,427,429,431,433,435,437,439,441,443,445,447,449,451,453,455,457,459,461,463,466,468,470,472,474,476,478,480,482,484,486,488,490,492,494,496,498,500,502,504,506,508,510,512,514,516,518,520,522,524,526,528,530,532,534,536,538,540,542,544,546,548,550,553,555,557,559,561,563,565,567,569,571,573,575,577,579,581,583,585,587,589,591,593,595,597,599,601,603,605,607,609,611,613,615,617,619,621,623,625,627,629,631,633,635,637,639,641,643,645,647,649,651,653,655,657,659,661,663,665,667,669,671,673,675,677,679,681,683,685,687,689,691,693,695,697,699,701,703,705,707,709,711,713,715,717,719,721,723,725,727,729,731,733,735,737,739,741,743,745,747,749,751,753,755,757,759,761,763,765,767,769,771,773,775,777,779,781,783,785,787,789,791,793,795,797,799,801,803,805,807,809,811,813,815,817,819,821,823,825,827,829,831,833,835,837,839,841,843,845,847,849,851,853,855,857,859,861,863,865,867,869,871,873,875,877,879,881,883,885,887,889,891,893,895,897,899,901,903,905,907,909,911,913,915,917,919,921,923,925,927,929,931,933,935,937,939,941,943,945,947,949,951,953,955,957,959,961,963,965,967,969,971,973,975,977,979,981,983,985,987,989,991,993,995,997,999,1001,1003,1005,1007,1009,1011,1013,1015,1017,1019,1021,1023,1025,1027,1029,1031,1033,1035,1037,1039,1041,1043,1045,1047,1049,1051,1053,1055,1057,1059,1061,1063,1065,1067,1069,1071,1073,1075,1077,1079,1081,1083,1085,1087,1089,1091,1093,1095,1097,1099,1101,1103,1105,1107,1109,1111,1113,1115,1117,1119,1121,1123,1125,1127,1129,1131,1133,1135,1137,1139,1141,1143,1145,1147,1149,1151,1153,1155,1157,1159,1161,1163,1165,1167,1169,1171,1173,1175,1177,1179,1181,1183,1185,1187,1189,1191,1193,1195,1197,1199,1201,1203,1205,1207,1209,1211,1213,1215,1217,1219,1221,1223,1225,1227,1229,1231,1233,1235,1237,1239,1241,1243,1245,1247,1249,1251,1253,1255,1257,1259,1261,1263,1265,1267,1269,1271,1273,1275,1277,1279,1281,1283,1285,1287,1289,1291,1293,1295,1297,1299,1301,1303,1305,1307,1309,1311,1313,1315,1317,1319,1321,1323,1325,1327,1329,1331,1333,1335,1337,1339,1341,1343,1345,1347,1349,1351,1353,1355,1357,1359,1361,1363,1365,1367,1369,1371,1373,1375,1377,1379,1381,1383,1385,1387,1389,1391,1393,1395,1397,1399,1401,1403,1405,1407,1409,1411,1413,1415,1417,1419,1421,1423,1425,1427,1429,1431,1433,1435,1437,1439,1441,1443,1445,1447,1449,1451,1453,1455,1457,1459,1461,1463,1465,1467,1469,1471,1473,1475,1477,1479,1481,1483,1485,1487,1489,1491,1493,1495,1497,1499,1501,1503,1505,1507,1509,1511,1513,1515,1517,1519,1521,1523,1525,1527,1529,1531,1533,1535,1537,1539,1541,1543,1545,1547,1549,1551,1553,1555,1557,1559,1561,1563,1565,1567,1569,1571,1573,1575,1577,1579,1581,1583,1585,1587,1589,1591,1593,1595,1597,1599,1601,1603,1605,1607,1609,1611,1613,1615,1617,1619,1621,1623,1625,1627,1629,1631,1633,1635,1637,1639,1641,1643,1645,1647,1649,1651,1653,1655,1657,1659,1661,1663,1665,1667,1669,1671,1673,1675,1677,1679,1681,1683,1685,1687,1689,1691,1693,1695,1697,1699,1701,1703,1705,1707,1709,1711,1713,1715,1717,1719,1721,1723,1725,1727,1729,1731,1733,1735,1737,1739,1741,1743,1745,1747,1749,1751,1753,1755,1757,1759,1761,1763,1765,1767,1769,1771,1773,1775,1777,1779,1781,1783,1785,1787,1789,1791,1793,1795,1797,1799,1801,1803,1805,1807,1809,1811,1813,1815,1817,1819,1821,1823,1825,1827,1829,1831,1833,1835,1837,1839,1841,1843,1845,1847,1849,1851,1853,1855,1857,1859,1861,1863,1865,1867,1869,1871,1873,1875,1877,1879,1881,1883,1885,1887,1889,1891,1893,1895,1897,1899,1901,1903,1905,1907,1909,1911,1913,1915,1917,1919,1921,1923,1925,1927,1929,1931,1933,1935,1937,1939,1941,1943,1945,1947,1949,1951,1953,1955,1957,1959,1961,1963,1965,1967,1969,1971,1973,1975,1977,1979,1981,1983,1985,1987,1989,1991,1993,1995,1997,1999,2001,2003,2005,2007,2009,2011,2013,2015,2017,2019,2021,2023,2025,2027,2029,2031,2033,2035,2037,2039,2041,2043,2045,2047,2049,2051,2053,2055,2057,2059,2061,2063,2065,2067,2069,2071,2073,2075,2077,2079,2081,2083,2085,2087,2089,2091,2093,2095,2097,2099,2101,2103,2105,2107,2109,2111,2113,2115,2117,2119,2121,2123,2125,2127,2129,2131,2133,2135,2137,2139,2141,2143,2145,2147,2149,2151,2153,2155,2157,2159,2161,2163,2165,2167,2169,2171,2173,2175,2177,2179,2181,2183,2185,2187,2189,2191,2193,2195,2197,2199,2201,2203,2205,2207,2209,2211,2213,2215,2217,2219,2221,2223,2225,2227,2229,2231,2233,2235,2237,2239,2241,2243,2245,2247,2249,2251,2253,2255,2257,2259,2261,2263,2265,2267,2269,2271,2273,2275,2277,2279,2281,2283,2285,2287,2289,2291,2293,2295,2297,2299,2301,2303,2305,2307,2309,2311,2313,2315,2317,2319,2321,2323,2325,2327,2329,2331,2333,2335,2337,2339,2341,2343,2345,2347,2349,2351,2353,2355,2357,2359,2361,2363,2365,2367,2369,2371,2373,2375,2377,2379,2381,2383,2385,2387,2389,2391,2393,2395,2397,2399,2401,2403,2405,2407,2409,2411,2413,2415,2417,2419,2421,2423,2425,2427,2429,2431,2433,2435,2437,2439,2441,2443,2445,2447,2449,2451,2453,2455,2457,2459,2461,2463,2465,2467,2469,2471,2473,2475,2477,2479,2481,2483,2485,2487,2489,2491,2493,2495,2497,2499,2501,2503,2505,2507,2509,2511,2513,2515,2517,2519,2521,2523,2525,2527,2529,2531,2533,2535,2537,2539,2541,2543,2545,2547,2549,2551,2553,2555,2557,2559,2561,2563,2565,2567,2569,2571,2573,2575,2577,2579,2581,2583,2585,2587,2589,2591,2593,2595,2597,2599,2601,2603,2605,2607,2609,2611,2613,2615,2617,2619,2621,2623,2625,2627,2629,2631,2633,2635,2637,2639,2641,2643,2645,2647,2649,2651,2653,2655,2657,2659,2661,2663,2665,2667,2669,2671,2673,2675,2677,2679,2681,2683,2685,2687,2689,2691,2693,2695,2697,2699,2701,2703,2705,2707,2709,2711,2713,2715,2717,2719,2721,2723,2725,2727,2729,2731,2733,2735,2737,2739,2741,2743,2745,2747,2749,2751,2753,2755,2757,2759,2761,2763,2765,2767,2769,2771,2773,2775,2777,2779,2781,2783,2785,2787,2789,2791,2793,2795,2797,2799,2801,2803,2805,2807,2809,2811,2813,2815,2817,2819,2821,2823,2825,2827,2829,2831,2833,2835,2837,2839,2841,2843,2845,2847,2849,2851,2853,2855,2857,2859,2861,2863,2865,2867,2869,2871,2873,2875,2877,2879,2881,2883,2885,2887,2889,2891,2893,2895,2897,2899,2901,2903,2905,2907,2909,2911,2913,2915,2917,2919,2921,2923,2925,2927,2929,2931,2933,2935,2937,2939,2941,2943,2945,2947,2949,2951,2953,2955,2957,2959,2961,2963,2965,2967,2969,2971,2973,2975,2977,2979,2981,2983,2985,2987,2989,2991,2993,2995,2997,2999,3001,3003,3005,3007,3009,3011,3013,3015,3017,3019,3021,3023,3025,3027,3029,3031,3033,3035,3037,3039,3041,3043,3045,3047,3049,3051,3053,3055,3057,3059,3061,3063,3065,3067,3069,3071,3073,3075,3077,3079,3081,3083,3085,3087,3089,3091,3093,3095,3097,3099,3101,3103,3105,3107,3109,3111,3113,3115,3117,3119,3121,3123,3125,3127,3129,3131,3133,3135,3137,3139,3141,3143,3145,3147,3149,3151,3153,3155,3157,3159,3161,3163,3165,3167,3169,3171,3173,3175,3177,3179,3181,3183,3185,3187,3189,3191,3193,3195,3197,3199,3201,3203,3205,3207,3209,3211,3213,3215,3217,3219,3221,3223,3225,3227,3229,3231,3233,3235,3237,3239,3241,3243,3245,3247,3249,3251,3253,3255,3257,3259,3261,3263,3265,3267,3269,3271,3273,3275,3277,3279,3281,3283,3285,3287,3289,3291,3293,3295,3297,3299,3301,3303,3305,3307,3309,3311,3313,3315,3317,3319,3321,3323,3325,3327,3329,3331,3333,3335,3337,3339,3341,3343,3345,3347,3349,3351,3353,3355,3357,3359,3361,3363,3365,3367,3369,3371,3373,3375,3377,3379,3381,3383,3385,3387,3389,3391,3393,3395,3397,3399,3401,3403,3405,3407,3409,3411,3413,3415,3417,3419,3421,3423,3425,3427,3429,3431,3433,3435,3437,3439,3441,3443,3445,3447,3449,3451,3453,3455,3457,3459,3461,3463,3465,3467,3469,3471,3473,3475,3477,3479,3481,3483,3485,3487,3489,3491,3493,3495,3497,3499,3501,3503,3505,3507,3509,3511,3513,3515,3517,3519,3521,3523,3525,3527,3529,3531,3533,3535,3537,3539,3541,3543,3545,3547,3549,3551,3553,3555,3557,3559,3561,3563,3565,3567,3569,3571,3573,3575,3577,3579,3581,3583,3585,3587,3589,3591,3593,3595,3597,3599,3601,3603,3605,3607,3609,3611,3613,3615,3617,3619,3621,3623,3625,3627,3629,3631,3633,3635,3637,3639,3641,3643,3645,3647,3649,3651,3653,3655,3657,3659,3661,3663,3665,3667,3669,3671,3673,3675,3677,3679,3681,3683,3685,3687,3689,3691,3693,3695,3697,3699,3701,3703,3705,3707,3709,3711,3713,3715,3717,3719,3721,3723,3725,3727,3729,3731,3733,3735,3737,3739,3741,3743,3745,3747,3749,3751,3753,3755,3757,3759,3761,3763,3765,3767,3769,3771,3773,3775,3777,3779,3781,3783,3785,3787,3789,3791,3793,3795,3797,3799,3801,3803,3805,3807,3809,3811,3813,3815,3817,3819,3821,3823,3825,3827,3829,3831,3833,3835,3837,3839,3841,3843,3845,3847,3849,3851,3853,3855,3857,3859,3861,3863,3865,3867,3869,3871,3873,3875,3877,3879,3881,3883,3885,3887,3889,3891,3893,3895,3897,3899,3901,3903,3905,3907,3909,3911,3913,3915,3917,3919,3921,3923,3925,3927,3929,3931,3933,3935,3937,3939,3941,3943,3945,3947,3949,3951,3953,3955,3957,3959,3961,3963,3965,3967,3969,3971,3973,3975,3977,3979,3981,3983,3985,3987,3989,3991,3993,3995,3997,3999,4001,4003,4005,4007,4009,4011,4013,4015,4017,4019,4021,4023,4025,4027,4029,4031,4033,4035,4037,4039,4041,4043,4045,4047,4049,4051,4053,4055,4057,4059,4061,4063,4065,4067,4069,4071,4073,4075,4077,4079,4081,4083,4085,4087,4089,4091,4093,4095,4097,4099,4101,4103,4105,4107,4109,4111,4113,4115,4117,4119,4121,4123,4125,4127,4129,4131,4133,4135,4137,4139,4141,4143,4145,4147,4149,4151,4153,4155,4157,4159,4161,4163,4165,4167,4169,4171,4173,4175,4177,4179,4181,4183,4185,4187,4189,4191,4193,4195,4197,4199,4201,4203,4205,4207,4209,4211,4213,4215,4217,4219,4221,4223,4225,4227,4229,4231,4233,4235,4237,4239,4241,4243,4245,4247,4249,4251,4253,4255,4257,4259,4261,4263,4265,4267,4269,4271,4273,4275,4277,4279,4281,4283,4285,4287,4289,4291,4293,4295,4297,4299,4301,4303,4305,4307,4309,4311,4313,4315,4317,4319,4321,4323,4325,4327,4329,4331,4333,4335,4337,4339,4341,4343,4345,4347,4349,4351,4353,4355,4357,4359,4361,4363,4365,4367,4369,4371,4373,4375,4377,4379,4381,4383,4385,4387,4389,4391,4393,4395,4397,4399,4401,4403,4405,4407,4409,4411,4413,4415,4417,4419,4421,4423,4425,4427,4429,4431,4433,4435,4437,4439,4441,4443,4445,4447,4449,4451,4453,4455,4457,4459,4461,4463,4465,4467,4469,4471,4473,4475,4477,4479,4481,4483,4485,4487,4489,4491,4493,4495,4497,4499,4501,4503,4505],{"categories":103},[104],"Business & SaaS",{"categories":106},[104],{"categories":108},[109],"AI News & Trends",{"categories":111},[],{"categories":113},[114],"AI Automation",{"categories":116},[117],"Marketing & Growth",{"categories":119},[120],"Design & Frontend",{"categories":122},[123],"Software Engineering",{"categories":125},[114],{"categories":127},[],{"categories":129},[120],{"categories":131},[120],{"categories":133},[114],{"categories":135},[120],{"categories":137},[120],{"categories":139},[140],"AI & LLMs",{"categories":142},[120],{"categories":144},[120],{"categories":146},[],{"categories":148},[120],{"categories":150},[120],{"categories":152},[140],{"categories":154},[155],"Developer Productivity",{"categories":157},[140],{"categories":159},[140],{"categories":161},[140],{"categories":163},[109],{"categories":165},[140],{"categories":167},[114],{"categories":169},[104],{"categories":171},[109],{"categories":173},[117],{"categories":175},[],{"categories":177},[],{"categories":179},[114],{"categories":181},[114],{"categories":183},[114],{"categories":185},[117],{"categories":187},[140],{"categories":189},[155],{"categories":191},[109],{"categories":193},[],{"categories":195},[],{"categories":197},[],{"categories":199},[200],"Data Science & Visualization",{"categories":202},[],{"categories":204},[114],{"categories":206},[123],{"categories":208},[114],{"categories":210},[114],{"categories":212},[140],{"categories":214},[117],{"categories":216},[114],{"categories":218},[],{"categories":220},[],{"categories":222},[],{"categories":224},[120],{"categories":226},[120],{"categories":228},[114],{"categories":230},[117],{"categories":232},[155],{"categories":234},[120],{"categories":236},[140],{"categories":238},[123],{"categories":240},[140],{"categories":242},[],{"categories":244},[114],{"categories":246},[140],{"categories":248},[155],{"categories":250},[155],{"categories":252},[],{"categories":254},[117],{"categories":256},[104],{"categories":258},[140],{"categories":260},[104],{"categories":262},[104],{"categories":264},[114],{"categories":266},[117],{"categories":268},[114],{"categories":270},[104],{"categories":272},[114],{"categories":274},[120],{"categories":276},[140],{"categories":278},[120],{"categories":280},[140],{"categories":282},[104],{"categories":284},[140],{"categories":286},[117],{"categories":288},[],{"categories":290},[140],{"categories":292},[104],{"categories":294},[],{"categories":296},[109],{"categories":298},[123],{"categories":300},[],{"categories":302},[140],{"categories":304},[120],{"categories":306},[140],{"categories":308},[120],{"categories":310},[],{"categories":312},[114],{"categories":314},[],{"categories":316},[],{"categories":318},[],{"categories":320},[140],{"categories":322},[],{"categories":324},[140],{"categories":326},[140],{"categories":328},[120],{"categories":330},[140],{"categories":332},[155],{"categories":334},[114],{"categories":336},[117],{"categories":338},[155],{"categories":340},[155],{"categories":342},[155],{"categories":344},[117],{"categories":346},[117],{"categories":348},[140],{"categories":350},[140],{"categories":352},[120],{"categories":354},[104],{"categories":356},[120],{"categories":358},[123],{"categories":360},[104],{"categories":362},[104],{"categories":364},[104],{"categories":366},[120],{"categories":368},[],{"categories":370},[],{"categories":372},[140],{"categories":374},[140],{"categories":376},[123],{"categories":378},[140],{"categories":380},[140],{"categories":382},[],{"categories":384},[140],{"categories":386},[140],{"categories":388},[],{"categories":390},[140],{"categories":392},[109],{"categories":394},[109],{"categories":396},[],{"categories":398},[],{"categories":400},[117],{"categories":402},[117],{"categories":404},[123],{"categories":406},[140],{"categories":408},[],{"categories":410},[],{"categories":412},[114],{"categories":414},[140],{"categories":416},[140],{"categories":418},[],{"categories":420},[140,104],{"categories":422},[140],{"categories":424},[],{"categories":426},[140],{"categories":428},[140],{"categories":430},[],{"categories":432},[],{"categories":434},[114],{"categories":436},[140],{"categories":438},[140],{"categories":440},[114],{"categories":442},[140],{"categories":444},[],{"categories":446},[],{"categories":448},[140],{"categories":450},[],{"categories":452},[140],{"categories":454},[140],{"categories":456},[],{"categories":458},[114],{"categories":460},[120],{"categories":462},[],{"categories":464},[114,465],"DevOps & Cloud",{"categories":467},[140],{"categories":469},[114],{"categories":471},[140],{"categories":473},[],{"categories":475},[],{"categories":477},[],{"categories":479},[],{"categories":481},[140],{"categories":483},[114],{"categories":485},[],{"categories":487},[114],{"categories":489},[],{"categories":491},[140],{"categories":493},[],{"categories":495},[],{"categories":497},[],{"categories":499},[],{"categories":501},[114],{"categories":503},[120],{"categories":505},[140],{"categories":507},[117],{"categories":509},[109],{"categories":511},[104],{"categories":513},[155],{"categories":515},[],{"categories":517},[114],{"categories":519},[114],{"categories":521},[140],{"categories":523},[],{"categories":525},[],{"categories":527},[],{"categories":529},[114],{"categories":531},[],{"categories":533},[114],{"categories":535},[114],{"categories":537},[109],{"categories":539},[114],{"categories":541},[140],{"categories":543},[],{"categories":545},[140],{"categories":547},[],{"categories":549},[109],{"categories":551},[114,552],"Product Strategy",{"categories":554},[123],{"categories":556},[465],{"categories":558},[552],{"categories":560},[140],{"categories":562},[114],{"categories":564},[],{"categories":566},[109],{"categories":568},[109],{"categories":570},[114],{"categories":572},[],{"categories":574},[114],{"categories":576},[140],{"categories":578},[140],{"categories":580},[155],{"categories":582},[140],{"categories":584},[],{"categories":586},[140,123],{"categories":588},[109],{"categories":590},[140],{"categories":592},[109],{"categories":594},[114],{"categories":596},[109],{"categories":598},[],{"categories":600},[123],{"categories":602},[104],{"categories":604},[],{"categories":606},[114],{"categories":608},[114],{"categories":610},[114],{"categories":612},[114],{"categories":614},[104],{"categories":616},[120],{"categories":618},[117],{"categories":620},[],{"categories":622},[114],{"categories":624},[],{"categories":626},[109],{"categories":628},[109],{"categories":630},[109],{"categories":632},[114],{"categories":634},[109],{"categories":636},[140],{"categories":638},[155],{"categories":640},[140],{"categories":642},[123],{"categories":644},[140,155],{"categories":646},[155],{"categories":648},[155],{"categories":650},[155],{"categories":652},[155],{"categories":654},[140],{"categories":656},[],{"categories":658},[],{"categories":660},[117],{"categories":662},[],{"categories":664},[140],{"categories":666},[155],{"categories":668},[140],{"categories":670},[120],{"categories":672},[123],{"categories":674},[],{"categories":676},[140],{"categories":678},[155],{"categories":680},[117],{"categories":682},[109],{"categories":684},[123],{"categories":686},[140],{"categories":688},[],{"categories":690},[123],{"categories":692},[120],{"categories":694},[104],{"categories":696},[104],{"categories":698},[],{"categories":700},[120],{"categories":702},[104],{"categories":704},[109],{"categories":706},[155],{"categories":708},[114],{"categories":710},[114],{"categories":712},[140],{"categories":714},[140],{"categories":716},[109],{"categories":718},[109],{"categories":720},[155],{"categories":722},[109],{"categories":724},[],{"categories":726},[552],{"categories":728},[114],{"categories":730},[109],{"categories":732},[109],{"categories":734},[109],{"categories":736},[140],{"categories":738},[114],{"categories":740},[114],{"categories":742},[104],{"categories":744},[104],{"categories":746},[140],{"categories":748},[109],{"categories":750},[],{"categories":752},[140],{"categories":754},[104],{"categories":756},[114],{"categories":758},[114],{"categories":760},[114],{"categories":762},[120],{"categories":764},[114],{"categories":766},[155],{"categories":768},[109],{"categories":770},[109],{"categories":772},[109],{"categories":774},[109],{"categories":776},[109],{"categories":778},[],{"categories":780},[],{"categories":782},[155],{"categories":784},[109],{"categories":786},[109],{"categories":788},[109],{"categories":790},[],{"categories":792},[140],{"categories":794},[],{"categories":796},[],{"categories":798},[120],{"categories":800},[104],{"categories":802},[],{"categories":804},[109],{"categories":806},[114],{"categories":808},[114],{"categories":810},[114],{"categories":812},[117],{"categories":814},[114],{"categories":816},[],{"categories":818},[109],{"categories":820},[109],{"categories":822},[140],{"categories":824},[],{"categories":826},[117],{"categories":828},[117],{"categories":830},[140],{"categories":832},[109],{"categories":834},[104],{"categories":836},[123],{"categories":838},[140],{"categories":840},[],{"categories":842},[140],{"categories":844},[140],{"categories":846},[123],{"categories":848},[140],{"categories":850},[140],{"categories":852},[140],{"categories":854},[117],{"categories":856},[109],{"categories":858},[140],{"categories":860},[140],{"categories":862},[109],{"categories":864},[114],{"categories":866},[155],{"categories":868},[104],{"categories":870},[140],{"categories":872},[155],{"categories":874},[155],{"categories":876},[],{"categories":878},[117],{"categories":880},[109],{"categories":882},[109],{"categories":884},[155],{"categories":886},[114],{"categories":888},[114],{"categories":890},[114],{"categories":892},[114],{"categories":894},[120],{"categories":896},[140],{"categories":898},[140],{"categories":900},[552],{"categories":902},[140],{"categories":904},[140],{"categories":906},[114],{"categories":908},[104],{"categories":910},[117],{"categories":912},[],{"categories":914},[104],{"categories":916},[104],{"categories":918},[],{"categories":920},[120],{"categories":922},[140],{"categories":924},[],{"categories":926},[],{"categories":928},[109],{"categories":930},[109],{"categories":932},[109],{"categories":934},[109],{"categories":936},[],{"categories":938},[109],{"categories":940},[140],{"categories":942},[140],{"categories":944},[],{"categories":946},[109],{"categories":948},[109],{"categories":950},[104],{"categories":952},[140],{"categories":954},[],{"categories":956},[],{"categories":958},[109],{"categories":960},[109],{"categories":962},[109],{"categories":964},[140],{"categories":966},[109],{"categories":968},[109],{"categories":970},[109],{"categories":972},[109],{"categories":974},[109],{"categories":976},[],{"categories":978},[114],{"categories":980},[140],{"categories":982},[117],{"categories":984},[104],{"categories":986},[114],{"categories":988},[140],{"categories":990},[],{"categories":992},[117],{"categories":994},[109],{"categories":996},[109],{"categories":998},[109],{"categories":1000},[109],{"categories":1002},[155],{"categories":1004},[123],{"categories":1006},[],{"categories":1008},[140],{"categories":1010},[114],{"categories":1012},[114],{"categories":1014},[114],{"categories":1016},[465],{"categories":1018},[114],{"categories":1020},[140],{"categories":1022},[140],{"categories":1024},[123],{"categories":1026},[465],{"categories":1028},[200],{"categories":1030},[140],{"categories":1032},[200],{"categories":1034},[],{"categories":1036},[117],{"categories":1038},[117],{"categories":1040},[120],{"categories":1042},[465],{"categories":1044},[114],{"categories":1046},[140],{"categories":1048},[140],{"categories":1050},[114],{"categories":1052},[114],{"categories":1054},[114],{"categories":1056},[155],{"categories":1058},[155],{"categories":1060},[114],{"categories":1062},[114],{"categories":1064},[],{"categories":1066},[114],{"categories":1068},[114],{"categories":1070},[140],{"categories":1072},[200],{"categories":1074},[114],{"categories":1076},[114],{"categories":1078},[114],{"categories":1080},[114],{"categories":1082},[104],{"categories":1084},[120],{"categories":1086},[109],{"categories":1088},[123],{"categories":1090},[465],{"categories":1092},[123],{"categories":1094},[200],{"categories":1096},[],{"categories":1098},[123],{"categories":1100},[],{"categories":1102},[],{"categories":1104},[123],{"categories":1106},[140],{"categories":1108},[],{"categories":1110},[],{"categories":1112},[],{"categories":1114},[104],{"categories":1116},[],{"categories":1118},[],{"categories":1120},[200],{"categories":1122},[140],{"categories":1124},[465],{"categories":1126},[140],{"categories":1128},[],{"categories":1130},[114],{"categories":1132},[155],{"categories":1134},[155],{"categories":1136},[117],{"categories":1138},[117],{"categories":1140},[117],{"categories":1142},[465],{"categories":1144},[123],{"categories":1146},[114],{"categories":1148},[104],{"categories":1150},[104],{"categories":1152},[123],{"categories":1154},[120],{"categories":1156},[200],{"categories":1158},[120],{"categories":1160},[],{"categories":1162},[140],{"categories":1164},[114],{"categories":1166},[114],{"categories":1168},[155],{"categories":1170},[114],{"categories":1172},[114],{"categories":1174},[120],{"categories":1176},[120],{"categories":1178},[114],{"categories":1180},[465],{"categories":1182},[140],{"categories":1184},[],{"categories":1186},[117],{"categories":1188},[114],{"categories":1190},[104],{"categories":1192},[114],{"categories":1194},[114],{"categories":1196},[],{"categories":1198},[140],{"categories":1200},[114],{"categories":1202},[114],{"categories":1204},[155],{"categories":1206},[114],{"categories":1208},[140],{"categories":1210},[],{"categories":1212},[114],{"categories":1214},[],{"categories":1216},[120],{"categories":1218},[155],{"categories":1220},[140],{"categories":1222},[123],{"categories":1224},[120],{"categories":1226},[155],{"categories":1228},[200],{"categories":1230},[155],{"categories":1232},[],{"categories":1234},[140],{"categories":1236},[140],{"categories":1238},[552],{"categories":1240},[123],{"categories":1242},[140,114],{"categories":1244},[114],{"categories":1246},[140],{"categories":1248},[114],{"categories":1250},[114,123],{"categories":1252},[114],{"categories":1254},[140],{"categories":1256},[],{"categories":1258},[155],{"categories":1260},[140],{"categories":1262},[114],{"categories":1264},[140],{"categories":1266},[],{"categories":1268},[123],{"categories":1270},[104],{"categories":1272},[114],{"categories":1274},[],{"categories":1276},[200],{"categories":1278},[123],{"categories":1280},[114],{"categories":1282},[123],{"categories":1284},[],{"categories":1286},[114],{"categories":1288},[],{"categories":1290},[114],{"categories":1292},[],{"categories":1294},[],{"categories":1296},[120],{"categories":1298},[155],{"categories":1300},[140],{"categories":1302},[114],{"categories":1304},[],{"categories":1306},[114],{"categories":1308},[123],{"categories":1310},[140],{"categories":1312},[140],{"categories":1314},[123],{"categories":1316},[123],{"categories":1318},[155],{"categories":1320},[104],{"categories":1322},[],{"categories":1324},[140],{"categories":1326},[140],{"categories":1328},[140],{"categories":1330},[114],{"categories":1332},[140],{"categories":1334},[],{"categories":1336},[120],{"categories":1338},[140],{"categories":1340},[114],{"categories":1342},[],{"categories":1344},[140],{"categories":1346},[],{"categories":1348},[140],{"categories":1350},[],{"categories":1352},[],{"categories":1354},[],{"categories":1356},[140],{"categories":1358},[140],{"categories":1360},[140],{"categories":1362},[140],{"categories":1364},[],{"categories":1366},[140],{"categories":1368},[140],{"categories":1370},[140],{"categories":1372},[],{"categories":1374},[140],{"categories":1376},[],{"categories":1378},[117],{"categories":1380},[140],{"categories":1382},[],{"categories":1384},[],{"categories":1386},[],{"categories":1388},[140],{"categories":1390},[109],{"categories":1392},[109],{"categories":1394},[],{"categories":1396},[114],{"categories":1398},[140],{"categories":1400},[],{"categories":1402},[140],{"categories":1404},[140],{"categories":1406},[109],{"categories":1408},[],{"categories":1410},[140],{"categories":1412},[109],{"categories":1414},[114],{"categories":1416},[140],{"categories":1418},[],{"categories":1420},[],{"categories":1422},[],{"categories":1424},[114],{"categories":1426},[114],{"categories":1428},[114],{"categories":1430},[114],{"categories":1432},[140],{"categories":1434},[120],{"categories":1436},[120],{"categories":1438},[114],{"categories":1440},[114],{"categories":1442},[155],{"categories":1444},[552],{"categories":1446},[155],{"categories":1448},[155],{"categories":1450},[140],{"categories":1452},[114],{"categories":1454},[140],{"categories":1456},[155],{"categories":1458},[140],{"categories":1460},[114],{"categories":1462},[114],{"categories":1464},[114],{"categories":1466},[114],{"categories":1468},[114],{"categories":1470},[140],{"categories":1472},[155],{"categories":1474},[155],{"categories":1476},[117],{"categories":1478},[114],{"categories":1480},[],{"categories":1482},[114],{"categories":1484},[],{"categories":1486},[109],{"categories":1488},[140],{"categories":1490},[],{"categories":1492},[104],{"categories":1494},[120],{"categories":1496},[120],{"categories":1498},[114],{"categories":1500},[114],{"categories":1502},[140],{"categories":1504},[140],{"categories":1506},[109],{"categories":1508},[109],{"categories":1510},[465],{"categories":1512},[114],{"categories":1514},[109],{"categories":1516},[],{"categories":1518},[140],{"categories":1520},[114],{"categories":1522},[114],{"categories":1524},[114],{"categories":1526},[114],{"categories":1528},[140],{"categories":1530},[140],{"categories":1532},[140],{"categories":1534},[140],{"categories":1536},[114],{"categories":1538},[114],{"categories":1540},[114],{"categories":1542},[114],{"categories":1544},[],{"categories":1546},[120],{"categories":1548},[140],{"categories":1550},[140],{"categories":1552},[140],{"categories":1554},[],{"categories":1556},[117],{"categories":1558},[],{"categories":1560},[155],{"categories":1562},[],{"categories":1564},[114],{"categories":1566},[155],{"categories":1568},[120],{"categories":1570},[155],{"categories":1572},[],{"categories":1574},[155],{"categories":1576},[155],{"categories":1578},[],{"categories":1580},[120],{"categories":1582},[114],{"categories":1584},[114],{"categories":1586},[155],{"categories":1588},[140],{"categories":1590},[140],{"categories":1592},[],{"categories":1594},[109],{"categories":1596},[],{"categories":1598},[117],{"categories":1600},[],{"categories":1602},[120],{"categories":1604},[109],{"categories":1606},[120],{"categories":1608},[120],{"categories":1610},[120],{"categories":1612},[120],{"categories":1614},[120],{"categories":1616},[120],{"categories":1618},[120],{"categories":1620},[120],{"categories":1622},[120],{"categories":1624},[120],{"categories":1626},[],{"categories":1628},[114],{"categories":1630},[120],{"categories":1632},[140],{"categories":1634},[140],{"categories":1636},[120],{"categories":1638},[120],{"categories":1640},[120],{"categories":1642},[120],{"categories":1644},[120],{"categories":1646},[120],{"categories":1648},[120],{"categories":1650},[140,120],{"categories":1652},[120],{"categories":1654},[120],{"categories":1656},[120],{"categories":1658},[120],{"categories":1660},[],{"categories":1662},[120],{"categories":1664},[120],{"categories":1666},[120],{"categories":1668},[120],{"categories":1670},[120],{"categories":1672},[120],{"categories":1674},[120],{"categories":1676},[120],{"categories":1678},[120],{"categories":1680},[120,140],{"categories":1682},[120],{"categories":1684},[120],{"categories":1686},[],{"categories":1688},[109],{"categories":1690},[],{"categories":1692},[140],{"categories":1694},[],{"categories":1696},[114],{"categories":1698},[465],{"categories":1700},[552],{"categories":1702},[114],{"categories":1704},[114],{"categories":1706},[],{"categories":1708},[114],{"categories":1710},[],{"categories":1712},[114],{"categories":1714},[],{"categories":1716},[],{"categories":1718},[140],{"categories":1720},[140],{"categories":1722},[140],{"categories":1724},[109],{"categories":1726},[109],{"categories":1728},[109],{"categories":1730},[109],{"categories":1732},[],{"categories":1734},[109],{"categories":1736},[],{"categories":1738},[109],{"categories":1740},[140],{"categories":1742},[109],{"categories":1744},[109],{"categories":1746},[109],{"categories":1748},[109],{"categories":1750},[140],{"categories":1752},[109],{"categories":1754},[114],{"categories":1756},[],{"categories":1758},[114],{"categories":1760},[109],{"categories":1762},[140],{"categories":1764},[109],{"categories":1766},[109],{"categories":1768},[109],{"categories":1770},[140],{"categories":1772},[140],{"categories":1774},[140],{"categories":1776},[],{"categories":1778},[],{"categories":1780},[140],{"categories":1782},[109],{"categories":1784},[],{"categories":1786},[140],{"categories":1788},[114],{"categories":1790},[140],{"categories":1792},[114],{"categories":1794},[114],{"categories":1796},[140],{"categories":1798},[],{"categories":1800},[],{"categories":1802},[114],{"categories":1804},[114],{"categories":1806},[114],{"categories":1808},[114],{"categories":1810},[114],{"categories":1812},[114],{"categories":1814},[114],{"categories":1816},[114],{"categories":1818},[],{"categories":1820},[114],{"categories":1822},[114],{"categories":1824},[114],{"categories":1826},[140],{"categories":1828},[140],{"categories":1830},[140],{"categories":1832},[109],{"categories":1834},[140],{"categories":1836},[140],{"categories":1838},[140],{"categories":1840},[114],{"categories":1842},[117],{"categories":1844},[117],{"categories":1846},[117],{"categories":1848},[114],{"categories":1850},[],{"categories":1852},[140],{"categories":1854},[],{"categories":1856},[],{"categories":1858},[140],{"categories":1860},[],{"categories":1862},[114],{"categories":1864},[120],{"categories":1866},[155],{"categories":1868},[200],{"categories":1870},[140],{"categories":1872},[114],{"categories":1874},[120],{"categories":1876},[],{"categories":1878},[114],{"categories":1880},[117,104],{"categories":1882},[114],{"categories":1884},[114],{"categories":1886},[465],{"categories":1888},[123],{"categories":1890},[117],{"categories":1892},[155],{"categories":1894},[140],{"categories":1896},[],{"categories":1898},[140],{"categories":1900},[],{"categories":1902},[140],{"categories":1904},[140],{"categories":1906},[114],{"categories":1908},[],{"categories":1910},[140],{"categories":1912},[114],{"categories":1914},[140],{"categories":1916},[155],{"categories":1918},[114],{"categories":1920},[140],{"categories":1922},[140,155],{"categories":1924},[155],{"categories":1926},[],{"categories":1928},[140],{"categories":1930},[140],{"categories":1932},[140],{"categories":1934},[],{"categories":1936},[],{"categories":1938},[114],{"categories":1940},[117],{"categories":1942},[109],{"categories":1944},[114],{"categories":1946},[140],{"categories":1948},[109],{"categories":1950},[],{"categories":1952},[155],{"categories":1954},[109],{"categories":1956},[],{"categories":1958},[200],{"categories":1960},[117],{"categories":1962},[104],{"categories":1964},[109],{"categories":1966},[140],{"categories":1968},[114],{"categories":1970},[140],{"categories":1972},[114],{"categories":1974},[114],{"categories":1976},[109],{"categories":1978},[155],{"categories":1980},[120],{"categories":1982},[104],{"categories":1984},[140],{"categories":1986},[140],{"categories":1988},[],{"categories":1990},[],{"categories":1992},[140],{"categories":1994},[],{"categories":1996},[140],{"categories":1998},[109],{"categories":2000},[],{"categories":2002},[114],{"categories":2004},[155],{"categories":2006},[109],{"categories":2008},[155],{"categories":2010},[114],{"categories":2012},[140],{"categories":2014},[],{"categories":2016},[114],{"categories":2018},[114],{"categories":2020},[120],{"categories":2022},[114],{"categories":2024},[120],{"categories":2026},[114],{"categories":2028},[114],{"categories":2030},[120],{"categories":2032},[],{"categories":2034},[],{"categories":2036},[120],{"categories":2038},[120],{"categories":2040},[120],{"categories":2042},[123],{"categories":2044},[155],{"categories":2046},[155],{"categories":2048},[114],{"categories":2050},[109],{"categories":2052},[155],{"categories":2054},[155],{"categories":2056},[117],{"categories":2058},[120],{"categories":2060},[114],{"categories":2062},[114],{"categories":2064},[140],{"categories":2066},[155],{"categories":2068},[140],{"categories":2070},[],{"categories":2072},[465],{"categories":2074},[552],{"categories":2076},[],{"categories":2078},[],{"categories":2080},[114],{"categories":2082},[109],{"categories":2084},[117],{"categories":2086},[117],{"categories":2088},[200],{"categories":2090},[120],{"categories":2092},[200],{"categories":2094},[200],{"categories":2096},[114],{"categories":2098},[],{"categories":2100},[],{"categories":2102},[200],{"categories":2104},[123],{"categories":2106},[140],{"categories":2108},[123],{"categories":2110},[200],{"categories":2112},[123],{"categories":2114},[200],{"categories":2116},[104],{"categories":2118},[123],{"categories":2120},[155],{"categories":2122},[140],{"categories":2124},[],{"categories":2126},[200],{"categories":2128},[465],{"categories":2130},[],{"categories":2132},[140],{"categories":2134},[140],{"categories":2136},[],{"categories":2138},[],{"categories":2140},[140],{"categories":2142},[140],{"categories":2144},[109],{"categories":2146},[140],{"categories":2148},[],{"categories":2150},[109],{"categories":2152},[],{"categories":2154},[],{"categories":2156},[109],{"categories":2158},[109],{"categories":2160},[140],{"categories":2162},[140],{"categories":2164},[140],{"categories":2166},[140],{"categories":2168},[140],{"categories":2170},[140],{"categories":2172},[117],{"categories":2174},[],{"categories":2176},[140],{"categories":2178},[],{"categories":2180},[],{"categories":2182},[114],{"categories":2184},[155],{"categories":2186},[],{"categories":2188},[465],{"categories":2190},[140,465],{"categories":2192},[140],{"categories":2194},[],{"categories":2196},[120],{"categories":2198},[120],{"categories":2200},[120],{"categories":2202},[120],{"categories":2204},[120],{"categories":2206},[],{"categories":2208},[],{"categories":2210},[],{"categories":2212},[123],{"categories":2214},[114],{"categories":2216},[104],{"categories":2218},[123],{"categories":2220},[155],{"categories":2222},[120],{"categories":2224},[],{"categories":2226},[117],{"categories":2228},[552],{"categories":2230},[200],{"categories":2232},[200],{"categories":2234},[200],{"categories":2236},[155],{"categories":2238},[552],{"categories":2240},[155],{"categories":2242},[],{"categories":2244},[104],{"categories":2246},[123],{"categories":2248},[140],{"categories":2250},[120],{"categories":2252},[117],{"categories":2254},[123],{"categories":2256},[117],{"categories":2258},[140],{"categories":2260},[120],{"categories":2262},[123],{"categories":2264},[465],{"categories":2266},[140],{"categories":2268},[109],{"categories":2270},[123],{"categories":2272},[],{"categories":2274},[140],{"categories":2276},[123],{"categories":2278},[123],{"categories":2280},[114],{"categories":2282},[],{"categories":2284},[117],{"categories":2286},[117],{"categories":2288},[117],{"categories":2290},[114],{"categories":2292},[140],{"categories":2294},[],{"categories":2296},[104],{"categories":2298},[155],{"categories":2300},[155],{"categories":2302},[200],{"categories":2304},[104],{"categories":2306},[109],{"categories":2308},[200],{"categories":2310},[],{"categories":2312},[109],{"categories":2314},[109],{"categories":2316},[109],{"categories":2318},[140],{"categories":2320},[104],{"categories":2322},[140],{"categories":2324},[],{"categories":2326},[],{"categories":2328},[],{"categories":2330},[123],{"categories":2332},[114],{"categories":2334},[],{"categories":2336},[155],{"categories":2338},[120],{"categories":2340},[],{"categories":2342},[117],{"categories":2344},[],{"categories":2346},[120],{"categories":2348},[140],{"categories":2350},[155],{"categories":2352},[104],{"categories":2354},[],{"categories":2356},[120],{"categories":2358},[120],{"categories":2360},[140],{"categories":2362},[],{"categories":2364},[],{"categories":2366},[123],{"categories":2368},[140],{"categories":2370},[],{"categories":2372},[114],{"categories":2374},[140],{"categories":2376},[],{"categories":2378},[123],{"categories":2380},[114],{"categories":2382},[140],{"categories":2384},[200],{"categories":2386},[140],{"categories":2388},[],{"categories":2390},[200],{"categories":2392},[140],{"categories":2394},[123],{"categories":2396},[140],{"categories":2398},[200],{"categories":2400},[114],{"categories":2402},[140],{"categories":2404},[140],{"categories":2406},[140,114],{"categories":2408},[114],{"categories":2410},[114],{"categories":2412},[114],{"categories":2414},[120],{"categories":2416},[155],{"categories":2418},[140],{"categories":2420},[155],{"categories":2422},[120],{"categories":2424},[140],{"categories":2426},[],{"categories":2428},[],{"categories":2430},[140],{"categories":2432},[140],{"categories":2434},[140],{"categories":2436},[114],{"categories":2438},[140],{"categories":2440},[],{"categories":2442},[140],{"categories":2444},[140],{"categories":2446},[114],{"categories":2448},[114],{"categories":2450},[140],{"categories":2452},[140],{"categories":2454},[],{"categories":2456},[140],{"categories":2458},[],{"categories":2460},[140],{"categories":2462},[140],{"categories":2464},[140],{"categories":2466},[140],{"categories":2468},[140],{"categories":2470},[140],{"categories":2472},[140],{"categories":2474},[],{"categories":2476},[140],{"categories":2478},[109],{"categories":2480},[109],{"categories":2482},[],{"categories":2484},[],{"categories":2486},[140],{"categories":2488},[],{"categories":2490},[140],{"categories":2492},[140,465],{"categories":2494},[],{"categories":2496},[109],{"categories":2498},[],{"categories":2500},[140],{"categories":2502},[],{"categories":2504},[],{"categories":2506},[],{"categories":2508},[140],{"categories":2510},[],{"categories":2512},[140],{"categories":2514},[],{"categories":2516},[140],{"categories":2518},[140],{"categories":2520},[],{"categories":2522},[],{"categories":2524},[140,465],{"categories":2526},[465,140],{"categories":2528},[109],{"categories":2530},[],{"categories":2532},[140],{"categories":2534},[],{"categories":2536},[140],{"categories":2538},[140],{"categories":2540},[],{"categories":2542},[109],{"categories":2544},[140,104],{"categories":2546},[109],{"categories":2548},[123],{"categories":2550},[],{"categories":2552},[114],{"categories":2554},[140],{"categories":2556},[117],{"categories":2558},[140],{"categories":2560},[155],{"categories":2562},[155],{"categories":2564},[465],{"categories":2566},[109],{"categories":2568},[140],{"categories":2570},[465],{"categories":2572},[123],{"categories":2574},[140],{"categories":2576},[155],{"categories":2578},[],{"categories":2580},[140],{"categories":2582},[],{"categories":2584},[],{"categories":2586},[140],{"categories":2588},[],{"categories":2590},[140],{"categories":2592},[123],{"categories":2594},[104],{"categories":2596},[155],{"categories":2598},[117],{"categories":2600},[114],{"categories":2602},[155],{"categories":2604},[],{"categories":2606},[117],{"categories":2608},[],{"categories":2610},[],{"categories":2612},[140],{"categories":2614},[109],{"categories":2616},[117],{"categories":2618},[],{"categories":2620},[140],{"categories":2622},[109],{"categories":2624},[109],{"categories":2626},[117],{"categories":2628},[109],{"categories":2630},[140],{"categories":2632},[109],{"categories":2634},[140],{"categories":2636},[],{"categories":2638},[140],{"categories":2640},[140],{"categories":2642},[140],{"categories":2644},[109],{"categories":2646},[],{"categories":2648},[],{"categories":2650},[120],{"categories":2652},[109],{"categories":2654},[],{"categories":2656},[140],{"categories":2658},[140],{"categories":2660},[140],{"categories":2662},[140],{"categories":2664},[140],{"categories":2666},[140],{"categories":2668},[140],{"categories":2670},[140],{"categories":2672},[140],{"categories":2674},[117],{"categories":2676},[140,120],{"categories":2678},[109],{"categories":2680},[109],{"categories":2682},[140],{"categories":2684},[123],{"categories":2686},[200],{"categories":2688},[140],{"categories":2690},[140],{"categories":2692},[],{"categories":2694},[],{"categories":2696},[140],{"categories":2698},[140],{"categories":2700},[],{"categories":2702},[120],{"categories":2704},[120],{"categories":2706},[155],{"categories":2708},[140],{"categories":2710},[155],{"categories":2712},[140],{"categories":2714},[140],{"categories":2716},[],{"categories":2718},[140],{"categories":2720},[],{"categories":2722},[],{"categories":2724},[140],{"categories":2726},[],{"categories":2728},[],{"categories":2730},[109],{"categories":2732},[],{"categories":2734},[140],{"categories":2736},[140],{"categories":2738},[140],{"categories":2740},[],{"categories":2742},[140],{"categories":2744},[109],{"categories":2746},[552],{"categories":2748},[114],{"categories":2750},[140],{"categories":2752},[],{"categories":2754},[114],{"categories":2756},[140],{"categories":2758},[],{"categories":2760},[140],{"categories":2762},[],{"categories":2764},[114],{"categories":2766},[],{"categories":2768},[],{"categories":2770},[114],{"categories":2772},[114],{"categories":2774},[114],{"categories":2776},[140],{"categories":2778},[],{"categories":2780},[114],{"categories":2782},[114],{"categories":2784},[],{"categories":2786},[],{"categories":2788},[114],{"categories":2790},[140],{"categories":2792},[109],{"categories":2794},[552],{"categories":2796},[117],{"categories":2798},[],{"categories":2800},[120],{"categories":2802},[140],{"categories":2804},[140],{"categories":2806},[104],{"categories":2808},[109],{"categories":2810},[109],{"categories":2812},[109],{"categories":2814},[109],{"categories":2816},[],{"categories":2818},[114],{"categories":2820},[114],{"categories":2822},[114],{"categories":2824},[114],{"categories":2826},[155],{"categories":2828},[140],{"categories":2830},[104],{"categories":2832},[],{"categories":2834},[155],{"categories":2836},[114],{"categories":2838},[120],{"categories":2840},[120],{"categories":2842},[120],{"categories":2844},[120],{"categories":2846},[120],{"categories":2848},[120],{"categories":2850},[140,104],{"categories":2852},[114],{"categories":2854},[104],{"categories":2856},[109],{"categories":2858},[109],{"categories":2860},[155],{"categories":2862},[],{"categories":2864},[],{"categories":2866},[117],{"categories":2868},[],{"categories":2870},[140],{"categories":2872},[117],{"categories":2874},[140],{"categories":2876},[123],{"categories":2878},[114],{"categories":2880},[104],{"categories":2882},[114],{"categories":2884},[123],{"categories":2886},[155],{"categories":2888},[114],{"categories":2890},[],{"categories":2892},[155],{"categories":2894},[],{"categories":2896},[],{"categories":2898},[114],{"categories":2900},[114],{"categories":2902},[114],{"categories":2904},[140],{"categories":2906},[140],{"categories":2908},[140],{"categories":2910},[140],{"categories":2912},[140],{"categories":2914},[],{"categories":2916},[465],{"categories":2918},[140],{"categories":2920},[],{"categories":2922},[],{"categories":2924},[],{"categories":2926},[155],{"categories":2928},[],{"categories":2930},[140],{"categories":2932},[],{"categories":2934},[109],{"categories":2936},[140],{"categories":2938},[109],{"categories":2940},[140],{"categories":2942},[114],{"categories":2944},[],{"categories":2946},[140],{"categories":2948},[140],{"categories":2950},[],{"categories":2952},[200],{"categories":2954},[200],{"categories":2956},[123],{"categories":2958},[120],{"categories":2960},[],{"categories":2962},[140],{"categories":2964},[114],{"categories":2966},[],{"categories":2968},[],{"categories":2970},[140],{"categories":2972},[123],{"categories":2974},[114],{"categories":2976},[104],{"categories":2978},[155,123],{"categories":2980},[123],{"categories":2982},[140],{"categories":2984},[114],{"categories":2986},[],{"categories":2988},[],{"categories":2990},[],{"categories":2992},[],{"categories":2994},[],{"categories":2996},[],{"categories":2998},[140],{"categories":3000},[],{"categories":3002},[],{"categories":3004},[140],{"categories":3006},[],{"categories":3008},[],{"categories":3010},[],{"categories":3012},[140],{"categories":3014},[109],{"categories":3016},[],{"categories":3018},[],{"categories":3020},[],{"categories":3022},[140],{"categories":3024},[],{"categories":3026},[140],{"categories":3028},[140],{"categories":3030},[],{"categories":3032},[140],{"categories":3034},[123],{"categories":3036},[],{"categories":3038},[155],{"categories":3040},[155],{"categories":3042},[],{"categories":3044},[117],{"categories":3046},[],{"categories":3048},[],{"categories":3050},[],{"categories":3052},[120],{"categories":3054},[109],{"categories":3056},[114],{"categories":3058},[140],{"categories":3060},[104],{"categories":3062},[140],{"categories":3064},[],{"categories":3066},[],{"categories":3068},[104],{"categories":3070},[117],{"categories":3072},[114],{"categories":3074},[],{"categories":3076},[465],{"categories":3078},[],{"categories":3080},[117],{"categories":3082},[140],{"categories":3084},[140],{"categories":3086},[117],{"categories":3088},[140],{"categories":3090},[120],{"categories":3092},[114],{"categories":3094},[140],{"categories":3096},[114],{"categories":3098},[140],{"categories":3100},[114],{"categories":3102},[155],{"categories":3104},[155],{"categories":3106},[120],{"categories":3108},[],{"categories":3110},[140],{"categories":3112},[140],{"categories":3114},[117],{"categories":3116},[552],{"categories":3118},[155],{"categories":3120},[109],{"categories":3122},[140],{"categories":3124},[109],{"categories":3126},[140],{"categories":3128},[140],{"categories":3130},[],{"categories":3132},[140],{"categories":3134},[],{"categories":3136},[140],{"categories":3138},[117],{"categories":3140},[140],{"categories":3142},[140],{"categories":3144},[140],{"categories":3146},[],{"categories":3148},[140],{"categories":3150},[140],{"categories":3152},[552],{"categories":3154},[],{"categories":3156},[109],{"categories":3158},[465],{"categories":3160},[123],{"categories":3162},[],{"categories":3164},[200],{"categories":3166},[],{"categories":3168},[],{"categories":3170},[109],{"categories":3172},[140],{"categories":3174},[],{"categories":3176},[140],{"categories":3178},[140],{"categories":3180},[114],{"categories":3182},[140],{"categories":3184},[109],{"categories":3186},[109],{"categories":3188},[120],{"categories":3190},[120],{"categories":3192},[120],{"categories":3194},[140],{"categories":3196},[200],{"categories":3198},[109],{"categories":3200},[155],{"categories":3202},[],{"categories":3204},[120],{"categories":3206},[120],{"categories":3208},[465],{"categories":3210},[120],{"categories":3212},[120],{"categories":3214},[114],{"categories":3216},[109],{"categories":3218},[465],{"categories":3220},[140],{"categories":3222},[140],{"categories":3224},[140],{"categories":3226},[140],{"categories":3228},[],{"categories":3230},[114],{"categories":3232},[140],{"categories":3234},[120],{"categories":3236},[],{"categories":3238},[],{"categories":3240},[109],{"categories":3242},[],{"categories":3244},[114],{"categories":3246},[114],{"categories":3248},[114],{"categories":3250},[114],{"categories":3252},[114],{"categories":3254},[114],{"categories":3256},[114],{"categories":3258},[114],{"categories":3260},[],{"categories":3262},[],{"categories":3264},[140],{"categories":3266},[],{"categories":3268},[114],{"categories":3270},[155],{"categories":3272},[155],{"categories":3274},[200],{"categories":3276},[104],{"categories":3278},[],{"categories":3280},[],{"categories":3282},[],{"categories":3284},[120],{"categories":3286},[140],{"categories":3288},[],{"categories":3290},[104],{"categories":3292},[104],{"categories":3294},[120],{"categories":3296},[155],{"categories":3298},[200],{"categories":3300},[120],{"categories":3302},[120],{"categories":3304},[],{"categories":3306},[114],{"categories":3308},[104],{"categories":3310},[104],{"categories":3312},[140],{"categories":3314},[114],{"categories":3316},[123],{"categories":3318},[120],{"categories":3320},[],{"categories":3322},[117],{"categories":3324},[200],{"categories":3326},[109],{"categories":3328},[109],{"categories":3330},[109],{"categories":3332},[465],{"categories":3334},[],{"categories":3336},[114],{"categories":3338},[],{"categories":3340},[114],{"categories":3342},[114],{"categories":3344},[140],{"categories":3346},[140],{"categories":3348},[123],{"categories":3350},[114],{"categories":3352},[123],{"categories":3354},[],{"categories":3356},[114],{"categories":3358},[120],{"categories":3360},[120],{"categories":3362},[120],{"categories":3364},[140],{"categories":3366},[114],{"categories":3368},[140],{"categories":3370},[104],{"categories":3372},[109],{"categories":3374},[120],{"categories":3376},[109],{"categories":3378},[140],{"categories":3380},[],{"categories":3382},[109],{"categories":3384},[114],{"categories":3386},[109],{"categories":3388},[109],{"categories":3390},[109],{"categories":3392},[109],{"categories":3394},[],{"categories":3396},[],{"categories":3398},[109],{"categories":3400},[109],{"categories":3402},[],{"categories":3404},[109],{"categories":3406},[109],{"categories":3408},[140],{"categories":3410},[140],{"categories":3412},[109],{"categories":3414},[109],{"categories":3416},[140],{"categories":3418},[],{"categories":3420},[140],{"categories":3422},[114],{"categories":3424},[140],{"categories":3426},[140],{"categories":3428},[],{"categories":3430},[140],{"categories":3432},[140],{"categories":3434},[140],{"categories":3436},[109],{"categories":3438},[],{"categories":3440},[],{"categories":3442},[],{"categories":3444},[],{"categories":3446},[140],{"categories":3448},[140],{"categories":3450},[],{"categories":3452},[117],{"categories":3454},[109],{"categories":3456},[],{"categories":3458},[],{"categories":3460},[],{"categories":3462},[],{"categories":3464},[],{"categories":3466},[140],{"categories":3468},[],{"categories":3470},[],{"categories":3472},[140],{"categories":3474},[],{"categories":3476},[114],{"categories":3478},[114],{"categories":3480},[114],{"categories":3482},[104],{"categories":3484},[],{"categories":3486},[117],{"categories":3488},[123],{"categories":3490},[123],{"categories":3492},[465],{"categories":3494},[109],{"categories":3496},[],{"categories":3498},[140],{"categories":3500},[140],{"categories":3502},[104],{"categories":3504},[],{"categories":3506},[104],{"categories":3508},[],{"categories":3510},[],{"categories":3512},[],{"categories":3514},[123],{"categories":3516},[114],{"categories":3518},[114],{"categories":3520},[114],{"categories":3522},[114],{"categories":3524},[114],{"categories":3526},[],{"categories":3528},[109],{"categories":3530},[140],{"categories":3532},[140],{"categories":3534},[140],{"categories":3536},[],{"categories":3538},[104],{"categories":3540},[],{"categories":3542},[120],{"categories":3544},[200],{"categories":3546},[120],{"categories":3548},[],{"categories":3550},[],{"categories":3552},[140],{"categories":3554},[114],{"categories":3556},[],{"categories":3558},[140],{"categories":3560},[140],{"categories":3562},[140],{"categories":3564},[114],{"categories":3566},[114],{"categories":3568},[140],{"categories":3570},[200],{"categories":3572},[114],{"categories":3574},[],{"categories":3576},[140],{"categories":3578},[],{"categories":3580},[552],{"categories":3582},[123],{"categories":3584},[200],{"categories":3586},[123],{"categories":3588},[465],{"categories":3590},[140],{"categories":3592},[123],{"categories":3594},[109],{"categories":3596},[465],{"categories":3598},[123],{"categories":3600},[120],{"categories":3602},[120],{"categories":3604},[],{"categories":3606},[123],{"categories":3608},[],{"categories":3610},[155],{"categories":3612},[123],{"categories":3614},[],{"categories":3616},[200],{"categories":3618},[200],{"categories":3620},[552],{"categories":3622},[],{"categories":3624},[140],{"categories":3626},[123],{"categories":3628},[465],{"categories":3630},[114],{"categories":3632},[114],{"categories":3634},[200],{"categories":3636},[140],{"categories":3638},[155],{"categories":3640},[140],{"categories":3642},[],{"categories":3644},[],{"categories":3646},[],{"categories":3648},[117],{"categories":3650},[140],{"categories":3652},[120],{"categories":3654},[123],{"categories":3656},[123],{"categories":3658},[140],{"categories":3660},[117],{"categories":3662},[155],{"categories":3664},[140],{"categories":3666},[123],{"categories":3668},[140],{"categories":3670},[123],{"categories":3672},[155],{"categories":3674},[155],{"categories":3676},[114],{"categories":3678},[155],{"categories":3680},[123],{"categories":3682},[104],{"categories":3684},[123],{"categories":3686},[123],{"categories":3688},[123],{"categories":3690},[123],{"categories":3692},[],{"categories":3694},[109],{"categories":3696},[],{"categories":3698},[200],{"categories":3700},[140],{"categories":3702},[140],{"categories":3704},[],{"categories":3706},[],{"categories":3708},[],{"categories":3710},[140],{"categories":3712},[109],{"categories":3714},[140],{"categories":3716},[140],{"categories":3718},[],{"categories":3720},[140],{"categories":3722},[120],{"categories":3724},[140],{"categories":3726},[140],{"categories":3728},[140],{"categories":3730},[],{"categories":3732},[],{"categories":3734},[],{"categories":3736},[465],{"categories":3738},[465],{"categories":3740},[104],{"categories":3742},[114],{"categories":3744},[104,117],{"categories":3746},[140],{"categories":3748},[109],{"categories":3750},[],{"categories":3752},[120],{"categories":3754},[200],{"categories":3756},[140],{"categories":3758},[123],{"categories":3760},[140],{"categories":3762},[],{"categories":3764},[200],{"categories":3766},[465],{"categories":3768},[114],{"categories":3770},[104],{"categories":3772},[465],{"categories":3774},[114],{"categories":3776},[155],{"categories":3778},[114],{"categories":3780},[155],{"categories":3782},[140],{"categories":3784},[155],{"categories":3786},[155],{"categories":3788},[123],{"categories":3790},[200],{"categories":3792},[140],{"categories":3794},[117],{"categories":3796},[],{"categories":3798},[140],{"categories":3800},[120],{"categories":3802},[200],{"categories":3804},[104],{"categories":3806},[140],{"categories":3808},[200],{"categories":3810},[155],{"categories":3812},[140],{"categories":3814},[140],{"categories":3816},[200],{"categories":3818},[140],{"categories":3820},[155],{"categories":3822},[140],{"categories":3824},[],{"categories":3826},[140],{"categories":3828},[140],{"categories":3830},[140],{"categories":3832},[140],{"categories":3834},[],{"categories":3836},[114],{"categories":3838},[465],{"categories":3840},[],{"categories":3842},[],{"categories":3844},[140],{"categories":3846},[104],{"categories":3848},[117],{"categories":3850},[104],{"categories":3852},[104],{"categories":3854},[114],{"categories":3856},[],{"categories":3858},[140],{"categories":3860},[109],{"categories":3862},[140],{"categories":3864},[140],{"categories":3866},[],{"categories":3868},[114],{"categories":3870},[109],{"categories":3872},[140,465],{"categories":3874},[114,465],{"categories":3876},[465],{"categories":3878},[140],{"categories":3880},[114],{"categories":3882},[114],{"categories":3884},[123],{"categories":3886},[123],{"categories":3888},[123],{"categories":3890},[140],{"categories":3892},[120],{"categories":3894},[114],{"categories":3896},[],{"categories":3898},[465],{"categories":3900},[],{"categories":3902},[465],{"categories":3904},[465],{"categories":3906},[104],{"categories":3908},[114],{"categories":3910},[],{"categories":3912},[465],{"categories":3914},[140],{"categories":3916},[109],{"categories":3918},[140],{"categories":3920},[120],{"categories":3922},[123],{"categories":3924},[123],{"categories":3926},[123],{"categories":3928},[465],{"categories":3930},[],{"categories":3932},[],{"categories":3934},[],{"categories":3936},[140],{"categories":3938},[123],{"categories":3940},[140],{"categories":3942},[123],{"categories":3944},[465],{"categories":3946},[465],{"categories":3948},[140],{"categories":3950},[114],{"categories":3952},[],{"categories":3954},[140],{"categories":3956},[140],{"categories":3958},[140],{"categories":3960},[],{"categories":3962},[],{"categories":3964},[465],{"categories":3966},[465],{"categories":3968},[140,465],{"categories":3970},[114],{"categories":3972},[114],{"categories":3974},[114],{"categories":3976},[114],{"categories":3978},[114],{"categories":3980},[114],{"categories":3982},[],{"categories":3984},[123],{"categories":3986},[140],{"categories":3988},[123],{"categories":3990},[117],{"categories":3992},[140],{"categories":3994},[552],{"categories":3996},[552],{"categories":3998},[114],{"categories":4000},[123],{"categories":4002},[],{"categories":4004},[114],{"categories":4006},[140],{"categories":4008},[],{"categories":4010},[120],{"categories":4012},[],{"categories":4014},[140],{"categories":4016},[114],{"categories":4018},[109],{"categories":4020},[140],{"categories":4022},[],{"categories":4024},[],{"categories":4026},[120],{"categories":4028},[120],{"categories":4030},[155],{"categories":4032},[120],{"categories":4034},[114],{"categories":4036},[],{"categories":4038},[114],{"categories":4040},[109],{"categories":4042},[140],{"categories":4044},[140],{"categories":4046},[],{"categories":4048},[140],{"categories":4050},[155],{"categories":4052},[140],{"categories":4054},[],{"categories":4056},[200],{"categories":4058},[123],{"categories":4060},[123],{"categories":4062},[104],{"categories":4064},[104],{"categories":4066},[104],{"categories":4068},[114],{"categories":4070},[104],{"categories":4072},[114],{"categories":4074},[465],{"categories":4076},[552],{"categories":4078},[109],{"categories":4080},[109],{"categories":4082},[109],{"categories":4084},[465],{"categories":4086},[109,104],{"categories":4088},[200],{"categories":4090},[114],{"categories":4092},[],{"categories":4094},[140],{"categories":4096},[],{"categories":4098},[123],{"categories":4100},[200],{"categories":4102},[120],{"categories":4104},[123],{"categories":4106},[155],{"categories":4108},[],{"categories":4110},[114],{"categories":4112},[],{"categories":4114},[552],{"categories":4116},[],{"categories":4118},[120],{"categories":4120},[120],{"categories":4122},[200],{"categories":4124},[],{"categories":4126},[140],{"categories":4128},[200],{"categories":4130},[],{"categories":4132},[140],{"categories":4134},[140],{"categories":4136},[],{"categories":4138},[155],{"categories":4140},[140],{"categories":4142},[],{"categories":4144},[140],{"categories":4146},[],{"categories":4148},[],{"categories":4150},[114],{"categories":4152},[114],{"categories":4154},[],{"categories":4156},[123],{"categories":4158},[123],{"categories":4160},[123],{"categories":4162},[140,114],{"categories":4164},[114],{"categories":4166},[114],{"categories":4168},[114],{"categories":4170},[200],{"categories":4172},[200],{"categories":4174},[],{"categories":4176},[109],{"categories":4178},[140],{"categories":4180},[200],{"categories":4182},[200],{"categories":4184},[109],{"categories":4186},[104],{"categories":4188},[114],{"categories":4190},[123],{"categories":4192},[140],{"categories":4194},[140],{"categories":4196},[114],{"categories":4198},[123],{"categories":4200},[114],{"categories":4202},[140],{"categories":4204},[117],{"categories":4206},[],{"categories":4208},[140],{"categories":4210},[],{"categories":4212},[140],{"categories":4214},[140],{"categories":4216},[123],{"categories":4218},[],{"categories":4220},[200],{"categories":4222},[140],{"categories":4224},[114],{"categories":4226},[114],{"categories":4228},[123],{"categories":4230},[155],{"categories":4232},[155],{"categories":4234},[109],{"categories":4236},[140],{"categories":4238},[114],{"categories":4240},[],{"categories":4242},[114],{"categories":4244},[140],{"categories":4246},[109],{"categories":4248},[140],{"categories":4250},[140],{"categories":4252},[140],{"categories":4254},[114],{"categories":4256},[200],{"categories":4258},[140],{"categories":4260},[120],{"categories":4262},[140],{"categories":4264},[140],{"categories":4266},[140],{"categories":4268},[140],{"categories":4270},[],{"categories":4272},[140],{"categories":4274},[200],{"categories":4276},[120],{"categories":4278},[140],{"categories":4280},[120],{"categories":4282},[],{"categories":4284},[],{"categories":4286},[],{"categories":4288},[140],{"categories":4290},[],{"categories":4292},[],{"categories":4294},[],{"categories":4296},[],{"categories":4298},[114],{"categories":4300},[155],{"categories":4302},[114],{"categories":4304},[114],{"categories":4306},[123],{"categories":4308},[104],{"categories":4310},[140],{"categories":4312},[140],{"categories":4314},[140],{"categories":4316},[104],{"categories":4318},[155],{"categories":4320},[],{"categories":4322},[200],{"categories":4324},[117],{"categories":4326},[140],{"categories":4328},[120],{"categories":4330},[155],{"categories":4332},[155],{"categories":4334},[552],{"categories":4336},[114],{"categories":4338},[140],{"categories":4340},[140],{"categories":4342},[155],{"categories":4344},[140],{"categories":4346},[],{"categories":4348},[],{"categories":4350},[465],{"categories":4352},[120],{"categories":4354},[155],{"categories":4356},[140],{"categories":4358},[109],{"categories":4360},[155],{"categories":4362},[104],{"categories":4364},[114],{"categories":4366},[114],{"categories":4368},[109],{"categories":4370},[140],{"categories":4372},[],{"categories":4374},[],{"categories":4376},[],{"categories":4378},[140],{"categories":4380},[],{"categories":4382},[109],{"categories":4384},[],{"categories":4386},[140],{"categories":4388},[],{"categories":4390},[109],{"categories":4392},[114],{"categories":4394},[140],{"categories":4396},[465],{"categories":4398},[140],{"categories":4400},[155],{"categories":4402},[140],{"categories":4404},[155],{"categories":4406},[155],{"categories":4408},[],{"categories":4410},[],{"categories":4412},[155],{"categories":4414},[155],{"categories":4416},[155],{"categories":4418},[],{"categories":4420},[155],{"categories":4422},[114],{"categories":4424},[114],{"categories":4426},[],{"categories":4428},[140],{"categories":4430},[117],{"categories":4432},[200],{"categories":4434},[140],{"categories":4436},[],{"categories":4438},[155],{"categories":4440},[140],{"categories":4442},[552],{"categories":4444},[155],{"categories":4446},[155],{"categories":4448},[117],{"categories":4450},[123],{"categories":4452},[123],{"categories":4454},[],{"categories":4456},[123],{"categories":4458},[140],{"categories":4460},[],{"categories":4462},[],{"categories":4464},[114],{"categories":4466},[],{"categories":4468},[114],{"categories":4470},[114],{"categories":4472},[109],{"categories":4474},[140],{"categories":4476},[109],{"categories":4478},[155],{"categories":4480},[109],{"categories":4482},[123],{"categories":4484},[123],{"categories":4486},[123],{"categories":4488},[109],{"categories":4490},[140],{"categories":4492},[114],{"categories":4494},[465],{"categories":4496},[104],{"categories":4498},[465],{"categories":4500},[465],{"categories":4502},[123],{"categories":4504},[465],{"categories":4506},[465],[4508,4573,4713,4921],{"id":4509,"title":4510,"ai":4511,"body":4516,"categories":4547,"created_at":67,"date_modified":67,"description":59,"extension":68,"faq":67,"featured":69,"kicker_label":67,"meta":4548,"navigation":82,"path":4560,"published_at":4561,"question":67,"scraped_at":4562,"seo":4563,"sitemap":4564,"source_id":4565,"source_name":4566,"source_type":90,"source_url":4567,"stem":4568,"tags":4569,"thumbnail_url":67,"tldr":4570,"tweet":67,"unknown_tags":4571,"__hash__":4572},"summaries\u002Fsummaries\u002Fmoss-audio-unifies-audio-tasks-in-one-open-model-summary.md","MOSS-Audio Unifies Audio Tasks in One Open Model",{"provider":7,"model":8,"input_tokens":4512,"output_tokens":4513,"processing_time_ms":4514,"cost_usd":4515},5477,2076,17325,0.00211075,{"type":14,"value":4517,"toc":4542},[4518,4522,4525,4529,4532,4536,4539],[17,4519,4521],{"id":4520},"single-foundation-model-replaces-audio-toolchains","Single Foundation Model Replaces Audio Toolchains",[22,4523,4524],{},"Build audio apps without stitching ASR, emotion detectors, sound classifiers, and music analyzers—MOSS-Audio-4B\u002F8B models process raw audio for transcription with timestamps, speaker ID, emotion from tone\u002Ftimbre\u002Fcontext, background scene inference, music style\u002Finstrumentation\u002Femotion arcs, captioning, summarization, and multi-hop reasoning over podcasts\u002Fmeetings. Use Instruct variants (Qwen3-4B\u002F8B backbone, ~4.6B\u002F8.6B params) for structured outputs in pipelines; Thinking variants excel at chain-of-thought for complex inference. Input raw audio; encoder outputs 12.5 Hz representations projected to LLM embeddings for text generation.",[17,4526,4528],{"id":4527},"deepstack-injection-and-time-markers-boost-fidelity","DeepStack Injection and Time-Markers Boost Fidelity",[22,4530,4531],{},"Avoid losing prosody\u002Ftimbres\u002Ftransients by injecting multi-layer encoder features—DeepStack module selects early\u002Fintermediate\u002Ffinal layers, projects them separately, and feeds into LLM early layers for granular acoustic-to-semantic retention. Gain native temporal awareness without post-processing: pretraining inserts fixed-interval time tokens between frames, enabling 'what at 2:00?' QA, event localization, and long-audio reasoning directly in autoregressive generation. Train custom encoders from scratch for robust speech across domains over generic frontends.",[17,4533,4535],{"id":4534},"outperforms-larger-models-on-key-benchmarks","Outperforms Larger Models on Key Benchmarks",[22,4537,4538],{},"MOSS-Audio-8B-Thinking averages 71.08% accuracy (MMAU 77.33, MMAU-Pro 64.92, MMAR 66.53, MMSU 75.52), topping open-source including 33B Step-Audio-R1 (70.67) and 30B Qwen3-Omni (67.91); 4B-Thinking hits 68.37, beating all bigger Instruct models. Leads speech captioning (8B-Instruct: 3.7252\u002F5 across 13 traits like accent\u002Femotion\u002Fpersonality via LLM judge). Lowest ASR CER 11.30 over 12 dims (health\u002Fcode-switching\u002Fsinging). Timestamp ASR: 8B-Instruct at 35.77 AAS (AISHELL-1), 131.61 (LibriSpeech) vs. 30B Qwen3-Omni's 833.66 and Gemini-3.1-Pro's 708.24.",[22,4540,4541],{},"Download from Hugging Face collections or GitHub repo to integrate into apps today.",{"title":59,"searchDepth":60,"depth":60,"links":4543},[4544,4545,4546],{"id":4520,"depth":60,"text":4521},{"id":4527,"depth":60,"text":4528},{"id":4534,"depth":60,"text":4535},[],{"content_references":4549,"triage":4557},[4550,4554],{"type":4551,"title":4552,"url":4553,"context":76},"tool","MOSS-Audio Model Weights","https:\u002F\u002Fhuggingface.co\u002Fcollections\u002FOpenMOSS-Team\u002Fmoss-audio",{"type":73,"title":4555,"url":4556,"context":76},"MOSS-Audio Repo","https:\u002F\u002Fgithub.com\u002FOpenMOSS\u002FMOSS-Audio",{"relevance":78,"novelty":78,"quality":79,"actionability":78,"composite":4558,"reasoning":4559},3.25,"Category: AI & LLMs. The article discusses the MOSS-Audio model, which unifies various audio processing tasks, providing practical insights into its capabilities and performance benchmarks. While it presents new information about the model's architecture and performance, it lacks detailed guidance on how to implement it in real-world applications.","\u002Fsummaries\u002Fmoss-audio-unifies-audio-tasks-in-one-open-model-summary","2026-04-27 18:36:06","2026-04-28 15:16:18",{"title":4510,"description":59},{"loc":4560},"427dafbffb53888b","MarkTechPost","https:\u002F\u002Fwww.marktechpost.com\u002F2026\u002F04\u002F27\u002Fopenmoss-releases-moss-audio-an-open-source-foundation-model-for-speech-sound-music-and-time-aware-audio-reasoning\u002F","summaries\u002Fmoss-audio-unifies-audio-tasks-in-one-open-model-summary",[94,95,96],"MOSS-Audio open-source models (4B\u002F8B) handle speech, sound, music analysis, emotion detection, and time-aware QA in a single system, beating 30B+ rivals on benchmarks via DeepStack injection and time-markers.",[],"2ksxhzjTaLMUx7u2g8_6UGaMUsAD25y6uwkjzV9FOsc",{"id":4574,"title":4575,"ai":4576,"body":4581,"categories":4688,"created_at":67,"date_modified":67,"description":59,"extension":68,"faq":67,"featured":69,"kicker_label":67,"meta":4689,"navigation":82,"path":4700,"published_at":4701,"question":67,"scraped_at":4702,"seo":4703,"sitemap":4704,"source_id":4705,"source_name":4706,"source_type":90,"source_url":4707,"stem":4708,"tags":4709,"thumbnail_url":67,"tldr":4710,"tweet":67,"unknown_tags":4711,"__hash__":4712},"summaries\u002Fsummaries\u002Feve-bodnia-ebms-fix-what-llms-can-t-for-critical-t-summary.md","Eve Bodnia: EBMs Fix What LLMs Can't for Critical Tasks",{"provider":7,"model":8,"input_tokens":4577,"output_tokens":4578,"processing_time_ms":4579,"cost_usd":4580},8762,2251,23722,0.00285525,{"type":14,"value":4582,"toc":4680},[4583,4587,4590,4593,4596,4600,4603,4606,4609,4612,4616,4619,4622,4625,4628,4632,4635,4638,4642,4645,4648,4652],[17,4584,4586],{"id":4585},"llms-fatal-flaws-for-mission-critical-systems","LLMs' Fatal Flaws for Mission-Critical Systems",[22,4588,4589],{},"Eve Bodnia argues that transformer-based LLMs, dominant in AI today, are fundamentally unreliable for high-stakes applications like chip design, financial analysis, or aviation controls. Their autoregressive nature—generating output token-by-token without mid-process inspection—leads to hallucinations, where the model commits to errors without correction. \"Imagine there's AI driving a car and you're in that car and that car is an LLM and someone tells you like, you know, 20% of the time it's going to hallucinate and you might end up like in in like a wrong place,\" Bodnia warns, contrasting Dan Shipper's more experimental curiosity about such risks.",[22,4591,4592],{},"LLMs act as black boxes: you can't peek inside during generation to assess confidence or reasoning. Even with external verifiers like Lean 4—a machine-verifiable proof language—attached post-generation, the core issue persists. Token prediction remains a costly \"guessing game,\" expensive in compute and unreliable for determinism. Shipper pushes back, noting LLMs excel at generating useful output verifiable via tests, but Bodnia counters that this \"guess and check\" is inefficient and doesn't guarantee internals align with outputs.",[22,4594,4595],{},"Mission-critical industries haven't widely adopted LLMs precisely because of this gap. Bodnia sees Logical Intelligence filling it by prioritizing \"deterministic AI, verifiable AI,\" starting with software\u002Fhardware correctness.",[17,4597,4599],{"id":4598},"energy-based-models-physics-inspired-alternatives","Energy-Based Models: Physics-Inspired Alternatives",[22,4601,4602],{},"Bodnia's solution is energy-based models (EBMs), rooted in physics' energy minimization principle—think Lagrangians deriving equations of motion from kinetic and potential energy terms. EBMs are non-autoregressive and token-free, mapping all possible outcomes onto an \"energy landscape\": probable states settle in low-energy \"valleys,\" improbable ones on high-energy \"peaks.\"",[22,4604,4605],{},"Unlike LLMs' sequential navigation (like a left-brain pathfinder taking wrong turns without backtracking), EBMs survey the entire map upfront. \"EBM going to have the first view all the time. So if you see there's a hole, you're going to choose a different route,\" Bodnia explains with a navigation metaphor. Her team's model, dubbed Kona (energy-based reasoning model with latent variables), constructs these landscapes from data, enabling real-time inspection and self-alignment during training.",[22,4607,4608],{},"Shipper tests the concept: modeling his post-podcast behavior (ending on the couch). An LLM might predict via token probabilities from vast text data, but EBMs directly map observed states (tiredness, house geometry) to the landscape without language mediation. This yields inspectable confidence scores pre-output, plus external verifiers for double assurance.",[22,4610,4611],{},"EBMs are cheaper—no tokens mean no guessing compute—and controllable: \"You control the training. It's no longer black box for you.\" Bodnia envisions hybrid use: prototype on LLMs, plug in EBMs for production.",[17,4613,4615],{"id":4614},"beyond-language-true-data-understanding","Beyond Language: True Data Understanding",[22,4617,4618],{},"A core critique: LLMs force all intelligence through language, distorting non-verbal tasks. Human reasoning is abstract, multilingual, and language-independent; LLMs' token chains vary by training language, yielding inconsistent processes. Driving a car or navigating a house relies on visual-spatial data, not word prediction—yet LLMs embed it into language space first.",[22,4620,4621],{},"\"Intelligence which is language-dependent... feels really wrong,\" Bodnia asserts. \"When you drive a car, when you walk around your house, how much language you actually use? Are you trying to predict next word...? Probably not.\"",[22,4623,4624],{},"EBMs process raw data modally, constructing landscapes that reveal underlying \"laws\" (e.g., conservation principles). Shipper suggests sequence modeling via movement tokens; Bodnia agrees it's viable but unnecessary—EBMs handle it natively, without language crutches.",[22,4626,4627],{},"This enables \"understanding\" as structural insight, not statistical correlation. Observing Shipper repeatedly, an EBM learns his \"equation of motion\": tired → couch (lowest valley), gym as secondary low point.",[17,4629,4631],{"id":4630},"verifiable-code-from-plain-english","Verifiable Code from Plain English",[22,4633,4634],{},"EBMs tackle \"vibe coding\"—LLM-generated code that feels right but fails scrutiny. By enabling formal verification in plain English (no C++ needed), they produce certifiably correct outputs. Internal verifiers assess solution quality mid-process; landscapes quantify confidence.",[22,4636,4637],{},"Logical Intelligence targets code gen and chip design, where LLMs falter. Bodnia predicts EBMs bridge the adoption gap in banking, aviation, and beyond, automating without risk.",[17,4639,4641],{"id":4640},"signs-of-llm-plateau-and-ebm-momentum","Signs of LLM Plateau and EBM Momentum",[22,4643,4644],{},"Bodnia observes LLM progress stalling: scaling laws yield diminishing returns as language ceilings hit. Non-language tasks expose limits; mission-critical sectors demand alternatives.",[22,4646,4647],{},"\"LLM progress is plateauing,\" she states at 00:43:21 timestamp context. EBMs, inspectable and efficient, position Logical Intelligence as a foundational player. Shipper probes trade-offs, but Bodnia emphasizes EBMs' universality for verifiable AI everywhere.",[17,4649,4651],{"id":4650},"key-takeaways","Key Takeaways",[4653,4654,4655,4659,4662,4665,4668,4671,4674,4677],"ul",{},[4656,4657,4658],"li",{},"Prioritize internal verifiers in AI architecture for mission-critical tasks; LLMs' black-box token generation can't self-correct hallucinations.",[4656,4660,4661],{},"Build energy landscapes to model data: map states to valleys\u002Fpeaks for probabilistic navigation without sequences.",[4656,4663,4664],{},"Ditch language dependency—process visual\u002Fspatial data natively to avoid embedding distortions in non-verbal reasoning.",[4656,4666,4667],{},"Combine EBM self-alignment with external tools like Lean 4 for double verification, slashing compute costs.",[4656,4669,4670],{},"Prototype on LLMs, deploy EBMs: hybrids accelerate verifiable code gen and chip design from plain English.",[4656,4672,4673],{},"Watch LLM scaling plateau; physics-based models like EBMs unlock deterministic AI for aviation, finance, and automation.",[4656,4675,4676],{},"Inspect models in real-time during training to control outcomes—EBMs make AI transparent, not a post-hoc guess.",[4656,4678,4679],{},"For behavior prediction (e.g., post-work routines), observe states directly; energy minimization reveals 'laws' like tired → relax.",{"title":59,"searchDepth":60,"depth":60,"links":4681},[4682,4683,4684,4685,4686,4687],{"id":4585,"depth":60,"text":4586},{"id":4598,"depth":60,"text":4599},{"id":4614,"depth":60,"text":4615},{"id":4630,"depth":60,"text":4631},{"id":4640,"depth":60,"text":4641},{"id":4650,"depth":60,"text":4651},[],{"content_references":4690,"triage":4697},[4691,4693],{"type":4551,"title":4692,"context":76},"Lean 4",{"type":4551,"title":4694,"url":4695,"context":4696},"Granola","http:\u002F\u002Fgranola.ai\u002Fevery","recommended",{"relevance":79,"novelty":79,"quality":79,"actionability":78,"composite":4698,"reasoning":4699},3.8,"Category: AI & LLMs. The article critiques LLMs for critical applications and introduces energy-based models as a solution, addressing a specific pain point regarding reliability in mission-critical systems. It provides insights into the limitations of LLMs and presents a novel alternative, making it relevant and actionable for those exploring AI integration.","\u002Fsummaries\u002Feve-bodnia-ebms-fix-what-llms-can-t-for-critical-t-summary","2026-04-15 15:00:53","2026-04-19 03:30:59",{"title":4575,"description":59},{"loc":4700},"9aa350456b8c67ba","Every","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=Q-i8ZSUCtIc","summaries\u002Feve-bodnia-ebms-fix-what-llms-can-t-for-critical-t-summary",[96,94,97],"Eve Bodnia critiques LLMs' hallucinations and language bias for mission-critical uses like chip design; her energy-based models (EBMs) enable verifiable AI via physics-inspired energy landscapes, inspectable reasoning, and token-free processing.",[97],"Ie5m7oOFB8sKieM5HfDnINFGfHMHcNZPYJCP517P2VE",{"id":4714,"title":4715,"ai":4716,"body":4721,"categories":4877,"created_at":67,"date_modified":67,"description":59,"extension":68,"faq":67,"featured":69,"kicker_label":67,"meta":4878,"navigation":82,"path":4909,"published_at":67,"question":67,"scraped_at":4910,"seo":4911,"sitemap":4912,"source_id":4913,"source_name":4914,"source_type":90,"source_url":4915,"stem":4916,"tags":4917,"thumbnail_url":67,"tldr":4918,"tweet":67,"unknown_tags":4919,"__hash__":4920},"summaries\u002Fsummaries\u002Fgemma-2-open-llms-trained-on-13t-tokens-top-benchm-summary.md","Gemma 2: Open LLMs Trained on 13T Tokens, Top Benchmarks",{"provider":7,"model":8,"input_tokens":4717,"output_tokens":4718,"processing_time_ms":4719,"cost_usd":4720},6087,2342,14579,0.0023659,{"type":14,"value":4722,"toc":4872},[4723,4727,4730,4733,4801,4805,4808,4811,4815,4818,4821,4869],[17,4724,4726],{"id":4725},"deploy-high-performance-llms-on-limited-hardware","Deploy High-Performance LLMs on Limited Hardware",[22,4728,4729],{},"Gemma 2 models (2B, 9B, 27B parameters) are text-to-text, decoder-only LLMs optimized for question answering, summarization, and reasoning. Their small size enables deployment on laptops, desktops, or personal cloud setups, unlike larger models needing massive clusters. Train the 27B on 13T tokens, 9B on 8T, and 2B on 2T from diverse sources like web docs, code, math\u002Fscience, and multilingual text. Preprocessing filters duplicates, PII, low-quality content, and adult material using heuristics and classifiers, ensuring broad task coverage without common failure modes.",[22,4731,4732],{},"On benchmarks, larger variants excel: 27B PT hits 75.2 MMLU (5-shot), 86.4 HellaSwag (10-shot), 51.8 HumanEval pass@1, 74.0 GSM8K (5-shot maj@1); 9B PT at 71.3 MMLU, 40.2 HumanEval; 2B PT at 51.3 MMLU. They surpass comparably-sized open alternatives across reasoning (ARC-c 71.4 for 27B), QA (TriviaQA 83.7), and math (MATH 42.3), proving state-of-the-art efficiency.",[4734,4735,4736,4755],"table",{},[4737,4738,4739],"thead",{},[4740,4741,4742,4746,4749,4752],"tr",{},[4743,4744,4745],"th",{},"Benchmark",[4743,4747,4748],{},"2B PT",[4743,4750,4751],{},"9B PT",[4743,4753,4754],{},"27B PT",[4756,4757,4758,4773,4787],"tbody",{},[4740,4759,4760,4764,4767,4770],{},[4761,4762,4763],"td",{},"MMLU 5-shot",[4761,4765,4766],{},"51.3",[4761,4768,4769],{},"71.3",[4761,4771,4772],{},"75.2",[4740,4774,4775,4778,4781,4784],{},[4761,4776,4777],{},"HumanEval pass@1",[4761,4779,4780],{},"17.7",[4761,4782,4783],{},"40.2",[4761,4785,4786],{},"51.8",[4740,4788,4789,4792,4795,4798],{},[4761,4790,4791],{},"GSM8K 5-shot",[4761,4793,4794],{},"23.9",[4761,4796,4797],{},"68.6",[4761,4799,4800],{},"74.0",[17,4802,4804],{"id":4803},"train-efficiently-with-tpuv5p-jax-and-pathways","Train Efficiently with TPUv5p, JAX, and Pathways",[22,4806,4807],{},"Leverage TPUv5p hardware for matrix-heavy training, offering higher throughput than GPUs for LLMs. Use JAX for hardware acceleration and ML Pathways for multi-task orchestration in a single Python process, simplifying workflows as in Gemini papers. This combo scales to 13T tokens while cutting development overhead—ideal for replicating on custom infra.",[22,4809,4810],{},"Data mix includes web, code, math, and polyglot sources; dedupe at sentence\u002Fparagraph levels, filter via quality classifiers, and remove PII\u002Fadult content to boost generalization without memorization risks.",[17,4812,4814],{"id":4813},"pass-safety-and-dangerous-capability-thresholds","Pass Safety and Dangerous Capability Thresholds",[22,4816,4817],{},"Instruction-tuned (IT) variants score low toxicity (RealToxicity 8.84 avg for 27B IT) and bias (CrowS-Pairs 36.67 top-1), with strong BBQ (86.94 Disambig for 27B) and TruthfulQA (51.60). They meet Google's internal policies on child safety, harms, and memorization.",[22,4819,4820],{},"Dangerous evals cap risks: 27B IT solves 34\u002F76 InterCode-CTF cyber challenges (low success), 1\u002F13 internal CTF, 0\u002F13 HackTheBox; persuasion tests show 81% find it interesting but minimal harmful shifts (1% toward incorrect beliefs, £3.72 mean donation). Mitigate via preprocessing, post-training, and monitoring—users must add safeguards for production.",[4734,4822,4823,4839],{},[4737,4824,4825],{},[4740,4826,4827,4830,4833,4836],{},[4743,4828,4829],{},"Safety Benchmark",[4743,4831,4832],{},"2B IT",[4743,4834,4835],{},"9B IT",[4743,4837,4838],{},"27B IT",[4756,4840,4841,4855],{},[4740,4842,4843,4846,4849,4852],{},[4761,4844,4845],{},"RealToxicity avg",[4761,4847,4848],{},"8.16",[4761,4850,4851],{},"8.25",[4761,4853,4854],{},"8.84",[4740,4856,4857,4860,4863,4866],{},[4761,4858,4859],{},"TruthfulQA",[4761,4861,4862],{},"43.72",[4761,4864,4865],{},"50.27",[4761,4867,4868],{},"51.60",[22,4870,4871],{},"Limitations: May amplify biases, hallucinate, or violate policies without filters; not for high-risk uses like medical\u002Flegal advice.",{"title":59,"searchDepth":60,"depth":60,"links":4873},[4874,4875,4876],{"id":4725,"depth":60,"text":4726},{"id":4803,"depth":60,"text":4804},{"id":4813,"depth":60,"text":4814},[],{"content_references":4879,"triage":4906},[4880,4887,4890,4893,4897,4900,4903],{"type":4881,"title":4882,"author":4883,"publisher":4884,"url":4885,"context":4886},"paper","Gemma","Gemma Team","Kaggle","https:\u002F\u002Fwww.kaggle.com\u002Fm\u002F3301","cited",{"type":4881,"title":4888,"url":4889,"context":4886},"Gemma 2 technical report","https:\u002F\u002Fstorage.googleapis.com\u002Fdeepmind-media\u002Fgemma\u002Fgemma-2-report.pdf",{"type":4881,"title":4891,"url":4892,"context":4886},"Evaluating Frontier Models for Dangerous Capabilities","https:\u002F\u002Farxiv.org\u002Fabs\u002F2403.13793",{"type":4894,"title":4895,"url":4896,"context":4886},"report","2023 Google AI Principles Progress Update","https:\u002F\u002Fstorage.googleapis.com\u002Fgweb-uniblog-publish-prod\u002Fdocuments\u002F2023_Google_AI_Principles_Progress_Update.pdf#page=11",{"type":4551,"title":4898,"url":4899,"context":76},"Tensor Processing Unit (TPU)","https:\u002F\u002Fcloud.google.com\u002Ftpu\u002Fdocs\u002Fintro-to-tpu",{"type":4551,"title":4901,"url":4902,"context":76},"JAX","https:\u002F\u002Fgithub.com\u002Fjax-ml\u002Fjax",{"type":73,"title":4904,"url":4905,"context":76},"ML Pathways","https:\u002F\u002Fblog.google\u002Ftechnology\u002Fai\u002Fintroducing-pathways-next-generation-ai-architecture\u002F",{"relevance":79,"novelty":78,"quality":79,"actionability":78,"composite":4907,"reasoning":4908},3.6,"Category: AI & LLMs. The article discusses the performance and deployment of the Gemma 2 LLMs, which addresses the audience's interest in practical AI applications. It provides insights into model efficiency and training techniques, but lacks detailed actionable steps for implementation.","\u002Fsummaries\u002Fgemma-2-open-llms-trained-on-13t-tokens-top-benchm-summary","2026-04-16 03:04:59",{"title":4715,"description":59},{"loc":4909},"5f72f336c67bc8d8","__oneoff__","https:\u002F\u002Fai.google.dev\u002Fgemma\u002Fdocs\u002Fcore\u002Fmodel_card_2","summaries\u002Fgemma-2-open-llms-trained-on-13t-tokens-top-benchm-summary",[94,95,96],"Google's Gemma 2 family (2B, 9B, 27B params) are lightweight open decoder-only LLMs trained on 2-13T tokens, outperforming similar-sized open models on MMLU (75.2 for 27B), HumanEval (51.8), and safety benchmarks while running on laptops.",[],"Z2M7c8HxkhbGonJY2QBI8o5jbVHIoo_g4Sn0AINw8jQ",{"id":4922,"title":4923,"ai":4924,"body":4929,"categories":4962,"created_at":67,"date_modified":67,"description":59,"extension":68,"faq":67,"featured":69,"kicker_label":67,"meta":4963,"navigation":82,"path":4976,"published_at":4977,"question":67,"scraped_at":4978,"seo":4979,"sitemap":4980,"source_id":4981,"source_name":4982,"source_type":90,"source_url":4983,"stem":4984,"tags":4985,"thumbnail_url":67,"tldr":4987,"tweet":67,"unknown_tags":4988,"__hash__":4989},"summaries\u002Fsummaries\u002Fdeepseek-s-visual-primitives-10x-kv-cache-efficien-summary.md","DeepSeek's Visual Primitives: 10x KV Cache Efficiency",{"provider":7,"model":8,"input_tokens":4925,"output_tokens":4926,"processing_time_ms":4927,"cost_usd":4928},6138,2040,25012,0.00174075,{"type":14,"value":4930,"toc":4957},[4931,4935,4943,4947,4950,4954],[17,4932,4934],{"id":4933},"visual-primitives-fix-reference-gaps-in-multimodal-chain-of-thought","Visual Primitives Fix Reference Gaps in Multimodal Chain-of-Thought",[22,4936,4937,4938,4942],{},"Current multimodal models suffer from a 'reference gap': even with perfect perception, language descriptions lose precision in long reasoning (e.g., 'third bear from the left'). DeepSeek solves this by treating bounding boxes and points as first-class tokens in the vocabulary, output inline during chain-of-thought. For a team photo count query, the model generates tags like [label:person]",[4939,4940,4941],"span",{},"box:(x1,y1,x2,y2)"," for each entity, enabling reliable counting in dense scenes, multi-hop spatial reasoning, and disambiguating visuals like Chihuahua vs. muffin. This builds on DeepSeek's 2-year lineage prioritizing cheap representations: DeepSeek-VL (hybrid SIGLIP\u002FSAM encoders), Janus (decoupled understanding\u002Fgeneration encoders), DeepSeek-VL2 (MoE\u002FMLHA for 1B active params scoring 80.9 OCR\u002F88.9 DocVQA), Janus-Pro-7B (runs on consumer GPU, beats DALL-E 3 at 80% on GenEval), and DeepSeek-OCR (renders 1000 text tokens to image for 97% accurate 100-token compression). The throughline: seek minimal representations that preserve info, like pixels over tokens (per Karpathy: 'the tokenizer must go').",[17,4944,4946],{"id":4945},"architecture-delivers-7000x-compression-on-deepseek-v4-flash","Architecture Delivers 7000x Compression on DeepSeek-V4 Flash",[22,4948,4949],{},"Base is standard: image → custom Vision Transformer (arbitrary resolution, 14x14 patches) → LLM (DeepSeek-V4 Flash: 284B MoE, 13B active params) ← text tokenizer; detokenizer on output. Efficiency magic in ViT: 756x756 image (571k pixels) → 2916 patch tokens → 3x3 channel compression to 324 tokens → V4's compressed sparse attention for 4x KV reduction → 81 KV entries (7000x compression). An 80x80 image uses 90 KV entries vs. Sonnet 4.6's 870 or Gemini 3 Flash's ~1000—10x less compute. Training: (1) trillions-scale pretrain; (2) SFT on separate box\u002Fpoint grounding models; (3) GRPO RL with format\u002Fquality\u002Faccuracy rewards; (4) unified RFD merge; (5) on-policy distillation to single student. Result: frontier reasoning at 1\u002F10th vision inference cost.",[17,4951,4953],{"id":4952},"strong-grounded-reasoning-wins-but-limited-to-triggered-use","Strong Grounded Reasoning Wins, But Limited to Triggered Use",[22,4955,4956],{},"Excels on pointer-dependent tasks: 67% maze navigation (vs. 49% Gemini 3 Flash\u002FGPT-4o\u002FSonnet 4.6); doubles path tracing scores; ties\u002Fwins counting\u002Fspatial. Gemini 3 Flash leads raw count QA, but primitives boost topology where language fails trajectories. Caveats (per paper): scores only on relevant subsets, not overall superiority; resolution-bound (fine scenes fail); explicit trigger needed (no auto-use); point reasoning generalizes poorly across scenarios. DeepSeek emphasizes honesty vs. hype. Rollout started April 29, 2025, in app\u002Fweb fast\u002Fexpert modes; paper briefly on GitHub.",{"title":59,"searchDepth":60,"depth":60,"links":4958},[4959,4960,4961],{"id":4933,"depth":60,"text":4934},{"id":4945,"depth":60,"text":4946},{"id":4952,"depth":60,"text":4953},[140],{"content_references":4964,"triage":4974},[4965,4968,4971],{"type":4881,"title":4966,"url":4967,"context":4886},"Thinking with Visual Primitives","https:\u002F\u002Fgithub.com\u002Failuntx\u002FThinking-with-Visual-Primitives\u002Fblob\u002Fmain\u002FThinking_with_Visual_Primitives.pdf",{"type":4881,"title":4969,"author":4970,"context":4886},"Highly Efficient Million Token Context Intelligence","DeepSeek V4",{"type":4551,"title":4972,"url":4973,"context":76},"whryte.com","https:\u002F\u002Fwhryte.com",{"relevance":78,"novelty":79,"quality":79,"actionability":60,"composite":4558,"reasoning":4975},"Category: AI & LLMs. The article discusses a novel approach to improving KV cache efficiency in multimodal models, addressing a specific technical challenge that could interest AI developers. However, it lacks actionable steps for implementation, making it less practical for immediate application.","\u002Fsummaries\u002Fdeepseek-s-visual-primitives-10x-kv-cache-efficien-summary","2026-05-02 13:00:09","2026-05-03 16:54:07",{"title":4923,"description":59},{"loc":4976},"09bf8ca335e756a3","Prompt Engineering","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=315Xn6h_e_4","summaries\u002Fdeepseek-s-visual-primitives-10x-kv-cache-efficien-summary",[94,96,97,4986],"ai-news","DeepSeek's 'Thinking with Visual Primitives' embeds bounding boxes and points as inline chain-of-thought tokens to solve visual reference gaps, compressing KV cache 10x (90 entries vs. 870 for Sonnet on 80x80 images) for frontier-grade vision at 1\u002F10th cost.",[97,4986],"3mHrMKH2jVswTjYHWm5JAOiilB2AMyQPDYqF11jKDmc"]