[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"summary-663c736737905d03-vibevoice-realtime-0-5b-300ms-streaming-tts-model-summary":3,"summaries-facets-categories":99,"summary-related-663c736737905d03-vibevoice-realtime-0-5b-300ms-streaming-tts-model-summary":3669},{"id":4,"title":5,"ai":6,"body":13,"categories":52,"created_at":53,"date_modified":53,"description":46,"extension":54,"faq":53,"featured":55,"kicker_label":53,"meta":56,"navigation":82,"path":83,"published_at":53,"question":53,"scraped_at":84,"seo":85,"sitemap":86,"source_id":87,"source_name":88,"source_type":89,"source_url":90,"stem":91,"tags":92,"thumbnail_url":53,"tldr":96,"tweet":53,"unknown_tags":97,"__hash__":98},"summaries\u002Fsummaries\u002F663c736737905d03-vibevoice-realtime-0-5b-300ms-streaming-tts-model-summary.md","VibeVoice-Realtime-0.5B: 300ms Streaming TTS Model",{"provider":7,"model":8,"input_tokens":9,"output_tokens":10,"processing_time_ms":11,"cost_usd":12},"openrouter","x-ai\u002Fgrok-4.1-fast",5279,1858,17075,0.00147795,{"type":14,"value":15,"toc":45},"minimark",[16,21,25,29,32,36],[17,18,20],"h2",{"id":19},"build-real-time-tts-with-interleaved-streaming-design","Build Real-Time TTS with Interleaved Streaming Design",[22,23,24],"p",{},"Integrate VibeVoice-Realtime-0.5B to generate speech from streaming text inputs, producing initial audio in ~300ms (hardware-dependent) for live narration or LLM responses. The 0.5B parameter model uses an interleaved, windowed architecture: it encodes incoming text chunks incrementally while parallel diffusion-based acoustic latent generation continues from prior context. This drops the semantic tokenizer of larger variants, relying on an efficient acoustic tokenizer at 7.5 Hz frame rate for low latency. Supports up to 8k context (~10min generation), single English speaker (multilingual like German\u002FFrench\u002FItalian\u002FJapanese\u002FKorean\u002FDutch\u002FPolish\u002FPortuguese\u002FSpanish works reasonably). Launch websocket demos via GitHub for real-time apps; plug into any LLM for token-by-token speech before full responses complete. Trade-off: no multi-speaker or overlapping speech—use larger VibeVoice models (1.5B\u002F64k ctx or Large\u002F32k ctx) for conversations.",[17,26,28],{"id":27},"outperform-baselines-on-zero-shot-tts-benchmarks","Outperform Baselines on Zero-Shot TTS Benchmarks",[22,30,31],{},"Deploy for production-like quality: on LibriSpeech test-clean, achieves 2.00% WER (↓ better) and 0.695 speaker similarity (↑ better), topping VALL-E 2 (2.40%\u002F0.643), Voicebox (1.90%\u002F0.662), and MELLE (2.10%\u002F0.625). On SEED test-en, hits 2.05% WER\u002F0.633 similarity, edging MaskGCT (2.62%\u002F0.714), Seed-TTS (2.25%\u002F0.762), FireRedTTS (3.82%\u002F0.460), SparkTTS (1.98%\u002F0.584), and CosyVoice2 (2.57%\u002F0.652). Excels in long-form over short sentences; transformer LLM (Qwen2.5 0.5B base) + acoustic tokenizer + diffusion head enables this without full retraining.",[17,33,35],{"id":34},"mitigate-risks-in-research-deployments","Mitigate Risks in Research Deployments",[22,37,38,39,44],{},"For research-only: install via GitHub README, avoiding commercial use without testing. Pre-process inputs to strip code\u002Fformulas\u002Fsymbols (unsupported). Limitations: English-focused (non-English unpredictable), no non-speech audio\u002Foverlaps; inherits Qwen2.5 biases. Safeguards include auto-embedded 'This segment was generated by AI' disclaimer, imperceptible watermark for provenance verification, and removed acoustic tokenizer to block custom embeddings. Disclose AI use; comply with laws\u002FMIT license. Contact ",[40,41,43],"a",{"href":42},"mailto:VibeVoice@microsoft.com","VibeVoice@microsoft.com"," for issues—Microsoft Research welcomes feedback.",{"title":46,"searchDepth":47,"depth":47,"links":48},"",2,[49,50,51],{"id":19,"depth":47,"text":20},{"id":27,"depth":47,"text":28},{"id":34,"depth":47,"text":35},[],null,"md",false,{"content_references":57,"triage":77},[58,63,66,70,74],{"type":59,"title":60,"url":61,"context":62},"paper","VibeVoice Technical Report","https:\u002F\u002Farxiv.org\u002Fabs\u002F2508.19205","cited",{"type":59,"title":64,"context":65},"Multimodal Latent Language Modeling with Next-Token Diffusion","mentioned",{"type":67,"title":68,"url":69,"context":65},"tool","VibeVoice Code","https:\u002F\u002Fgithub.com\u002Fmicrosoft\u002FVibeVoice",{"type":71,"title":72,"url":73,"context":65},"other","VibeVoice Project Page","https:\u002F\u002Fmicrosoft.github.io\u002FVibeVoice",{"type":67,"title":75,"url":76,"context":65},"VibeVoice-Realtime-0.5B App","https:\u002F\u002Fhuggingface.co\u002Fspaces\u002Fanycoderapps\u002FVibeVoice-Realtime-0.5B",{"relevance":78,"novelty":79,"quality":78,"actionability":78,"composite":80,"reasoning":81},4,3,3.8,"Category: AI & LLMs. The article discusses a specific AI model for real-time text-to-speech (TTS) generation, which is relevant for developers looking to integrate AI features into their products. It provides actionable insights on implementation and performance benchmarks, making it useful for those building AI-powered applications.",true,"\u002Fsummaries\u002F663c736737905d03-vibevoice-realtime-0-5b-300ms-streaming-tts-model-summary","2026-04-14 14:33:42",{"title":5,"description":46},{"loc":83},"663c736737905d03","__oneoff__","article","https:\u002F\u002Fhuggingface.co\u002Fmicrosoft\u002FVibeVoice-Realtime-0.5B","summaries\u002F663c736737905d03-vibevoice-realtime-0-5b-300ms-streaming-tts-model-summary",[93,94,95],"ai-tools","llm","machine-learning","Microsoft's 0.5B param TTS model streams text input for real-time speech output in ~300ms, handles ~10min long-form English audio, beats benchmarks on WER (2.00% LibriSpeech) while adding multilingual support.",[],"b55YrFS-Cg5QXviMOtiwKnfVfQUtIng7M-aT4JHBXJM",[100,103,106,109,112,115,117,119,121,123,125,127,130,132,134,136,138,140,142,144,146,148,151,154,156,158,161,163,165,168,170,172,174,176,178,180,182,184,186,188,190,192,194,196,198,200,202,204,206,208,210,212,214,216,218,220,222,224,226,228,230,232,234,236,238,240,242,244,246,248,250,252,254,256,258,260,262,264,266,268,270,272,274,276,278,280,282,284,286,288,290,292,294,296,298,300,302,304,306,308,310,312,314,316,318,320,322,324,326,328,330,332,334,336,338,340,342,344,346,348,350,352,354,356,358,360,362,364,366,368,370,372,374,376,378,380,382,384,386,388,390,392,394,396,398,400,402,404,406,408,410,412,414,416,418,420,423,425,427,429,431,433,435,437,439,441,443,445,447,449,451,453,455,457,459,461,463,465,467,469,471,473,475,477,479,481,483,485,487,489,491,493,495,497,499,501,503,505,507,509,511,513,515,517,519,521,523,525,527,529,531,533,535,537,539,541,543,545,547,549,551,553,555,557,559,561,563,565,567,569,571,573,575,577,579,581,583,585,587,589,591,593,595,597,599,601,603,605,607,609,611,613,615,617,619,621,623,625,627,629,631,633,635,637,639,641,643,645,647,649,651,653,655,657,659,661,663,665,667,669,671,673,675,677,679,681,683,685,687,689,691,693,695,697,699,701,703,705,707,709,711,713,715,717,719,721,723,725,727,729,731,733,735,737,739,741,743,745,747,749,751,753,755,757,759,761,763,765,767,769,771,773,775,777,779,781,783,785,787,789,791,793,795,797,799,801,803,805,807,809,811,813,815,817,819,821,823,825,827,829,831,833,835,837,839,841,843,845,847,849,851,853,855,857,859,861,863,865,867,869,871,873,875,877,879,881,883,885,887,889,891,893,895,897,899,901,903,905,907,909,911,913,915,917,919,921,923,925,927,929,931,933,935,937,939,941,943,945,947,949,951,953,955,957,959,961,963,965,967,969,971,973,975,977,979,981,983,985,987,989,991,993,995,997,999,1001,1003,1005,1007,1009,1011,1013,1015,1017,1019,1021,1023,1025,1027,1029,1031,1033,1035,1037,1039,1041,1043,1045,1047,1049,1051,1053,1055,1057,1059,1061,1063,1065,1067,1069,1071,1073,1075,1077,1079,1081,1083,1085,1087,1089,1091,1093,1095,1097,1099,1101,1103,1105,1107,1109,1111,1113,1115,1117,1119,1121,1123,1125,1127,1129,1131,1133,1135,1137,1139,1141,1143,1145,1147,1149,1151,1153,1155,1157,1159,1161,1163,1165,1167,1169,1171,1173,1175,1177,1179,1181,1183,1185,1187,1189,1191,1193,1195,1197,1199,1201,1203,1205,1207,1209,1211,1213,1215,1217,1219,1221,1223,1225,1227,1229,1231,1233,1235,1237,1239,1241,1243,1245,1247,1249,1251,1253,1255,1257,1259,1261,1263,1265,1267,1269,1271,1273,1275,1277,1279,1281,1283,1285,1287,1289,1291,1293,1295,1297,1299,1301,1303,1305,1307,1309,1311,1313,1315,1317,1319,1321,1323,1325,1327,1329,1331,1333,1335,1337,1339,1341,1343,1345,1347,1349,1351,1353,1355,1357,1359,1361,1363,1365,1367,1369,1371,1373,1375,1377,1379,1381,1383,1385,1387,1389,1391,1393,1395,1397,1399,1401,1403,1405,1407,1409,1411,1413,1415,1417,1419,1421,1423,1425,1427,1429,1431,1433,1435,1437,1439,1441,1443,1445,1447,1449,1451,1453,1455,1457,1459,1461,1463,1465,1467,1469,1471,1473,1475,1477,1479,1481,1483,1485,1487,1489,1491,1493,1495,1497,1499,1501,1503,1505,1507,1509,1511,1513,1515,1517,1519,1521,1523,1525,1527,1529,1531,1533,1535,1537,1539,1541,1543,1545,1547,1549,1551,1553,1555,1557,1559,1561,1563,1565,1567,1569,1571,1573,1575,1577,1579,1581,1583,1585,1587,1589,1591,1593,1595,1597,1599,1601,1603,1605,1607,1609,1611,1613,1615,1617,1619,1621,1623,1625,1627,1629,1631,1633,1635,1637,1639,1641,1643,1645,1647,1649,1651,1653,1655,1657,1659,1661,1663,1665,1667,1669,1671,1673,1675,1677,1679,1681,1683,1685,1687,1689,1691,1693,1695,1697,1699,1701,1703,1705,1707,1709,1711,1713,1715,1717,1719,1721,1723,1725,1727,1729,1731,1733,1735,1737,1739,1741,1743,1745,1747,1749,1751,1753,1755,1757,1759,1761,1763,1765,1767,1769,1771,1773,1775,1777,1779,1781,1783,1785,1787,1789,1791,1793,1795,1797,1799,1801,1803,1805,1807,1809,1811,1813,1815,1817,1819,1821,1823,1825,1827,1829,1831,1833,1835,1837,1839,1841,1843,1845,1847,1849,1851,1853,1855,1857,1859,1861,1863,1865,1867,1869,1871,1873,1875,1877,1879,1881,1883,1885,1887,1889,1891,1893,1895,1897,1899,1901,1903,1905,1907,1909,1911,1913,1915,1917,1919,1921,1923,1925,1927,1929,1931,1933,1935,1937,1939,1941,1943,1945,1947,1949,1951,1953,1955,1957,1959,1961,1963,1965,1967,1969,1971,1973,1975,1977,1979,1981,1983,1985,1987,1989,1991,1993,1995,1997,1999,2001,2003,2005,2007,2009,2011,2013,2015,2017,2019,2021,2023,2025,2027,2029,2031,2033,2035,2037,2039,2041,2043,2045,2047,2049,2051,2053,2055,2057,2059,2061,2063,2065,2067,2069,2071,2073,2075,2077,2079,2081,2083,2085,2087,2089,2091,2093,2095,2097,2099,2101,2103,2105,2107,2109,2111,2113,2115,2117,2119,2121,2123,2125,2127,2129,2131,2133,2135,2137,2139,2141,2143,2145,2147,2149,2151,2153,2155,2157,2159,2161,2163,2165,2167,2169,2171,2173,2175,2177,2179,2181,2183,2185,2187,2189,2191,2193,2195,2197,2199,2201,2203,2205,2207,2209,2211,2213,2215,2217,2219,2221,2223,2225,2227,2229,2231,2233,2235,2237,2239,2241,2243,2245,2247,2249,2251,2253,2255,2257,2259,2261,2263,2265,2267,2269,2271,2273,2275,2277,2279,2281,2283,2285,2287,2289,2291,2293,2295,2297,2299,2301,2303,2305,2307,2309,2311,2313,2315,2317,2319,2321,2323,2325,2327,2329,2331,2333,2335,2337,2339,2341,2343,2345,2347,2349,2351,2353,2355,2357,2359,2361,2363,2365,2367,2369,2371,2373,2375,2377,2379,2381,2383,2385,2387,2389,2391,2393,2395,2397,2399,2401,2403,2405,2407,2409,2411,2413,2415,2417,2419,2421,2423,2425,2427,2429,2431,2433,2435,2437,2439,2441,2443,2445,2447,2449,2451,2453,2455,2457,2459,2461,2463,2465,2467,2469,2471,2473,2475,2477,2479,2481,2483,2485,2487,2489,2491,2493,2495,2497,2499,2501,2503,2505,2507,2509,2511,2513,2515,2517,2519,2521,2523,2525,2527,2529,2531,2533,2535,2537,2539,2541,2543,2545,2547,2549,2551,2553,2555,2557,2559,2561,2563,2565,2567,2569,2571,2573,2575,2577,2579,2581,2583,2585,2587,2589,2591,2593,2595,2597,2599,2601,2603,2605,2607,2609,2611,2613,2615,2617,2619,2621,2623,2625,2627,2629,2631,2633,2635,2637,2639,2641,2643,2645,2647,2649,2651,2653,2655,2657,2659,2661,2663,2665,2667,2669,2671,2673,2675,2677,2679,2681,2683,2685,2687,2689,2691,2693,2695,2697,2699,2701,2703,2705,2707,2709,2711,2713,2715,2717,2719,2721,2723,2725,2727,2729,2731,2733,2735,2737,2739,2741,2743,2745,2747,2749,2751,2753,2755,2757,2759,2761,2763,2765,2767,2769,2771,2773,2775,2777,2779,2781,2783,2785,2787,2789,2791,2793,2795,2797,2799,2801,2803,2805,2807,2809,2811,2813,2815,2817,2819,2821,2823,2825,2827,2829,2831,2833,2835,2837,2839,2841,2843,2845,2847,2849,2851,2853,2855,2857,2859,2861,2863,2865,2867,2869,2871,2873,2875,2877,2879,2881,2883,2885,2887,2889,2891,2893,2895,2897,2899,2901,2903,2905,2907,2909,2911,2913,2915,2917,2919,2921,2923,2925,2927,2929,2931,2933,2935,2937,2939,2941,2943,2945,2947,2949,2951,2953,2955,2957,2959,2961,2963,2965,2967,2969,2971,2973,2975,2977,2979,2981,2983,2985,2987,2989,2991,2993,2995,2997,2999,3001,3003,3005,3007,3009,3011,3013,3015,3017,3019,3021,3023,3025,3027,3029,3031,3033,3035,3037,3039,3041,3043,3045,3047,3049,3051,3053,3055,3057,3059,3061,3063,3065,3067,3069,3071,3073,3075,3077,3079,3081,3083,3085,3087,3089,3091,3093,3095,3097,3099,3101,3103,3105,3107,3109,3111,3113,3115,3117,3119,3121,3123,3125,3127,3129,3131,3133,3135,3137,3139,3141,3143,3145,3147,3149,3151,3153,3155,3157,3159,3161,3163,3165,3167,3169,3171,3173,3175,3177,3179,3181,3183,3185,3187,3189,3191,3193,3195,3197,3199,3201,3203,3205,3207,3209,3211,3213,3215,3217,3219,3221,3223,3225,3227,3229,3231,3233,3235,3237,3239,3241,3243,3245,3247,3249,3251,3253,3255,3257,3259,3261,3263,3265,3267,3269,3271,3273,3275,3277,3279,3281,3283,3285,3287,3289,3291,3293,3295,3297,3299,3301,3303,3305,3307,3309,3311,3313,3315,3317,3319,3321,3323,3325,3327,3329,3331,3333,3335,3337,3339,3341,3343,3345,3347,3349,3351,3353,3355,3357,3359,3361,3363,3365,3367,3369,3371,3373,3375,3377,3379,3381,3383,3385,3387,3389,3391,3393,3395,3397,3399,3401,3403,3405,3407,3409,3411,3413,3415,3417,3419,3421,3423,3425,3427,3429,3431,3433,3435,3437,3439,3441,3443,3445,3447,3449,3451,3453,3455,3457,3459,3461,3463,3465,3467,3469,3471,3473,3475,3477,3479,3481,3483,3485,3487,3489,3491,3493,3495,3497,3499,3501,3503,3505,3507,3509,3511,3513,3515,3517,3519,3521,3523,3525,3527,3529,3531,3533,3535,3537,3539,3541,3543,3545,3547,3549,3551,3553,3555,3557,3559,3561,3563,3565,3567,3569,3571,3573,3575,3577,3579,3581,3583,3585,3587,3589,3591,3593,3595,3597,3599,3601,3603,3605,3607,3609,3611,3613,3615,3617,3619,3621,3623,3625,3627,3629,3631,3633,3635,3637,3639,3641,3643,3645,3647,3649,3651,3653,3655,3657,3659,3661,3663,3665,3667],{"categories":101},[102],"Developer Productivity",{"categories":104},[105],"Business & SaaS",{"categories":107},[108],"AI & LLMs",{"categories":110},[111],"AI Automation",{"categories":113},[114],"Product Strategy",{"categories":116},[108],{"categories":118},[102],{"categories":120},[105],{"categories":122},[],{"categories":124},[108],{"categories":126},[],{"categories":128},[129],"AI News & Trends",{"categories":131},[111],{"categories":133},[129],{"categories":135},[111],{"categories":137},[111],{"categories":139},[108],{"categories":141},[108],{"categories":143},[129],{"categories":145},[108],{"categories":147},[],{"categories":149},[150],"Design & Frontend",{"categories":152},[153],"Data Science & Visualization",{"categories":155},[129],{"categories":157},[],{"categories":159},[160],"Software Engineering",{"categories":162},[108],{"categories":164},[111],{"categories":166},[167],"Marketing & Growth",{"categories":169},[108],{"categories":171},[111],{"categories":173},[],{"categories":175},[],{"categories":177},[150],{"categories":179},[111],{"categories":181},[102],{"categories":183},[150],{"categories":185},[108],{"categories":187},[111],{"categories":189},[129],{"categories":191},[],{"categories":193},[],{"categories":195},[111],{"categories":197},[160],{"categories":199},[],{"categories":201},[105],{"categories":203},[],{"categories":205},[],{"categories":207},[111],{"categories":209},[111],{"categories":211},[108],{"categories":213},[],{"categories":215},[160],{"categories":217},[],{"categories":219},[],{"categories":221},[],{"categories":223},[108],{"categories":225},[167],{"categories":227},[150],{"categories":229},[150],{"categories":231},[108],{"categories":233},[111],{"categories":235},[108],{"categories":237},[108],{"categories":239},[111],{"categories":241},[111],{"categories":243},[153],{"categories":245},[129],{"categories":247},[111],{"categories":249},[167],{"categories":251},[111],{"categories":253},[114],{"categories":255},[],{"categories":257},[111],{"categories":259},[],{"categories":261},[111],{"categories":263},[160],{"categories":265},[150],{"categories":267},[108],{"categories":269},[],{"categories":271},[],{"categories":273},[111],{"categories":275},[],{"categories":277},[108],{"categories":279},[],{"categories":281},[102],{"categories":283},[160],{"categories":285},[105],{"categories":287},[129],{"categories":289},[108],{"categories":291},[],{"categories":293},[108],{"categories":295},[],{"categories":297},[160],{"categories":299},[153],{"categories":301},[],{"categories":303},[108],{"categories":305},[150],{"categories":307},[],{"categories":309},[150],{"categories":311},[111],{"categories":313},[],{"categories":315},[111],{"categories":317},[129],{"categories":319},[108],{"categories":321},[],{"categories":323},[111],{"categories":325},[108],{"categories":327},[114],{"categories":329},[],{"categories":331},[108],{"categories":333},[111],{"categories":335},[111],{"categories":337},[],{"categories":339},[153],{"categories":341},[108],{"categories":343},[],{"categories":345},[102],{"categories":347},[105],{"categories":349},[108],{"categories":351},[111],{"categories":353},[160],{"categories":355},[108],{"categories":357},[],{"categories":359},[],{"categories":361},[108],{"categories":363},[],{"categories":365},[150],{"categories":367},[],{"categories":369},[108],{"categories":371},[],{"categories":373},[111],{"categories":375},[108],{"categories":377},[150],{"categories":379},[],{"categories":381},[108],{"categories":383},[108],{"categories":385},[105],{"categories":387},[111],{"categories":389},[108],{"categories":391},[150],{"categories":393},[111],{"categories":395},[],{"categories":397},[],{"categories":399},[129],{"categories":401},[],{"categories":403},[108],{"categories":405},[105,167],{"categories":407},[],{"categories":409},[108],{"categories":411},[],{"categories":413},[],{"categories":415},[108],{"categories":417},[],{"categories":419},[108],{"categories":421},[422],"DevOps & Cloud",{"categories":424},[],{"categories":426},[129],{"categories":428},[150],{"categories":430},[],{"categories":432},[129],{"categories":434},[129],{"categories":436},[108],{"categories":438},[167],{"categories":440},[],{"categories":442},[105],{"categories":444},[],{"categories":446},[108,422],{"categories":448},[108],{"categories":450},[108],{"categories":452},[111],{"categories":454},[108,160],{"categories":456},[153],{"categories":458},[108],{"categories":460},[167],{"categories":462},[111],{"categories":464},[111],{"categories":466},[],{"categories":468},[111],{"categories":470},[108,105],{"categories":472},[],{"categories":474},[150],{"categories":476},[150],{"categories":478},[],{"categories":480},[],{"categories":482},[129],{"categories":484},[],{"categories":486},[102],{"categories":488},[160],{"categories":490},[108],{"categories":492},[150],{"categories":494},[111],{"categories":496},[160],{"categories":498},[129],{"categories":500},[150],{"categories":502},[],{"categories":504},[108],{"categories":506},[108],{"categories":508},[108],{"categories":510},[129],{"categories":512},[102],{"categories":514},[108],{"categories":516},[111],{"categories":518},[422],{"categories":520},[150],{"categories":522},[111],{"categories":524},[],{"categories":526},[],{"categories":528},[150],{"categories":530},[129],{"categories":532},[153],{"categories":534},[],{"categories":536},[108],{"categories":538},[108],{"categories":540},[105],{"categories":542},[108],{"categories":544},[108],{"categories":546},[129],{"categories":548},[],{"categories":550},[111],{"categories":552},[160],{"categories":554},[],{"categories":556},[108],{"categories":558},[108],{"categories":560},[111],{"categories":562},[],{"categories":564},[],{"categories":566},[108],{"categories":568},[],{"categories":570},[105],{"categories":572},[111],{"categories":574},[],{"categories":576},[102],{"categories":578},[108],{"categories":580},[105],{"categories":582},[129],{"categories":584},[],{"categories":586},[],{"categories":588},[],{"categories":590},[129],{"categories":592},[129],{"categories":594},[],{"categories":596},[],{"categories":598},[105],{"categories":600},[],{"categories":602},[],{"categories":604},[102],{"categories":606},[],{"categories":608},[167],{"categories":610},[111],{"categories":612},[105],{"categories":614},[111],{"categories":616},[],{"categories":618},[114],{"categories":620},[150],{"categories":622},[160],{"categories":624},[108],{"categories":626},[111],{"categories":628},[105],{"categories":630},[108],{"categories":632},[],{"categories":634},[],{"categories":636},[160],{"categories":638},[153],{"categories":640},[114],{"categories":642},[111],{"categories":644},[108],{"categories":646},[],{"categories":648},[422],{"categories":650},[],{"categories":652},[111],{"categories":654},[],{"categories":656},[],{"categories":658},[108],{"categories":660},[150],{"categories":662},[167],{"categories":664},[111],{"categories":666},[],{"categories":668},[102],{"categories":670},[],{"categories":672},[129],{"categories":674},[108,422],{"categories":676},[129],{"categories":678},[108],{"categories":680},[105],{"categories":682},[108],{"categories":684},[],{"categories":686},[105],{"categories":688},[],{"categories":690},[160],{"categories":692},[150],{"categories":694},[129],{"categories":696},[153],{"categories":698},[102],{"categories":700},[108],{"categories":702},[160],{"categories":704},[],{"categories":706},[],{"categories":708},[114],{"categories":710},[],{"categories":712},[108],{"categories":714},[],{"categories":716},[150],{"categories":718},[150],{"categories":720},[150],{"categories":722},[],{"categories":724},[],{"categories":726},[129],{"categories":728},[111],{"categories":730},[108],{"categories":732},[108],{"categories":734},[108],{"categories":736},[105],{"categories":738},[108],{"categories":740},[],{"categories":742},[160],{"categories":744},[160],{"categories":746},[105],{"categories":748},[],{"categories":750},[108],{"categories":752},[108],{"categories":754},[105],{"categories":756},[129],{"categories":758},[167],{"categories":760},[111],{"categories":762},[],{"categories":764},[150],{"categories":766},[],{"categories":768},[108],{"categories":770},[],{"categories":772},[105],{"categories":774},[111],{"categories":776},[],{"categories":778},[422],{"categories":780},[153],{"categories":782},[160],{"categories":784},[167],{"categories":786},[160],{"categories":788},[111],{"categories":790},[],{"categories":792},[],{"categories":794},[111],{"categories":796},[102],{"categories":798},[111],{"categories":800},[114],{"categories":802},[105],{"categories":804},[],{"categories":806},[108],{"categories":808},[114],{"categories":810},[108],{"categories":812},[108],{"categories":814},[167],{"categories":816},[150],{"categories":818},[111],{"categories":820},[],{"categories":822},[],{"categories":824},[422],{"categories":826},[160],{"categories":828},[],{"categories":830},[111],{"categories":832},[108],{"categories":834},[150,108],{"categories":836},[102],{"categories":838},[],{"categories":840},[108],{"categories":842},[102],{"categories":844},[150],{"categories":846},[111],{"categories":848},[160],{"categories":850},[],{"categories":852},[108],{"categories":854},[],{"categories":856},[102],{"categories":858},[],{"categories":860},[111],{"categories":862},[114],{"categories":864},[108],{"categories":866},[108],{"categories":868},[150],{"categories":870},[111],{"categories":872},[422],{"categories":874},[150],{"categories":876},[111],{"categories":878},[108],{"categories":880},[108],{"categories":882},[108],{"categories":884},[129],{"categories":886},[],{"categories":888},[114],{"categories":890},[111],{"categories":892},[150],{"categories":894},[111],{"categories":896},[160],{"categories":898},[150],{"categories":900},[111],{"categories":902},[129],{"categories":904},[],{"categories":906},[108],{"categories":908},[150],{"categories":910},[108],{"categories":912},[102],{"categories":914},[129],{"categories":916},[108],{"categories":918},[167],{"categories":920},[108],{"categories":922},[108],{"categories":924},[111],{"categories":926},[111],{"categories":928},[108],{"categories":930},[111],{"categories":932},[150],{"categories":934},[108],{"categories":936},[],{"categories":938},[],{"categories":940},[160],{"categories":942},[],{"categories":944},[102],{"categories":946},[422],{"categories":948},[],{"categories":950},[102],{"categories":952},[105],{"categories":954},[167],{"categories":956},[],{"categories":958},[105],{"categories":960},[],{"categories":962},[],{"categories":964},[],{"categories":966},[],{"categories":968},[],{"categories":970},[108],{"categories":972},[111],{"categories":974},[422],{"categories":976},[102],{"categories":978},[108],{"categories":980},[160],{"categories":982},[114],{"categories":984},[108],{"categories":986},[167],{"categories":988},[108],{"categories":990},[108],{"categories":992},[108],{"categories":994},[108,102],{"categories":996},[160],{"categories":998},[160],{"categories":1000},[150],{"categories":1002},[108],{"categories":1004},[],{"categories":1006},[],{"categories":1008},[],{"categories":1010},[160],{"categories":1012},[153],{"categories":1014},[129],{"categories":1016},[150],{"categories":1018},[],{"categories":1020},[108],{"categories":1022},[108],{"categories":1024},[],{"categories":1026},[],{"categories":1028},[111],{"categories":1030},[108],{"categories":1032},[105],{"categories":1034},[],{"categories":1036},[102],{"categories":1038},[108],{"categories":1040},[102],{"categories":1042},[108],{"categories":1044},[160],{"categories":1046},[167],{"categories":1048},[108,150],{"categories":1050},[129],{"categories":1052},[150],{"categories":1054},[],{"categories":1056},[422],{"categories":1058},[150],{"categories":1060},[111],{"categories":1062},[],{"categories":1064},[],{"categories":1066},[],{"categories":1068},[],{"categories":1070},[160],{"categories":1072},[111],{"categories":1074},[111],{"categories":1076},[108],{"categories":1078},[108],{"categories":1080},[],{"categories":1082},[150],{"categories":1084},[],{"categories":1086},[],{"categories":1088},[111],{"categories":1090},[],{"categories":1092},[],{"categories":1094},[167],{"categories":1096},[167],{"categories":1098},[111],{"categories":1100},[],{"categories":1102},[108],{"categories":1104},[108],{"categories":1106},[160],{"categories":1108},[150],{"categories":1110},[150],{"categories":1112},[111],{"categories":1114},[102],{"categories":1116},[108],{"categories":1118},[150],{"categories":1120},[150],{"categories":1122},[111],{"categories":1124},[111],{"categories":1126},[108],{"categories":1128},[],{"categories":1130},[],{"categories":1132},[108],{"categories":1134},[111],{"categories":1136},[129],{"categories":1138},[160],{"categories":1140},[102],{"categories":1142},[108],{"categories":1144},[],{"categories":1146},[111],{"categories":1148},[111],{"categories":1150},[],{"categories":1152},[102],{"categories":1154},[108],{"categories":1156},[102],{"categories":1158},[102],{"categories":1160},[],{"categories":1162},[],{"categories":1164},[111],{"categories":1166},[111],{"categories":1168},[108],{"categories":1170},[108],{"categories":1172},[129],{"categories":1174},[153],{"categories":1176},[114],{"categories":1178},[129],{"categories":1180},[150],{"categories":1182},[],{"categories":1184},[129],{"categories":1186},[],{"categories":1188},[],{"categories":1190},[],{"categories":1192},[],{"categories":1194},[160],{"categories":1196},[153],{"categories":1198},[],{"categories":1200},[108],{"categories":1202},[108],{"categories":1204},[153],{"categories":1206},[160],{"categories":1208},[],{"categories":1210},[],{"categories":1212},[111],{"categories":1214},[129],{"categories":1216},[129],{"categories":1218},[111],{"categories":1220},[102],{"categories":1222},[108,422],{"categories":1224},[],{"categories":1226},[150],{"categories":1228},[102],{"categories":1230},[111],{"categories":1232},[150],{"categories":1234},[],{"categories":1236},[111],{"categories":1238},[111],{"categories":1240},[108],{"categories":1242},[167],{"categories":1244},[160],{"categories":1246},[150],{"categories":1248},[],{"categories":1250},[111],{"categories":1252},[108],{"categories":1254},[111],{"categories":1256},[111],{"categories":1258},[111],{"categories":1260},[167],{"categories":1262},[111],{"categories":1264},[108],{"categories":1266},[],{"categories":1268},[167],{"categories":1270},[129],{"categories":1272},[111],{"categories":1274},[],{"categories":1276},[],{"categories":1278},[108],{"categories":1280},[111],{"categories":1282},[129],{"categories":1284},[111],{"categories":1286},[],{"categories":1288},[],{"categories":1290},[],{"categories":1292},[111],{"categories":1294},[],{"categories":1296},[],{"categories":1298},[153],{"categories":1300},[108],{"categories":1302},[153],{"categories":1304},[129],{"categories":1306},[108],{"categories":1308},[108],{"categories":1310},[111],{"categories":1312},[108],{"categories":1314},[],{"categories":1316},[],{"categories":1318},[422],{"categories":1320},[],{"categories":1322},[],{"categories":1324},[102],{"categories":1326},[],{"categories":1328},[],{"categories":1330},[],{"categories":1332},[],{"categories":1334},[160],{"categories":1336},[129],{"categories":1338},[167],{"categories":1340},[105],{"categories":1342},[108],{"categories":1344},[108],{"categories":1346},[105],{"categories":1348},[],{"categories":1350},[150],{"categories":1352},[111],{"categories":1354},[105],{"categories":1356},[108],{"categories":1358},[108],{"categories":1360},[102],{"categories":1362},[],{"categories":1364},[102],{"categories":1366},[108],{"categories":1368},[167],{"categories":1370},[111],{"categories":1372},[129],{"categories":1374},[105],{"categories":1376},[108],{"categories":1378},[111],{"categories":1380},[],{"categories":1382},[108],{"categories":1384},[102],{"categories":1386},[108],{"categories":1388},[],{"categories":1390},[129],{"categories":1392},[108],{"categories":1394},[],{"categories":1396},[105],{"categories":1398},[108],{"categories":1400},[],{"categories":1402},[],{"categories":1404},[],{"categories":1406},[108],{"categories":1408},[],{"categories":1410},[422],{"categories":1412},[108],{"categories":1414},[],{"categories":1416},[108],{"categories":1418},[108],{"categories":1420},[108],{"categories":1422},[108,422],{"categories":1424},[108],{"categories":1426},[108],{"categories":1428},[150],{"categories":1430},[111],{"categories":1432},[],{"categories":1434},[111],{"categories":1436},[108],{"categories":1438},[108],{"categories":1440},[108],{"categories":1442},[102],{"categories":1444},[102],{"categories":1446},[160],{"categories":1448},[150],{"categories":1450},[111],{"categories":1452},[],{"categories":1454},[108],{"categories":1456},[129],{"categories":1458},[108],{"categories":1460},[105],{"categories":1462},[],{"categories":1464},[422],{"categories":1466},[150],{"categories":1468},[150],{"categories":1470},[111],{"categories":1472},[129],{"categories":1474},[111],{"categories":1476},[108],{"categories":1478},[],{"categories":1480},[108],{"categories":1482},[],{"categories":1484},[],{"categories":1486},[108],{"categories":1488},[108],{"categories":1490},[108],{"categories":1492},[111],{"categories":1494},[108],{"categories":1496},[],{"categories":1498},[153],{"categories":1500},[111],{"categories":1502},[],{"categories":1504},[108],{"categories":1506},[129],{"categories":1508},[],{"categories":1510},[150],{"categories":1512},[422],{"categories":1514},[129],{"categories":1516},[160],{"categories":1518},[160],{"categories":1520},[129],{"categories":1522},[129],{"categories":1524},[422],{"categories":1526},[],{"categories":1528},[129],{"categories":1530},[108],{"categories":1532},[102],{"categories":1534},[129],{"categories":1536},[],{"categories":1538},[153],{"categories":1540},[129],{"categories":1542},[160],{"categories":1544},[129],{"categories":1546},[422],{"categories":1548},[108],{"categories":1550},[108],{"categories":1552},[],{"categories":1554},[105],{"categories":1556},[],{"categories":1558},[],{"categories":1560},[108],{"categories":1562},[108],{"categories":1564},[108],{"categories":1566},[108],{"categories":1568},[],{"categories":1570},[153],{"categories":1572},[102],{"categories":1574},[],{"categories":1576},[108],{"categories":1578},[108],{"categories":1580},[422],{"categories":1582},[422],{"categories":1584},[],{"categories":1586},[111],{"categories":1588},[129],{"categories":1590},[129],{"categories":1592},[108],{"categories":1594},[111],{"categories":1596},[],{"categories":1598},[150],{"categories":1600},[108],{"categories":1602},[108],{"categories":1604},[],{"categories":1606},[],{"categories":1608},[422],{"categories":1610},[108],{"categories":1612},[160],{"categories":1614},[105],{"categories":1616},[108],{"categories":1618},[],{"categories":1620},[111],{"categories":1622},[102],{"categories":1624},[102],{"categories":1626},[],{"categories":1628},[108],{"categories":1630},[150],{"categories":1632},[111],{"categories":1634},[],{"categories":1636},[108],{"categories":1638},[108],{"categories":1640},[111],{"categories":1642},[],{"categories":1644},[111],{"categories":1646},[160],{"categories":1648},[],{"categories":1650},[108],{"categories":1652},[],{"categories":1654},[108],{"categories":1656},[],{"categories":1658},[108],{"categories":1660},[108],{"categories":1662},[],{"categories":1664},[108],{"categories":1666},[129],{"categories":1668},[108],{"categories":1670},[108],{"categories":1672},[102],{"categories":1674},[108],{"categories":1676},[129],{"categories":1678},[111],{"categories":1680},[],{"categories":1682},[108],{"categories":1684},[167],{"categories":1686},[],{"categories":1688},[],{"categories":1690},[],{"categories":1692},[102],{"categories":1694},[129],{"categories":1696},[111],{"categories":1698},[108],{"categories":1700},[150],{"categories":1702},[111],{"categories":1704},[],{"categories":1706},[111],{"categories":1708},[],{"categories":1710},[108],{"categories":1712},[111],{"categories":1714},[108],{"categories":1716},[],{"categories":1718},[108],{"categories":1720},[108],{"categories":1722},[129],{"categories":1724},[150],{"categories":1726},[111],{"categories":1728},[150],{"categories":1730},[105],{"categories":1732},[],{"categories":1734},[],{"categories":1736},[108],{"categories":1738},[102],{"categories":1740},[129],{"categories":1742},[],{"categories":1744},[],{"categories":1746},[160],{"categories":1748},[150],{"categories":1750},[],{"categories":1752},[108],{"categories":1754},[],{"categories":1756},[167],{"categories":1758},[108],{"categories":1760},[422],{"categories":1762},[160],{"categories":1764},[],{"categories":1766},[111],{"categories":1768},[108],{"categories":1770},[111],{"categories":1772},[111],{"categories":1774},[108],{"categories":1776},[],{"categories":1778},[102],{"categories":1780},[108],{"categories":1782},[105],{"categories":1784},[160],{"categories":1786},[150],{"categories":1788},[],{"categories":1790},[],{"categories":1792},[],{"categories":1794},[111],{"categories":1796},[150],{"categories":1798},[129],{"categories":1800},[108],{"categories":1802},[129],{"categories":1804},[150],{"categories":1806},[],{"categories":1808},[150],{"categories":1810},[129],{"categories":1812},[105],{"categories":1814},[108],{"categories":1816},[129],{"categories":1818},[167],{"categories":1820},[],{"categories":1822},[],{"categories":1824},[153],{"categories":1826},[108,160],{"categories":1828},[129],{"categories":1830},[108],{"categories":1832},[111],{"categories":1834},[111],{"categories":1836},[108],{"categories":1838},[],{"categories":1840},[160],{"categories":1842},[108],{"categories":1844},[153],{"categories":1846},[111],{"categories":1848},[167],{"categories":1850},[422],{"categories":1852},[],{"categories":1854},[102],{"categories":1856},[111],{"categories":1858},[111],{"categories":1860},[160],{"categories":1862},[108],{"categories":1864},[108],{"categories":1866},[],{"categories":1868},[],{"categories":1870},[],{"categories":1872},[422],{"categories":1874},[129],{"categories":1876},[108],{"categories":1878},[108],{"categories":1880},[108],{"categories":1882},[],{"categories":1884},[153],{"categories":1886},[105],{"categories":1888},[],{"categories":1890},[111],{"categories":1892},[422],{"categories":1894},[],{"categories":1896},[150],{"categories":1898},[150],{"categories":1900},[],{"categories":1902},[160],{"categories":1904},[150],{"categories":1906},[108],{"categories":1908},[],{"categories":1910},[129],{"categories":1912},[108],{"categories":1914},[150],{"categories":1916},[111],{"categories":1918},[129],{"categories":1920},[],{"categories":1922},[111],{"categories":1924},[150],{"categories":1926},[108],{"categories":1928},[],{"categories":1930},[108],{"categories":1932},[108],{"categories":1934},[422],{"categories":1936},[129],{"categories":1938},[153],{"categories":1940},[153],{"categories":1942},[],{"categories":1944},[],{"categories":1946},[],{"categories":1948},[111],{"categories":1950},[160],{"categories":1952},[160],{"categories":1954},[],{"categories":1956},[],{"categories":1958},[108],{"categories":1960},[],{"categories":1962},[111],{"categories":1964},[108],{"categories":1966},[],{"categories":1968},[108],{"categories":1970},[105],{"categories":1972},[108],{"categories":1974},[167],{"categories":1976},[111],{"categories":1978},[108],{"categories":1980},[160],{"categories":1982},[129],{"categories":1984},[111],{"categories":1986},[],{"categories":1988},[129],{"categories":1990},[111],{"categories":1992},[111],{"categories":1994},[],{"categories":1996},[105],{"categories":1998},[111],{"categories":2000},[],{"categories":2002},[108],{"categories":2004},[102],{"categories":2006},[129],{"categories":2008},[422],{"categories":2010},[111],{"categories":2012},[111],{"categories":2014},[102],{"categories":2016},[108],{"categories":2018},[],{"categories":2020},[],{"categories":2022},[150],{"categories":2024},[108,105],{"categories":2026},[],{"categories":2028},[102],{"categories":2030},[153],{"categories":2032},[108],{"categories":2034},[160],{"categories":2036},[108],{"categories":2038},[111],{"categories":2040},[108],{"categories":2042},[108],{"categories":2044},[129],{"categories":2046},[111],{"categories":2048},[],{"categories":2050},[],{"categories":2052},[111],{"categories":2054},[108],{"categories":2056},[422],{"categories":2058},[],{"categories":2060},[108],{"categories":2062},[111],{"categories":2064},[],{"categories":2066},[108],{"categories":2068},[167],{"categories":2070},[153],{"categories":2072},[111],{"categories":2074},[108],{"categories":2076},[422],{"categories":2078},[],{"categories":2080},[108],{"categories":2082},[167],{"categories":2084},[150],{"categories":2086},[108],{"categories":2088},[],{"categories":2090},[167],{"categories":2092},[129],{"categories":2094},[108],{"categories":2096},[108],{"categories":2098},[102],{"categories":2100},[],{"categories":2102},[],{"categories":2104},[150],{"categories":2106},[108],{"categories":2108},[153],{"categories":2110},[167],{"categories":2112},[167],{"categories":2114},[129],{"categories":2116},[],{"categories":2118},[],{"categories":2120},[108],{"categories":2122},[],{"categories":2124},[108,160],{"categories":2126},[129],{"categories":2128},[111],{"categories":2130},[160],{"categories":2132},[108],{"categories":2134},[102],{"categories":2136},[],{"categories":2138},[],{"categories":2140},[102],{"categories":2142},[167],{"categories":2144},[108],{"categories":2146},[],{"categories":2148},[150,108],{"categories":2150},[422],{"categories":2152},[102],{"categories":2154},[],{"categories":2156},[105],{"categories":2158},[105],{"categories":2160},[108],{"categories":2162},[160],{"categories":2164},[111],{"categories":2166},[129],{"categories":2168},[167],{"categories":2170},[150],{"categories":2172},[108],{"categories":2174},[108],{"categories":2176},[108],{"categories":2178},[102],{"categories":2180},[108],{"categories":2182},[111],{"categories":2184},[129],{"categories":2186},[],{"categories":2188},[],{"categories":2190},[153],{"categories":2192},[160],{"categories":2194},[108],{"categories":2196},[150],{"categories":2198},[153],{"categories":2200},[108],{"categories":2202},[108],{"categories":2204},[111],{"categories":2206},[111],{"categories":2208},[108,105],{"categories":2210},[],{"categories":2212},[150],{"categories":2214},[],{"categories":2216},[108],{"categories":2218},[129],{"categories":2220},[102],{"categories":2222},[102],{"categories":2224},[111],{"categories":2226},[108],{"categories":2228},[105],{"categories":2230},[160],{"categories":2232},[167],{"categories":2234},[],{"categories":2236},[129],{"categories":2238},[108],{"categories":2240},[108],{"categories":2242},[129],{"categories":2244},[160],{"categories":2246},[108],{"categories":2248},[111],{"categories":2250},[129],{"categories":2252},[108],{"categories":2254},[150],{"categories":2256},[108],{"categories":2258},[108],{"categories":2260},[422],{"categories":2262},[114],{"categories":2264},[111],{"categories":2266},[108],{"categories":2268},[129],{"categories":2270},[111],{"categories":2272},[167],{"categories":2274},[108],{"categories":2276},[],{"categories":2278},[108],{"categories":2280},[],{"categories":2282},[],{"categories":2284},[],{"categories":2286},[105],{"categories":2288},[108],{"categories":2290},[111],{"categories":2292},[129],{"categories":2294},[129],{"categories":2296},[129],{"categories":2298},[129],{"categories":2300},[],{"categories":2302},[102],{"categories":2304},[111],{"categories":2306},[129],{"categories":2308},[102],{"categories":2310},[111],{"categories":2312},[108],{"categories":2314},[108,111],{"categories":2316},[111],{"categories":2318},[422],{"categories":2320},[129],{"categories":2322},[129],{"categories":2324},[111],{"categories":2326},[108],{"categories":2328},[],{"categories":2330},[129],{"categories":2332},[167],{"categories":2334},[102],{"categories":2336},[108],{"categories":2338},[108],{"categories":2340},[],{"categories":2342},[160],{"categories":2344},[],{"categories":2346},[102],{"categories":2348},[111],{"categories":2350},[129],{"categories":2352},[108],{"categories":2354},[129],{"categories":2356},[102],{"categories":2358},[129],{"categories":2360},[129],{"categories":2362},[],{"categories":2364},[105],{"categories":2366},[111],{"categories":2368},[129],{"categories":2370},[129],{"categories":2372},[129],{"categories":2374},[129],{"categories":2376},[129],{"categories":2378},[129],{"categories":2380},[129],{"categories":2382},[129],{"categories":2384},[129],{"categories":2386},[129],{"categories":2388},[153],{"categories":2390},[102],{"categories":2392},[108],{"categories":2394},[108],{"categories":2396},[],{"categories":2398},[108,102],{"categories":2400},[],{"categories":2402},[111],{"categories":2404},[129],{"categories":2406},[111],{"categories":2408},[108],{"categories":2410},[108],{"categories":2412},[108],{"categories":2414},[108],{"categories":2416},[108],{"categories":2418},[111],{"categories":2420},[105],{"categories":2422},[150],{"categories":2424},[129],{"categories":2426},[108],{"categories":2428},[],{"categories":2430},[],{"categories":2432},[111],{"categories":2434},[150],{"categories":2436},[108],{"categories":2438},[],{"categories":2440},[],{"categories":2442},[167],{"categories":2444},[108],{"categories":2446},[],{"categories":2448},[],{"categories":2450},[102],{"categories":2452},[105],{"categories":2454},[108],{"categories":2456},[105],{"categories":2458},[150],{"categories":2460},[],{"categories":2462},[129],{"categories":2464},[],{"categories":2466},[150],{"categories":2468},[108],{"categories":2470},[167],{"categories":2472},[],{"categories":2474},[167],{"categories":2476},[],{"categories":2478},[],{"categories":2480},[111],{"categories":2482},[],{"categories":2484},[105],{"categories":2486},[102],{"categories":2488},[150],{"categories":2490},[160],{"categories":2492},[],{"categories":2494},[],{"categories":2496},[108],{"categories":2498},[102],{"categories":2500},[167],{"categories":2502},[],{"categories":2504},[111],{"categories":2506},[111],{"categories":2508},[129],{"categories":2510},[108],{"categories":2512},[111],{"categories":2514},[108],{"categories":2516},[111],{"categories":2518},[108],{"categories":2520},[114],{"categories":2522},[129],{"categories":2524},[],{"categories":2526},[167],{"categories":2528},[160],{"categories":2530},[111],{"categories":2532},[],{"categories":2534},[108],{"categories":2536},[111],{"categories":2538},[105],{"categories":2540},[102],{"categories":2542},[108],{"categories":2544},[150],{"categories":2546},[160],{"categories":2548},[160],{"categories":2550},[108],{"categories":2552},[153],{"categories":2554},[108],{"categories":2556},[111],{"categories":2558},[105],{"categories":2560},[111],{"categories":2562},[108],{"categories":2564},[108],{"categories":2566},[111],{"categories":2568},[129],{"categories":2570},[],{"categories":2572},[102],{"categories":2574},[108],{"categories":2576},[111],{"categories":2578},[108],{"categories":2580},[108],{"categories":2582},[],{"categories":2584},[150],{"categories":2586},[105],{"categories":2588},[129],{"categories":2590},[108],{"categories":2592},[108],{"categories":2594},[150],{"categories":2596},[167],{"categories":2598},[153],{"categories":2600},[108],{"categories":2602},[129],{"categories":2604},[108],{"categories":2606},[111],{"categories":2608},[422],{"categories":2610},[108],{"categories":2612},[111],{"categories":2614},[153],{"categories":2616},[],{"categories":2618},[111],{"categories":2620},[160],{"categories":2622},[150],{"categories":2624},[108],{"categories":2626},[102],{"categories":2628},[105],{"categories":2630},[160],{"categories":2632},[],{"categories":2634},[111],{"categories":2636},[108],{"categories":2638},[],{"categories":2640},[129],{"categories":2642},[],{"categories":2644},[129],{"categories":2646},[108],{"categories":2648},[111],{"categories":2650},[111],{"categories":2652},[111],{"categories":2654},[],{"categories":2656},[],{"categories":2658},[108],{"categories":2660},[108],{"categories":2662},[],{"categories":2664},[150],{"categories":2666},[111],{"categories":2668},[167],{"categories":2670},[102],{"categories":2672},[],{"categories":2674},[],{"categories":2676},[129],{"categories":2678},[160],{"categories":2680},[108],{"categories":2682},[108],{"categories":2684},[108],{"categories":2686},[160],{"categories":2688},[129],{"categories":2690},[150],{"categories":2692},[108],{"categories":2694},[108],{"categories":2696},[108],{"categories":2698},[129],{"categories":2700},[108],{"categories":2702},[129],{"categories":2704},[111],{"categories":2706},[111],{"categories":2708},[160],{"categories":2710},[111],{"categories":2712},[108],{"categories":2714},[160],{"categories":2716},[150],{"categories":2718},[],{"categories":2720},[111],{"categories":2722},[],{"categories":2724},[],{"categories":2726},[105],{"categories":2728},[108],{"categories":2730},[111],{"categories":2732},[102],{"categories":2734},[111],{"categories":2736},[167],{"categories":2738},[],{"categories":2740},[111],{"categories":2742},[],{"categories":2744},[102],{"categories":2746},[111],{"categories":2748},[],{"categories":2750},[111],{"categories":2752},[108],{"categories":2754},[129],{"categories":2756},[108],{"categories":2758},[111],{"categories":2760},[129],{"categories":2762},[111],{"categories":2764},[160],{"categories":2766},[150],{"categories":2768},[102],{"categories":2770},[],{"categories":2772},[111],{"categories":2774},[150],{"categories":2776},[129],{"categories":2778},[108],{"categories":2780},[150],{"categories":2782},[102],{"categories":2784},[],{"categories":2786},[111],{"categories":2788},[111],{"categories":2790},[108],{"categories":2792},[],{"categories":2794},[111],{"categories":2796},[114],{"categories":2798},[129],{"categories":2800},[111],{"categories":2802},[105],{"categories":2804},[],{"categories":2806},[108],{"categories":2808},[114],{"categories":2810},[108],{"categories":2812},[111],{"categories":2814},[129],{"categories":2816},[102],{"categories":2818},[422],{"categories":2820},[108],{"categories":2822},[108],{"categories":2824},[108],{"categories":2826},[129],{"categories":2828},[105],{"categories":2830},[108],{"categories":2832},[150],{"categories":2834},[129],{"categories":2836},[422],{"categories":2838},[108],{"categories":2840},[],{"categories":2842},[],{"categories":2844},[422],{"categories":2846},[153],{"categories":2848},[111],{"categories":2850},[111],{"categories":2852},[129],{"categories":2854},[108],{"categories":2856},[102],{"categories":2858},[150],{"categories":2860},[111],{"categories":2862},[108],{"categories":2864},[167],{"categories":2866},[108],{"categories":2868},[111],{"categories":2870},[],{"categories":2872},[108],{"categories":2874},[108],{"categories":2876},[129],{"categories":2878},[102],{"categories":2880},[],{"categories":2882},[108],{"categories":2884},[108],{"categories":2886},[160],{"categories":2888},[150],{"categories":2890},[108,111],{"categories":2892},[167,105],{"categories":2894},[108],{"categories":2896},[],{"categories":2898},[111],{"categories":2900},[],{"categories":2902},[160],{"categories":2904},[108],{"categories":2906},[129],{"categories":2908},[],{"categories":2910},[111],{"categories":2912},[],{"categories":2914},[111],{"categories":2916},[102],{"categories":2918},[111],{"categories":2920},[108],{"categories":2922},[422],{"categories":2924},[167],{"categories":2926},[105],{"categories":2928},[105],{"categories":2930},[102],{"categories":2932},[102],{"categories":2934},[108],{"categories":2936},[111],{"categories":2938},[108],{"categories":2940},[108],{"categories":2942},[102],{"categories":2944},[108],{"categories":2946},[167],{"categories":2948},[129],{"categories":2950},[108],{"categories":2952},[111],{"categories":2954},[108],{"categories":2956},[],{"categories":2958},[160],{"categories":2960},[],{"categories":2962},[111],{"categories":2964},[102],{"categories":2966},[],{"categories":2968},[422],{"categories":2970},[108],{"categories":2972},[],{"categories":2974},[129],{"categories":2976},[111],{"categories":2978},[160],{"categories":2980},[108],{"categories":2982},[111],{"categories":2984},[160],{"categories":2986},[111],{"categories":2988},[129],{"categories":2990},[102],{"categories":2992},[129],{"categories":2994},[160],{"categories":2996},[108],{"categories":2998},[150],{"categories":3000},[108],{"categories":3002},[108],{"categories":3004},[108],{"categories":3006},[108],{"categories":3008},[111],{"categories":3010},[108],{"categories":3012},[111],{"categories":3014},[108],{"categories":3016},[102],{"categories":3018},[108],{"categories":3020},[111],{"categories":3022},[150],{"categories":3024},[102],{"categories":3026},[111],{"categories":3028},[150],{"categories":3030},[],{"categories":3032},[108],{"categories":3034},[108],{"categories":3036},[160],{"categories":3038},[],{"categories":3040},[111],{"categories":3042},[167],{"categories":3044},[108],{"categories":3046},[129],{"categories":3048},[167],{"categories":3050},[111],{"categories":3052},[105],{"categories":3054},[105],{"categories":3056},[108],{"categories":3058},[102],{"categories":3060},[],{"categories":3062},[108],{"categories":3064},[],{"categories":3066},[102],{"categories":3068},[108],{"categories":3070},[111],{"categories":3072},[111],{"categories":3074},[],{"categories":3076},[160],{"categories":3078},[160],{"categories":3080},[167],{"categories":3082},[150],{"categories":3084},[],{"categories":3086},[108],{"categories":3088},[102],{"categories":3090},[108],{"categories":3092},[160],{"categories":3094},[102],{"categories":3096},[129],{"categories":3098},[129],{"categories":3100},[],{"categories":3102},[129],{"categories":3104},[111],{"categories":3106},[150],{"categories":3108},[153],{"categories":3110},[108],{"categories":3112},[],{"categories":3114},[129],{"categories":3116},[160],{"categories":3118},[105],{"categories":3120},[108],{"categories":3122},[102],{"categories":3124},[422],{"categories":3126},[102],{"categories":3128},[],{"categories":3130},[],{"categories":3132},[129],{"categories":3134},[],{"categories":3136},[111],{"categories":3138},[111],{"categories":3140},[111],{"categories":3142},[],{"categories":3144},[108],{"categories":3146},[],{"categories":3148},[129],{"categories":3150},[102],{"categories":3152},[150],{"categories":3154},[108],{"categories":3156},[129],{"categories":3158},[129],{"categories":3160},[],{"categories":3162},[129],{"categories":3164},[102],{"categories":3166},[108],{"categories":3168},[],{"categories":3170},[111],{"categories":3172},[111],{"categories":3174},[102],{"categories":3176},[],{"categories":3178},[],{"categories":3180},[],{"categories":3182},[150],{"categories":3184},[111],{"categories":3186},[108],{"categories":3188},[],{"categories":3190},[],{"categories":3192},[],{"categories":3194},[150],{"categories":3196},[],{"categories":3198},[102],{"categories":3200},[],{"categories":3202},[],{"categories":3204},[150],{"categories":3206},[108],{"categories":3208},[129],{"categories":3210},[],{"categories":3212},[167],{"categories":3214},[129],{"categories":3216},[167],{"categories":3218},[108],{"categories":3220},[],{"categories":3222},[],{"categories":3224},[111],{"categories":3226},[],{"categories":3228},[],{"categories":3230},[111],{"categories":3232},[108],{"categories":3234},[],{"categories":3236},[111],{"categories":3238},[129],{"categories":3240},[167],{"categories":3242},[153],{"categories":3244},[111],{"categories":3246},[111],{"categories":3248},[],{"categories":3250},[],{"categories":3252},[],{"categories":3254},[129],{"categories":3256},[],{"categories":3258},[],{"categories":3260},[150],{"categories":3262},[102],{"categories":3264},[],{"categories":3266},[105],{"categories":3268},[167],{"categories":3270},[108],{"categories":3272},[160],{"categories":3274},[102],{"categories":3276},[153],{"categories":3278},[105],{"categories":3280},[160],{"categories":3282},[],{"categories":3284},[],{"categories":3286},[111],{"categories":3288},[102],{"categories":3290},[150],{"categories":3292},[102],{"categories":3294},[111],{"categories":3296},[422],{"categories":3298},[111],{"categories":3300},[],{"categories":3302},[108],{"categories":3304},[129],{"categories":3306},[160],{"categories":3308},[],{"categories":3310},[150],{"categories":3312},[129],{"categories":3314},[102],{"categories":3316},[111],{"categories":3318},[108],{"categories":3320},[105],{"categories":3322},[111,422],{"categories":3324},[111],{"categories":3326},[160],{"categories":3328},[108],{"categories":3330},[153],{"categories":3332},[167],{"categories":3334},[111],{"categories":3336},[],{"categories":3338},[111],{"categories":3340},[108],{"categories":3342},[105],{"categories":3344},[],{"categories":3346},[],{"categories":3348},[108],{"categories":3350},[153],{"categories":3352},[108],{"categories":3354},[],{"categories":3356},[129],{"categories":3358},[],{"categories":3360},[129],{"categories":3362},[160],{"categories":3364},[111],{"categories":3366},[108],{"categories":3368},[167],{"categories":3370},[160],{"categories":3372},[],{"categories":3374},[129],{"categories":3376},[108],{"categories":3378},[],{"categories":3380},[108],{"categories":3382},[111],{"categories":3384},[108],{"categories":3386},[111],{"categories":3388},[108],{"categories":3390},[108],{"categories":3392},[108],{"categories":3394},[108],{"categories":3396},[105],{"categories":3398},[],{"categories":3400},[114],{"categories":3402},[129],{"categories":3404},[108],{"categories":3406},[],{"categories":3408},[160],{"categories":3410},[108],{"categories":3412},[108],{"categories":3414},[111],{"categories":3416},[129],{"categories":3418},[108],{"categories":3420},[108],{"categories":3422},[105],{"categories":3424},[111],{"categories":3426},[150],{"categories":3428},[],{"categories":3430},[153],{"categories":3432},[108],{"categories":3434},[],{"categories":3436},[129],{"categories":3438},[167],{"categories":3440},[],{"categories":3442},[],{"categories":3444},[129],{"categories":3446},[129],{"categories":3448},[167],{"categories":3450},[102],{"categories":3452},[111],{"categories":3454},[111],{"categories":3456},[108],{"categories":3458},[105],{"categories":3460},[],{"categories":3462},[],{"categories":3464},[129],{"categories":3466},[153],{"categories":3468},[160],{"categories":3470},[111],{"categories":3472},[150],{"categories":3474},[153],{"categories":3476},[153],{"categories":3478},[],{"categories":3480},[129],{"categories":3482},[108],{"categories":3484},[108],{"categories":3486},[160],{"categories":3488},[],{"categories":3490},[129],{"categories":3492},[129],{"categories":3494},[129],{"categories":3496},[],{"categories":3498},[111],{"categories":3500},[108],{"categories":3502},[],{"categories":3504},[102],{"categories":3506},[105],{"categories":3508},[],{"categories":3510},[108],{"categories":3512},[108],{"categories":3514},[],{"categories":3516},[160],{"categories":3518},[],{"categories":3520},[],{"categories":3522},[],{"categories":3524},[],{"categories":3526},[108],{"categories":3528},[129],{"categories":3530},[],{"categories":3532},[],{"categories":3534},[108],{"categories":3536},[108],{"categories":3538},[108],{"categories":3540},[153],{"categories":3542},[108],{"categories":3544},[153],{"categories":3546},[],{"categories":3548},[153],{"categories":3550},[153],{"categories":3552},[422],{"categories":3554},[111],{"categories":3556},[160],{"categories":3558},[],{"categories":3560},[],{"categories":3562},[153],{"categories":3564},[160],{"categories":3566},[160],{"categories":3568},[160],{"categories":3570},[],{"categories":3572},[102],{"categories":3574},[160],{"categories":3576},[160],{"categories":3578},[102],{"categories":3580},[160],{"categories":3582},[105],{"categories":3584},[160],{"categories":3586},[160],{"categories":3588},[160],{"categories":3590},[153],{"categories":3592},[129],{"categories":3594},[129],{"categories":3596},[108],{"categories":3598},[160],{"categories":3600},[153],{"categories":3602},[422],{"categories":3604},[153],{"categories":3606},[153],{"categories":3608},[153],{"categories":3610},[],{"categories":3612},[105],{"categories":3614},[],{"categories":3616},[422],{"categories":3618},[160],{"categories":3620},[160],{"categories":3622},[160],{"categories":3624},[111],{"categories":3626},[129,105],{"categories":3628},[153],{"categories":3630},[],{"categories":3632},[],{"categories":3634},[153],{"categories":3636},[],{"categories":3638},[153],{"categories":3640},[129],{"categories":3642},[111],{"categories":3644},[],{"categories":3646},[160],{"categories":3648},[108],{"categories":3650},[150],{"categories":3652},[],{"categories":3654},[108],{"categories":3656},[],{"categories":3658},[129],{"categories":3660},[102],{"categories":3662},[153],{"categories":3664},[],{"categories":3666},[160],{"categories":3668},[129],[3670,3882,3954,4014],{"id":3671,"title":3672,"ai":3673,"body":3678,"categories":3850,"created_at":53,"date_modified":53,"description":46,"extension":54,"faq":53,"featured":55,"kicker_label":53,"meta":3851,"navigation":82,"path":3869,"published_at":3870,"question":53,"scraped_at":3871,"seo":3872,"sitemap":3873,"source_id":3874,"source_name":3875,"source_type":89,"source_url":3876,"stem":3877,"tags":3878,"thumbnail_url":53,"tldr":3879,"tweet":53,"unknown_tags":3880,"__hash__":3881},"summaries\u002Fsummaries\u002F2d4fed29fea91900-star-elastic-pack-30b-23b-12b-models-in-one-checkp-summary.md","Star Elastic: Pack 30B\u002F23B\u002F12B Models in One Checkpoint",{"provider":7,"model":8,"input_tokens":3674,"output_tokens":3675,"processing_time_ms":3676,"cost_usd":3677},9074,2939,32047,0.0032618,{"type":14,"value":3679,"toc":3844},[3680,3684,3687,3690,3694,3701,3704,3708,3711,3779,3783,3786,3789,3833,3840],[17,3681,3683],{"id":3682},"nested-weight-sharing-compresses-multiple-sizes-into-one-checkpoint","Nested Weight-Sharing Compresses Multiple Sizes into One Checkpoint",[22,3685,3686],{},"Train one 30B hybrid Mamba-Transformer-MoE parent model on 160B tokens to embed smaller 23B and 12B submodels as contiguous subsets of its highest-importance components. Rank embedding channels, attention heads, Mamba SSM heads, MoE experts, and FFN channels by contribution to accuracy using Router-Weighted Expert Activation Pruning (REAP), which weighs routing gates and output magnitudes over naive frequency pruning. A learnable end-to-end router takes a target budget (e.g., 2.8B active params) as one-hot input, outputs differentiable masks via Gumbel-Softmax, and trains jointly with knowledge distillation from the parent—penalizing budget deviations while maximizing accuracy. Use a two-stage curriculum: short-context (8K tokens, uniform budgets) then long-context (49K tokens, p(30B)=0.5, p(23B)=0.3, p(12B)=0.2), boosting AIME-2025 scores by up to 19.8% on smaller variants. Width compression (reducing dims\u002Fheads\u002Fexperts) recovers 98.1% baseline performance versus 95.2% for depth (layer dropping), so prioritize width for reasoning tasks.",[22,3688,3689],{},"This yields 360x fewer tokens than separate pretraining and 7x over sequential distillation, with all variants zero-shot slicable from one 58.9 GB BF16 checkpoint—versus 126.1 GB for independents.",[17,3691,3693],{"id":3692},"phase-specific-sizing-optimizes-reasoning-accuracy-latency","Phase-Specific Sizing Optimizes Reasoning Accuracy-Latency",[22,3695,3696,3697],{},"Ditch fixed-model token caps in ",[3698,3699,3700],"think",{}," phases: assign smaller nested models (e.g., 23B) to high-volume reasoning traces and larger (30B) to precise final answers in ℳS → ℳL configs. The 23B→30B setup beats Nemotron Nano v3 defaults by 16% accuracy at 1.9x lower latency, as reasoning tolerates capacity cuts but answers demand precision. Elastic-23B hits 85.63 on AIME-2025 (vs. Qwen3-30B-A3B's 80.00), matching or exceeding same-size independents on GPQA, LiveCodeBench v5, MMLU-Pro, IFBench, Tau Bench.",[22,3702,3703],{},"12B runs 2.4x throughput of 30B on H100 at BF16; NVFP4 12B hits 7,426 tokens\u002Fs (3.4x) on RTX Pro 6000.",[17,3705,3707],{"id":3706},"quantization-preserves-nesting-for-edge-deployment","Quantization Preserves Nesting for Edge Deployment",[22,3709,3710],{},"Apply Quantization-Aware Distillation (QAD) on the elastic checkpoint to maintain zero-shot slicing post-quant. FP8 PTQ recovers 98.69% BF16 accuracy on 30B; NVFP4 PTQ drops 4.12% but QAD (~5B tokens, 48K context) hits 97.79%. Single NVFP4 checkpoint: 18.7 GB (30B), enabling 12B\u002F8 GB on RTX 5080 (BF16 OOMs). Memory table:",[3712,3713,3714,3733],"table",{},[3715,3716,3717],"thead",{},[3718,3719,3720,3724,3727,3730],"tr",{},[3721,3722,3723],"th",{},"Variant",[3721,3725,3726],{},"30B",[3721,3728,3729],{},"23B",[3721,3731,3732],{},"12B",[3734,3735,3736,3751,3765],"tbody",{},[3718,3737,3738,3742,3745,3748],{},[3739,3740,3741],"td",{},"BF16",[3739,3743,3744],{},"58.9 GB",[3739,3746,3747],{},"44.0 GB",[3739,3749,3750],{},"23.2 GB",[3718,3752,3753,3756,3759,3762],{},[3739,3754,3755],{},"FP8",[3739,3757,3758],{},"31.4 GB",[3739,3760,3761],{},"23.7 GB",[3739,3763,3764],{},"13.0 GB",[3718,3766,3767,3770,3773,3776],{},[3739,3768,3769],{},"NVFP4",[3739,3771,3772],{},"18.7 GB",[3739,3774,3775],{},"14.1 GB",[3739,3777,3778],{},"8.0 GB",[17,3780,3782],{"id":3781},"load-and-serve-with-transformers-or-vllm","Load and Serve with Transformers or vLLM",[22,3784,3785],{},"Grab from HF: nvidia\u002FNVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-{BF16|FP8|NVFP4}. Use trust_remote_code=True for hybrid arch.",[22,3787,3788],{},"Transformers example:",[3790,3791,3795],"pre",{"className":3792,"code":3793,"language":3794,"meta":46,"style":46},"language-python shiki shiki-themes github-light github-dark","from transformers import AutoTokenizer, AutoModelForCausalLM\nimport torch\nmodel_id = \"nvidia\u002FNVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-BF16\"\ntokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)\nmodel = AutoModelForCausalLM.from_pretrained(model_id, trust_remote_code=True, torch_dtype=torch.bfloat16, device_map=\"auto\")\n# Generate with max_new_tokens=4096 for \u003Cthink> + answer\n","python",[3796,3797,3798,3806,3811,3816,3821,3827],"code",{"__ignoreMap":46},[3799,3800,3803],"span",{"class":3801,"line":3802},"line",1,[3799,3804,3805],{},"from transformers import AutoTokenizer, AutoModelForCausalLM\n",[3799,3807,3808],{"class":3801,"line":47},[3799,3809,3810],{},"import torch\n",[3799,3812,3813],{"class":3801,"line":79},[3799,3814,3815],{},"model_id = \"nvidia\u002FNVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-BF16\"\n",[3799,3817,3818],{"class":3801,"line":78},[3799,3819,3820],{},"tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)\n",[3799,3822,3824],{"class":3801,"line":3823},5,[3799,3825,3826],{},"model = AutoModelForCausalLM.from_pretrained(model_id, trust_remote_code=True, torch_dtype=torch.bfloat16, device_map=\"auto\")\n",[3799,3828,3830],{"class":3801,"line":3829},6,[3799,3831,3832],{},"# Generate with max_new_tokens=4096 for \u003Cthink> + answer\n",[22,3834,3835,3836,3839],{},"vLLM for prod: ",[3796,3837,3838],{},"vllm serve \u003Cmodel_id>"," (OpenAI API compat), or Docker\u002FSGLang. Query via curl with max_tokens=4096, temperature=0.6.",[3841,3842,3843],"style",{},"html .default .shiki span {color: var(--shiki-default);background: var(--shiki-default-bg);font-style: var(--shiki-default-font-style);font-weight: var(--shiki-default-font-weight);text-decoration: var(--shiki-default-text-decoration);}html .shiki span {color: var(--shiki-default);background: var(--shiki-default-bg);font-style: var(--shiki-default-font-style);font-weight: var(--shiki-default-font-weight);text-decoration: var(--shiki-default-text-decoration);}html .dark .shiki span {color: var(--shiki-dark);background: var(--shiki-dark-bg);font-style: var(--shiki-dark-font-style);font-weight: var(--shiki-dark-font-weight);text-decoration: var(--shiki-dark-text-decoration);}html.dark .shiki span {color: var(--shiki-dark);background: var(--shiki-dark-bg);font-style: var(--shiki-dark-font-style);font-weight: var(--shiki-dark-font-weight);text-decoration: var(--shiki-dark-text-decoration);}",{"title":46,"searchDepth":47,"depth":47,"links":3845},[3846,3847,3848,3849],{"id":3682,"depth":47,"text":3683},{"id":3692,"depth":47,"text":3693},{"id":3706,"depth":47,"text":3707},{"id":3781,"depth":47,"text":3782},[],{"content_references":3852,"triage":3866},[3853,3857,3860,3863],{"type":59,"title":3854,"url":3855,"context":3856},"Star Elastic","https:\u002F\u002Fcas-bridge.xethub.hf.co\u002Fxet-bridge-us\u002F69cd91b34a304b3afe4ceaa4\u002Fcedbede2a32a1757cd46b5ce6edbe0934f2c8437f61509d8f63aae86f96b43cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Credential=cas%2F20260509%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260509T212853Z&X-Amz-Expires=3600&X-Amz-Signature=a776c3adc5cd45d923a82950ea17eefb271caf85b0586ff79855f575381030a7&X-Amz-SignedHeaders=host&X-Xet-Cas-Uid=689a286d51b587fe5035c19f&response-content-disposition=inline%3B+filename*%3DUTF-8%27%27star_elastic_arxiv.pdf%3B+filename%3D%22star_elastic_arxiv.pdf%22%3B&response-content-type=application%2Fpdf&x-amz-checksum-mode=ENABLED&x-id=GetObject&Expires=1778365733&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTc3ODM2NTczM319LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2FzLWJyaWRnZS54ZXRodWIuaGYuY28veGV0LWJyaWRnZS11cy82OWNkOTFiMzRhMzA0YjNhZmU0Y2VhYTQvY2VkYmVkZTJhMzJhMTc1N2NkNDZiNWNlNmVkYmUwOTM0ZjJjODQzN2Y2MTUwOWQ4ZjYzYWFlODZmOTZiNDNjYioifV19&Signature=fpq%7EPKyILz2ZDcwgCMn%7EsYfSySqpZ5Fr-A3MXBBG94lfu6bTv6y63ejTUL16B8v03HIJyKwrdGgHoYAQr88iQ05qS%7EoIszdd0eU2dfem3CVxM-t3e8rIo4-i4OTBjP2oPAMjCqmwzcC6uPG3Xqm-3Tiq5IfrsDFSKSUPZavMI6nU%7EBBpxd-i-L3C4-4v80nzJWfkHZiKb0EHr3PN8CRlA6In1X2-tH3dXBm0GM0j83%7EBtcclb-4C18vdpfEuvEaKOf0tMxsf5zI0acMPdCJxnVatq%7EgZwixiF%7E53DxgPc94Pb93zl0TVTcLH4%7ExH8yi7Xj9YYjdMKB634Q1GeapoJA__&Key-Pair-Id=K2L8F4GPSG1IFC","recommended",{"type":67,"title":3858,"url":3859,"context":3856},"NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-BF16","https:\u002F\u002Fhuggingface.co\u002Fnvidia\u002FNVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-BF16",{"type":67,"title":3861,"url":3862,"context":3856},"NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-FP8","https:\u002F\u002Fhuggingface.co\u002Fnvidia\u002FNVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-FP8",{"type":67,"title":3864,"url":3865,"context":3856},"NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-NVFP4","https:\u002F\u002Fhuggingface.co\u002Fnvidia\u002FNVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-NVFP4",{"relevance":79,"novelty":79,"quality":78,"actionability":47,"composite":3867,"reasoning":3868},3.05,"Category: AI & LLMs. The article discusses a new model architecture from NVIDIA that could be relevant for developers looking to integrate advanced AI models into their products. However, while it provides technical details, it lacks practical steps or frameworks that the audience could directly apply in their work.","\u002Fsummaries\u002F2d4fed29fea91900-star-elastic-pack-30b-23b-12b-models-in-one-checkp-summary","2026-05-09 22:24:23","2026-05-10 15:26:52",{"title":3672,"description":46},{"loc":3869},"2d4fed29fea91900","MarkTechPost","https:\u002F\u002Fwww.marktechpost.com\u002F2026\u002F05\u002F09\u002Fnvidia-ai-releases-star-elastic-one-checkpoint-that-contains-30b-23b-and-12b-reasoning-models-with-zero-shot-slicing\u002F","summaries\u002F2d4fed29fea91900-star-elastic-pack-30b-23b-12b-models-in-one-checkp-summary",[94,93,95],"NVIDIA's Star Elastic embeds nested 30B (3.6B active), 23B (2.8B), and 12B (2.0B) reasoning models in a single checkpoint via importance-ranked weight-sharing, slashing training costs 360x and enabling phase-specific sizing for 16% accuracy gains at 1.9x lower latency.",[],"MmEv9MTKlBfvzKFMrwhf1uWOYr3g3Xhj2RLeYFKTfm8",{"id":3883,"title":3884,"ai":3885,"body":3890,"categories":3926,"created_at":53,"date_modified":53,"description":46,"extension":54,"faq":53,"featured":55,"kicker_label":53,"meta":3927,"navigation":82,"path":3941,"published_at":3942,"question":53,"scraped_at":3943,"seo":3944,"sitemap":3945,"source_id":3946,"source_name":3947,"source_type":89,"source_url":3948,"stem":3949,"tags":3950,"thumbnail_url":53,"tldr":3951,"tweet":53,"unknown_tags":3952,"__hash__":3953},"summaries\u002Fsummaries\u002F9c05119c3bd0f686-sovereign-ai-grounds-robotics-in-physics-for-1-1m--summary.md","Sovereign AI Grounds Robotics in Physics for 1.1M States\u002FSec",{"provider":7,"model":8,"input_tokens":3886,"output_tokens":3887,"processing_time_ms":3888,"cost_usd":3889},4417,1733,23053,0.0017274,{"type":14,"value":3891,"toc":3920},[3892,3896,3899,3903,3906,3910,3913,3917],[17,3893,3895],{"id":3894},"build-sub-millisecond-robotics-control-with-jax-tpu-v6","Build Sub-Millisecond Robotics Control with JAX + TPU v6",[22,3897,3898],{},"To overcome reinforcement learning's brittleness in real-world chaos, Sovereign AI leverages JAX 0.9.0+ on Google's TPU v6 Trillium for extreme speed: over 1.1 million states per second at 0.894 ms latency. This ensures a 22-DoF humanoid robot processes decisions faster than its actuators move, preventing delays that cause falls. Implement by running the full notebook on GitHub (frank-morales2020\u002FMLxDL), which integrates hardware acceleration for latent space computations without simulation pitfalls.",[17,3900,3902],{"id":3901},"anchor-predictions-to-physics-laws-via-jepa-for-47x-failure-sensitivity","Anchor Predictions to Physics Laws via JEPA for 4.7x Failure Sensitivity",[22,3904,3905],{},"Joint Embedding Predictive Architecture (JEPA) operates in a physics-informed latent space, using a Physics Anchor to monitor energy patterns. Detect anomalies by thresholding: energy loss of 8.5467 signals motor seizure (failure), while expansion of 4.8101 indicates intentional momentum for maneuvers like sideways slides. This delivers 4.7x greater sensitivity over traditional methods, grounding neural predictions in conservation laws so AI distinguishes planned actions from disasters in real time.",[17,3907,3909],{"id":3908},"gain-auditability-and-recovery-with-gemini-31-pro-oversight","Gain Auditability and Recovery with Gemini 3.1 Pro Oversight",[22,3911,3912],{},"Feed JEPA's abstract metrics into Gemini 3.1 Pro's Deep Thinking mode as the executive controller. It translates spikes into human-readable reports, diagnosing joint failures or sensor glitches, then outputs recovery plans. This Sovereign Return on Investment (SROI) enables full energy expenditure audits, making decisions transparent and recoverable rather than black-box guesses.",[17,3914,3916],{"id":3915},"slash-bandwidth-797-for-6g-scale-autonomy-with-semantic-compression","Slash Bandwidth 79.7% for 6G-Scale Autonomy with Semantic Compression",[22,3918,3919],{},"Compress data to transmit only semantic meaning, not raw sensors, yielding 79.7% bandwidth savings. For 6G networks, this sustains high-fidelity autonomy in bandwidth-constrained environments, ensuring reliable physical-world deployment without overwhelming infrastructure.",{"title":46,"searchDepth":47,"depth":47,"links":3921},[3922,3923,3924,3925],{"id":3894,"depth":47,"text":3895},{"id":3901,"depth":47,"text":3902},{"id":3908,"depth":47,"text":3909},{"id":3915,"depth":47,"text":3916},[108],{"content_references":3928,"triage":3938},[3929,3932,3934,3936],{"type":67,"title":3930,"url":3931,"context":65},"MLxDL (GEMINI_TPU.ipynb)","https:\u002F\u002Fgithub.com\u002Ffrank-morales2020\u002FMLxDL\u002Fblob\u002Fmain\u002FGEMINI_TPU.ipynb",{"type":67,"title":3933,"context":65},"JAX 0.9.0+",{"type":67,"title":3935,"context":65},"TPU v6 Trillium",{"type":67,"title":3937,"context":65},"Gemini 3.1 Pro",{"relevance":3823,"novelty":78,"quality":78,"actionability":78,"composite":3939,"reasoning":3940},4.35,"Category: AI & LLMs. The article provides in-depth insights into using AI for robotics control, addressing practical applications like real-time decision-making and failure detection, which are crucial for product builders. It includes specific frameworks and tools like JAX and JEPA, making it actionable for developers looking to implement these techniques.","\u002Fsummaries\u002F9c05119c3bd0f686-sovereign-ai-grounds-robotics-in-physics-for-1-1m-summary","2026-05-08 15:34:13","2026-05-09 15:36:56",{"title":3884,"description":46},{"loc":3941},"9c05119c3bd0f686","AI Simplified in Plain English","https:\u002F\u002Fmedium.com\u002Fai-simplified-in-plain-english\u002Fsovereign-ai-bridging-the-gap-between-neural-logic-and-physical-reality-27847c54ddbc?source=rss----f37ab7d4e76b---4","summaries\u002F9c05119c3bd0f686-sovereign-ai-grounds-robotics-in-physics-for-1-1m--summary",[94,95,93],"Sovereign AI uses JEPA with physics anchors on JAX\u002FTPU v6 to process 1.1M states\u002Fsec at 0.894ms latency, detecting failures 4.7x better via energy patterns, with Gemini 3.1 Pro generating auditable reports and recovery plans.",[],"S_G2pfMpHvfDy7cXXXBE5nN5ar3Jtvpq5EuPS2bYuY8",{"id":3955,"title":3956,"ai":3957,"body":3962,"categories":3991,"created_at":53,"date_modified":53,"description":46,"extension":54,"faq":53,"featured":55,"kicker_label":53,"meta":3992,"navigation":82,"path":4002,"published_at":4003,"question":53,"scraped_at":4004,"seo":4005,"sitemap":4006,"source_id":4007,"source_name":3875,"source_type":89,"source_url":4008,"stem":4009,"tags":4010,"thumbnail_url":53,"tldr":4011,"tweet":53,"unknown_tags":4012,"__hash__":4013},"summaries\u002Fsummaries\u002F4e271633d433ef16-gemma-4-mtp-drafters-3x-faster-inference-no-qualit-summary.md","Gemma 4 MTP Drafters: 3x Faster Inference, No Quality Loss",{"provider":7,"model":8,"input_tokens":3958,"output_tokens":3959,"processing_time_ms":3960,"cost_usd":3961},7596,1980,21477,0.00248655,{"type":14,"value":3963,"toc":3987},[3964,3968,3971,3974,3978,3981,3984],[17,3965,3967],{"id":3966},"speculative-decoding-overcomes-autoregressive-latency","Speculative Decoding Overcomes Autoregressive Latency",[22,3969,3970],{},"Standard LLM inference generates one token at a time autoregressively, creating a memory-bandwidth bottleneck: billions of parameters load from VRAM per token, leaving GPUs underutilized as data transfer dominates. Even predictable tokens (e.g., 'words' after 'Actions speak louder than...') require full computation, equal to complex reasoning steps.",[22,3972,3973],{},"Speculative decoding fixes this by pairing a small, fast drafter model with the large target (Gemma 4). The drafter proposes a sequence of tokens quickly—faster than the target processes one. The target verifies the entire draft in one parallel forward pass. Matches accept the full sequence plus one extra target-generated token, all in the time of a single standard pass. Verification ensures identical outputs to vanilla autoregressive generation, delivering lossless speedup. Gemma 4 drafters hit up to 3x overall inference speed post-60M downloads.",[17,3975,3977],{"id":3976},"mtp-architecture-shares-resources-for-edge-and-scale","MTP Architecture Shares Resources for Edge and Scale",[22,3979,3980],{},"Gemma 4's Multi-Token Prediction (MTP) drafters enhance speculative decoding by sharing the target's KV cache—storing prior attention computations—avoiding redundant context recompute. This cuts drafter overhead sharply.",[22,3982,3983],{},"For edge variants (E2B, E4B) on mobile, embedder-layer clustering accelerates logit computation (internal reps to vocab probabilities), targeting hardware-limited final steps. On Gemma 4 26B MoE, Apple Silicon sees ~2.2x speedup at batch size 4-8 (vs. batch 1 routing issues); NVIDIA A100 shows batch-dependent gains too.",[22,3985,3986],{},"Implement via Hugging Face Gemma 4 collections; speeds production apps without quality or accuracy trade-offs.",{"title":46,"searchDepth":47,"depth":47,"links":3988},[3989,3990],{"id":3966,"depth":47,"text":3967},{"id":3976,"depth":47,"text":3977},[108],{"content_references":3993,"triage":4000},[3994,3997],{"type":67,"title":3995,"url":3996,"context":65},"Gemma 4 Model Weights","https:\u002F\u002Fhuggingface.co\u002Fcollections\u002Fgoogle\u002Fgemma-4",{"type":71,"title":3998,"url":3999,"context":3856},"Multi-Token Prediction for Gemma 4","https:\u002F\u002Fblog.google\u002Finnovation-and-ai\u002Ftechnology\u002Fdevelopers-tools\u002Fmulti-token-prediction-gemma-4\u002F?linkId=61725841",{"relevance":78,"novelty":79,"quality":78,"actionability":78,"composite":80,"reasoning":4001},"Category: AI & LLMs. The article discusses the new Multi-Token Prediction (MTP) drafters for Gemma 4, which addresses a specific pain point of inference speed in AI models, making it relevant for developers looking to implement faster AI features. It provides actionable insights on how to implement this technology via Hugging Face, which adds to its practical value.","\u002Fsummaries\u002F4e271633d433ef16-gemma-4-mtp-drafters-3x-faster-inference-no-qualit-summary","2026-05-06 08:23:04","2026-05-06 16:14:12",{"title":3956,"description":46},{"loc":4002},"4e271633d433ef16","https:\u002F\u002Fwww.marktechpost.com\u002F2026\u002F05\u002F06\u002Fgoogle-ai-releases-multi-token-prediction-mtp-drafters-for-gemma-4-delivering-up-to-3x-faster-inference-without-quality-loss\u002F","summaries\u002F4e271633d433ef16-gemma-4-mtp-drafters-3x-faster-inference-no-qualit-summary",[94,95,93],"Pair Gemma 4 with lightweight MTP drafters using speculative decoding to generate up to 3x more tokens per pass by drafting sequences and verifying in parallel, sharing KV cache for efficiency without altering outputs.",[],"9zKQbGealE55IZRdNqkOAfuDfHteluCgF1trH9nWXc4",{"id":4015,"title":4016,"ai":4017,"body":4022,"categories":4050,"created_at":53,"date_modified":53,"description":46,"extension":54,"faq":53,"featured":55,"kicker_label":53,"meta":4051,"navigation":82,"path":4068,"published_at":4069,"question":53,"scraped_at":4070,"seo":4071,"sitemap":4072,"source_id":4073,"source_name":3875,"source_type":89,"source_url":4074,"stem":4075,"tags":4076,"thumbnail_url":53,"tldr":4077,"tweet":53,"unknown_tags":4078,"__hash__":4079},"summaries\u002Fsummaries\u002F240d772f7ed778dd-kame-zero-latency-s2s-with-real-time-llm-oracles-summary.md","KAME: Zero-Latency S2S with Real-Time LLM Oracles",{"provider":7,"model":8,"input_tokens":4018,"output_tokens":4019,"processing_time_ms":4020,"cost_usd":4021},8268,1889,12518,0.0025756,{"type":14,"value":4023,"toc":4045},[4024,4028,4031,4035,4038,4042],[17,4025,4027],{"id":4026},"bridging-s2s-speed-and-llm-depth","Bridging S2S Speed and LLM Depth",[22,4029,4030],{},"Direct S2S models like Moshi generate audio tokens every 80ms for near-instant responses but sacrifice factual knowledge to model tone, emotion, and rhythm. Cascaded pipelines—ASR to LLM to TTS—deliver frontier LLM quality but add 2.1s median latency by waiting for full user input, disrupting flow. KAME resolves this by running a Moshi-like front-end S2S in parallel with a streaming STT + LLM back-end, injecting partial LLM text responses (oracles) to guide speech output mid-conversation without retraining the front-end for different LLMs.",[17,4032,4034],{"id":4033},"asynchronous-oracle-stream-for-progressive-correction","Asynchronous Oracle Stream for Progressive Correction",[22,4036,4037],{},"KAME's front-end extends Moshi's three-stream transformer (input audio, inner monologue text, output audio) with a fourth oracle stream. As user speech streams in, back-end STT builds partial transcripts sent periodically to an LLM (e.g., GPT-4.1 or Claude-3-Opus), which generates evolving oracle texts—from rough guesses to refined answers. The front-end conditions its speech on these oracles, correcting mid-sentence like humans do. Both modules run independently, preserving zero-latency starts while upgrading responses in real time. Back-end is plug-and-play: swap GPT-4.1 (stronger on humanities) for Claude-3-Opus (better reasoning) or Gemini-2.5-Flash at inference.",[17,4039,4041],{"id":4040},"simulated-oracle-training-yields-production-results","Simulated Oracle Training Yields Production Results",[22,4043,4044],{},"Lacking real oracle data, train with Simulated Oracle Augmentation: Use a simulator LLM on 56,582 dialogues from MMLU-Pro, GSM8K, and HSSBench (TTS-converted to audio), generating 6 hint levels (0: unguided guess; 5: ground-truth). On speech-synthesized MT-Bench (reasoning, STEM, humanities), standalone Moshi scores 2.05. KAME + GPT-4.1 hits 6.43; +Claude-3-Opus 6.23—both at Moshi latency. Top cascaded Unmute (GPT-4.1) reaches 7.70 but at 2.1s. Final KAME oracles score 7.79 text-only, proving the gap stems from early speech, not LLM limits. Builders get open weights, inference code, and a back-end-agnostic path to natural voice AI.",{"title":46,"searchDepth":47,"depth":47,"links":4046},[4047,4048,4049],{"id":4026,"depth":47,"text":4027},{"id":4033,"depth":47,"text":4034},{"id":4040,"depth":47,"text":4041},[],{"content_references":4052,"triage":4065},[4053,4056,4059,4062],{"type":67,"title":4054,"url":4055,"context":65},"KAME Model Weights","https:\u002F\u002Fhuggingface.co\u002FSakanaAI\u002Fkame",{"type":59,"title":4057,"url":4058,"context":65},"KAME Paper","https:\u002F\u002Farxiv.org\u002Fpdf\u002F2510.02327",{"type":67,"title":4060,"url":4061,"context":65},"KAME Inference Code","https:\u002F\u002Fgithub.com\u002FSakanaAI\u002Fkame",{"type":71,"title":4063,"url":4064,"context":65},"KAME Technical Details","https:\u002F\u002Fpub.sakana.ai\u002Fkame\u002F",{"relevance":79,"novelty":78,"quality":78,"actionability":79,"composite":4066,"reasoning":4067},3.45,"Category: AI & LLMs. The article discusses a new architecture for speech-to-speech models that integrates LLMs in real-time, addressing a specific pain point of latency in AI-powered communication tools. It provides insights into the architecture and performance metrics, but lacks detailed actionable steps for implementation.","\u002Fsummaries\u002F240d772f7ed778dd-kame-zero-latency-s2s-with-real-time-llm-oracles-summary","2026-05-03 07:47:42","2026-05-03 17:01:44",{"title":4016,"description":46},{"loc":4068},"240d772f7ed778dd","https:\u002F\u002Fwww.marktechpost.com\u002F2026\u002F05\u002F03\u002Fsakana-ai-introduces-kame-a-tandem-speech-to-speech-architecture-that-injects-llm-knowledge-in-real-time\u002F","summaries\u002F240d772f7ed778dd-kame-zero-latency-s2s-with-real-time-llm-oracles-summary",[94,93,95],"KAME fuses fast direct speech-to-speech (S2S) with LLM smarts via asynchronous oracle injections, hitting 6.4\u002F10 on MT-Bench at Moshi's near-zero latency vs. cascaded 7.7\u002F10 at 2.1s delay.",[],"fjtaFzVPwtXlQGyHrFgFRL_NLdj8zJwNZVP-__S90z0"]