{"id":8390,"date":"2025-02-21T16:34:00","date_gmt":"2025-02-21T08:34:00","guid":{"rendered":"https:\/\/aict.nkust.edu.tw\/digitrans\/?p=8390"},"modified":"2025-02-21T20:47:06","modified_gmt":"2025-02-21T12:47:06","slug":"google-gemma%ef%bc%9a%e4%ba%ba%e5%b7%a5%e6%99%ba%e6%85%a7%e5%a4%a7%e4%b8%96%e7%95%8c%e4%b8%ad%e7%9a%84%e5%b0%8f%e5%9e%8b%e8%aa%9e%e8%a8%80%e6%a8%a1%e5%9e%8b-slm","status":"publish","type":"post","link":"https:\/\/aict.nkust.edu.tw\/digitrans\/?p=8390","title":{"rendered":"Google Gemma\uff1a\u4eba\u5de5\u667a\u6167\u5927\u4e16\u754c\u4e2d\u7684\u5c0f\u578b\u8a9e\u8a00\u6a21\u578b (SLM)"},"content":{"rendered":"\n<p>\u6b64\u7bc7\u6587\u7ae0\u6df1\u5165\u63a2\u8a0e<strong>Google Gemma<\/strong> \u5728\u4eba\u5de5\u667a\u6167\u9818\u57df\u7684\u5275\u65b0\u7a81\u7834\uff0c\u5f37\u8abf\u5176\u4f5c\u70ba\u8f15\u91cf\u7d1a\u3001\u958b\u6e90\u7684\u8a9e\u8a00\u6a21\u578b\uff0c\u5982\u4f55\u5728\u8a08\u7b97\u8cc7\u6e90\u53d7\u9650\u7684\u74b0\u5883\u4e0b\u63d0\u4f9b\u9ad8\u6548\u80fd\u7684 AI \u89e3\u6c7a\u65b9\u6848\u3002\u6587\u7ae0\u6307\u51fa\uff0c\u7576\u524d AI \u6280\u8853\u7684\u767c\u5c55\u5f80\u5f80\u4f9d\u8cf4\u65bc<strong>\u5927\u578b\u8a9e\u8a00\u6a21\u578b\uff08LLMs\uff09<\/strong>\uff0c\u5982 Google Gemini Ultra \u6216 OpenAI \u7684 GPT-4\uff0c\u9019\u4e9b\u6a21\u578b\u96d6\u7136\u64c1\u6709\u5f37\u5927\u7684\u81ea\u7136\u8a9e\u8a00\u8655\u7406\u80fd\u529b\uff0c\u4f46\u9f90\u5927\u7684\u53c3\u6578\u898f\u6a21\u8207\u9ad8\u6602\u7684\u904b\u7b97\u6210\u672c\uff0c\u4f7f\u5176\u96e3\u4ee5\u666e\u53ca\u81f3\u4f4e\u529f\u8017\u8a2d\u5099\u8207\u5373\u6642\u61c9\u7528\u5834\u666f\u3002\u56e0\u6b64\uff0cGoogle \u63a8\u51fa\u4e86 Gemma \u6a21\u578b\u5bb6\u65cf\uff0c\u65e8\u5728\u4ee5<strong>\u66f4\u5c11\u7684\u8a08\u7b97\u8cc7\u6e90<\/strong>\uff0c\u5be6\u73fe\u8207\u5927\u578b\u6a21\u578b\u76f8\u8fd1\u7684\u6548\u80fd\uff0c\u4e26\u9032\u4e00\u6b65\u964d\u4f4e AI \u90e8\u7f72\u7684\u9580\u6abb\uff0c\u8b93\u958b\u767c\u8005\u8207\u7814\u7a76\u4eba\u54e1\u80fd\u5920\u66f4\u8f15\u9b06\u5730\u904b\u7528\u5f37\u5927\u7684\u8a9e\u8a00\u6a21\u578b\u3002<\/p>\n\n\n\n<p>\u9032\u4e00\u6b65\u5206\u6790\u4e86 <strong>Gemma \u7684\u67b6\u69cb\u8207\u6280\u8853\u7279\u6027<\/strong>\uff0c\u6307\u51fa\u5176\u63a1\u7528<strong>\u89e3\u78bc\u5668\uff08Decoder-Only Transformer\uff09\u67b6\u69cb<\/strong>\uff0c\u5c08\u70ba<strong>\u6587\u672c\u751f\u6210<\/strong>\uff08Text-to-Text\uff09\u4efb\u52d9\u8a2d\u8a08\uff0c\u4f7f\u5176\u5728\u5c0d\u8a71\u6a5f\u5668\u4eba\u3001\u5167\u5bb9\u751f\u6210\u53ca\u667a\u80fd\u554f\u7b54\u9818\u57df\u8868\u73fe\u51fa\u8272\u3002\u6b64\u5916\uff0c\u9084\u8a73\u7d30\u95e1\u8ff0\u4e86 Gemma \u7684\u95dc\u9375\u6280\u8853\u5275\u65b0\uff0c\u5305\u62ec<strong>\u591a\u982d\u6ce8\u610f\u529b\u6a5f\u5236<\/strong>\uff08Multi-head Attention\uff09\u3001<strong>\u65cb\u8f49\u4f4d\u7f6e\u5d4c\u5165<\/strong>\uff08RoPE\uff09\u3001<strong>\u77e5\u8b58\u84b8\u993e<\/strong>\uff08Knowledge Distillation\uff09\u3001<strong>\u5c40\u90e8\u6ed1\u52d5\u7a97\u53e3\u6ce8\u610f\u529b<\/strong>\uff08Local Sliding Window Attention\uff09\u4ee5\u53ca<strong>\u5206\u7d44\u67e5\u8a62\u6ce8\u610f\u529b<\/strong>\uff08Grouped-Query Attention\uff09\u7b49\uff0c\u9019\u4e9b\u6280\u8853\u8b93 Gemma \u80fd\u5920\u5728\u6e1b\u5c11\u8a08\u7b97\u8cc7\u6e90\u9700\u6c42\u7684\u540c\u6642\uff0c\u4f9d\u7136\u7dad\u6301\u9ad8\u5ea6\u8a9e\u5883\u7406\u89e3\u80fd\u529b\u8207\u6587\u672c\u751f\u6210\u6d41\u66a2\u5ea6\u3002<\/p>\n\n\n\n<p>\u5728\u6a21\u578b\u898f\u6a21\u8207\u61c9\u7528\u65b9\u9762\uff0c\u6587\u7ae0\u4ecb\u7d39\u4e86 Google \u65bc 2024 \u5e74 2 \u6708\u6b63\u5f0f\u767c\u4f48\u7684 Gemma 2B\uff0820 \u5104\u53c3\u6578\uff09<strong>\u8207 Gemma 7B\uff0870 \u5104\u53c3\u6578\uff09\uff0c\u4ee5\u53ca\u5373\u5c07\u63a8\u51fa\u7684\u66f4\u5927\u898f\u6a21\u7248\u672c\uff0c\u5982 Gemma 2\uff082B\u30019B\u300127B\uff09\u3002\u6b64\u5916\uff0cGoogle \u4ea6\u64f4\u5c55 Gemma \u6a21\u578b\u5bb6\u65cf\uff0c\u91dd\u5c0d\u4e0d\u540c\u61c9\u7528\u5834\u666f\u958b\u767c\u4e86<\/strong>CodeGemma\uff08\u7a0b\u5f0f\u78bc\u751f\u6210\uff09\u3001DataGemma\uff08\u6578\u64da\u5206\u6790\uff09\u3001PaliGemma\uff08\u591a\u6a21\u614b\u8655\u7406\uff09\u3001RecurrentGemma\uff08\u5f37\u8abf\u8a18\u61b6\u80fd\u529b\u7684 AI \u7814\u7a76\uff09\u7b49\u6a21\u578b\u8b8a\u9ad4\uff0c\u4f7f Gemma \u80fd\u5920\u5ee3\u6cdb\u9069\u7528\u65bc NLP \u4efb\u52d9\u3001\u8edf\u9ad4\u958b\u767c\u3001\u6578\u64da\u8655\u7406\u53ca\u8996\u89ba\u8a9e\u8a00\u6574\u5408\u7b49\u591a\u500b\u9818\u57df\u3002<\/p>\n\n\n\n<p>\u9084\u6df1\u5165\u63a2\u8a0e\u4e86 <strong>Gemma \u7684\u8a13\u7df4\u65b9\u6cd5\u8207\u6548\u80fd\u8868\u73fe<\/strong>\uff0c\u5f37\u8abf\u5176\u900f\u904e\u9f90\u5927\u6578\u64da\u96c6\uff08\u7d04 6 \u5146 Token\uff09\u9032\u884c\u9810\u8a13\u7df4\uff0c\u6db5\u84cb\u591a\u8a9e\u8a00\u6587\u672c\u3001\u7a0b\u5f0f\u78bc\u6578\u64da\u8207\u6578\u5b78\u6587\u672c\uff0c\u4f7f\u5176\u5728\u4e0d\u540c\u61c9\u7528\u5834\u666f\u4e2d\u90fd\u80fd\u5177\u5099\u512a\u79c0\u7684\u6cdb\u5316\u80fd\u529b\u3002\u5118\u7ba1 Gemma \u7684\u53c3\u6578\u898f\u6a21\u5c0f\u65bc GPT-4 \u6216 Gemini Ultra\uff0c\u4f46\u5728 NLP \u57fa\u6e96\u6e2c\u8a66\u4e2d\u4ecd\u5c55\u73fe\u9ad8\u5ea6\u7af6\u722d\u529b\uff0c\u7279\u5225\u662f\u5728<strong>\u6587\u672c\u751f\u6210\u3001\u667a\u80fd\u554f\u7b54\u8207\u5167\u5bb9\u6458\u8981<\/strong>\u7b49\u4efb\u52d9\u4e2d\uff0c\u80fd\u5920\u9054\u5230\u63a5\u8fd1 LLMs \u7684\u6548\u80fd\uff0c\u540c\u6642\u986f\u8457\u964d\u4f4e\u904b\u7b97\u8cc7\u6e90\u9700\u6c42\uff0c\u4f7f\u5176\u6210\u70ba<strong>\u908a\u7de3\u904b\u7b97\u8207\u4f4e\u529f\u8017\u8a2d\u5099\u7684\u7406\u60f3\u9078\u64c7<\/strong>\u3002<\/p>\n\n\n\n<p>\u6700\u5f8c\uff0c\u5f37\u8abf <strong>Gemma \u5728 AI \u666e\u53ca\u5316\u4e2d\u7684\u91cd\u8981\u6027<\/strong>\uff0c\u6307\u51fa\u5176\u958b\u6e90\u7b56\u7565\u8207\u9748\u6d3b\u7684\u90e8\u7f72\u65b9\u5f0f\uff08\u5305\u62ec Google Cloud\u3001Hugging Face\u3001PyTorch \u53ca\u672c\u5730\u904b\u884c\uff09\u5c07\u4fc3\u9032 AI \u793e\u7fa4\u7684\u5275\u65b0\u8207\u5408\u4f5c\uff0c\u8b93\u4f01\u696d\u8207\u500b\u4eba\u958b\u767c\u8005\u90fd\u80fd\u8f15\u9b06\u5b58\u53d6\u8207\u61c9\u7528\u9019\u4e00\u6280\u8853\u3002\u900f\u904e Gemma\uff0cGoogle \u6b63\u5728\u63a8\u52d5 AI \u6280\u8853\u7684\u6c11\u4e3b\u5316\uff0c\u4f7f\u751f\u6210\u5f0f AI \u4e0d\u518d\u5c40\u9650\u65bc\u9ad8\u7aef\u786c\u9ad4\uff0c\u800c\u80fd\u5920\u666e\u53ca\u81f3\u66f4\u5ee3\u6cdb\u7684\u61c9\u7528\u5834\u666f\uff0c\u5f9e\u800c\u6539\u8b8a\u672a\u4f86 AI \u6280\u8853\u7684\u767c\u5c55\u6a21\u5f0f\u3002<\/p>\n\n\n\n<p>\u672c\u6587\u6700\u7d42\u6307\u51fa\uff0cGemma \u7684\u63a8\u51fa\u4e0d\u50c5\u4ee3\u8868<strong>\u8f15\u91cf\u7d1a AI \u6a21\u578b\u7684\u6280\u8853\u7a81\u7834<\/strong>\uff0c\u66f4\u9810\u793a\u8457\u4eba\u5de5\u667a\u6167\u767c\u5c55\u7684\u4e00\u500b\u65b0\u65b9\u5411\uff1a\u5373\u5982\u4f55\u5728<strong>\u4f4e\u8cc7\u6e90\u74b0\u5883\u4e2d\u767c\u63ee\u9ad8\u6548\u80fd<\/strong>\uff0c\u4e26\u70ba\u66f4\u5ee3\u6cdb\u7684\u7522\u696d\u8207\u500b\u4eba\u5e36\u4f86\u771f\u6b63\u53ef\u53ca\u7684 AI \u89e3\u6c7a\u65b9\u6848\u3002\u9019\u5834 AI \u9769\u547d\uff0c\u4e0d\u50c5\u662f\u8a08\u7b97\u6548\u7387\u7684\u63d0\u5347\uff0c\u66f4\u662f\u4eba\u5de5\u667a\u6167\u5f9e\u7cbe\u82f1\u6280\u8853\u8d70\u5411\u5927\u773e\u61c9\u7528\u7684\u91cd\u8981\u4e00\u6b65\u3002<\/p>\n\n\n\n<p>\u95b1\u8b80\u5168\u6587\u8acb\u81f3: <a href=\"https:\/\/ai-pro.org\/learn-ai\/articles\/google-gemma-the-small-language-model-slm-in-the-big-ai-world\/\">https:\/\/ai-pro.org\/learn-ai\/articles\/google-gemma-the-small-language-model-slm-in-the-big-ai-world\/<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u6b64\u7bc7\u6587\u7ae0\u6df1\u5165\u63a2\u8a0eGoogle Gemma \u5728\u4eba\u5de5\u667a\u6167\u9818\u57df\u7684\u5275\u65b0\u7a81\u7834\uff0c\u5f37\u8abf\u5176\u4f5c\u70ba\u8f15\u91cf\u7d1a\u3001\u958b\u6e90\u7684\u8a9e\u8a00\u6a21\u578b\uff0c\u5982\u4f55\u5728\u8a08\u7b97\u8cc7\u6e90\u53d7\u9650\u7684\u74b0\u5883\u4e0b\u63d0\u4f9b\u9ad8\u6548\u80fd\u7684 AI \u89e3\u6c7a\u65b9\u6848\u3002\u6587\u7ae0\u6307\u51fa\uff0c\u7576\u524d AI &hellip;<\/p>\n","protected":false},"author":4,"featured_media":8392,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[579],"tags":[26],"class_list":["post-8390","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-579","tag-ai"],"gutentor_comment":0,"jetpack_featured_media_url":"https:\/\/i0.wp.com\/aict.nkust.edu.tw\/digitrans\/wp-content\/uploads\/2025\/02\/%E8%9E%A2%E5%B9%95%E6%93%B7%E5%8F%96%E7%95%AB%E9%9D%A2-2025-02-21-163432.png?fit=861%2C429&ssl=1","jetpack-related-posts":[],"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=\/wp\/v2\/posts\/8390","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=8390"}],"version-history":[{"count":3,"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=\/wp\/v2\/posts\/8390\/revisions"}],"predecessor-version":[{"id":8407,"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=\/wp\/v2\/posts\/8390\/revisions\/8407"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=\/wp\/v2\/media\/8392"}],"wp:attachment":[{"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=8390"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=8390"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=8390"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}