{"id":7087,"date":"2024-02-21T16:38:01","date_gmt":"2024-02-21T08:38:01","guid":{"rendered":"https:\/\/aict.nkust.edu.tw\/digitrans\/?p=7087"},"modified":"2024-12-13T21:09:34","modified_gmt":"2024-12-13T13:09:34","slug":"google-gemma-llm-model-google-%e7%ac%ac%e4%b8%80%e5%80%8b%e5%9f%ba%e6%96%bc-gemini-%e7%9a%84%e9%96%8b%e6%ba%90-llm-%e6%a8%a1%e5%9e%8b","status":"publish","type":"post","link":"https:\/\/aict.nkust.edu.tw\/digitrans\/?p=7087","title":{"rendered":"Google Gemma LLM Model \u2014 Google \u7b2c\u4e00\u500b\u57fa\u65bc Gemini \u7684\u958b\u6e90 LLM \u6a21\u578b"},"content":{"rendered":"\n<p>2024-02-21 | Simon Liu<\/p>\n\n\n\n<p id=\"2eb8\">Google \u5728 2\/21 \u7684\u4eca\u5929\uff0c\u516c\u4f48\u4ed6\u5011\u65b0\u51fa\u4e86\u958b\u6e90\u6a21\u578b \u2014 Gemma\uff0c\u4ee5\u4e0b\u70ba\u5927\u5bb6\u7d71\u6574\u76f8\u95dc\u6a21\u578b\u8cc7\u8a0a\uff1a<\/p>\n\n\n\n<h1 class=\"wp-block-heading\" id=\"2e66\">I. Gemma \u6a21\u578b\u4ecb\u7d39<\/h1>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"6769\">\u6a21\u578b\u540d\u7a31<\/h2>\n\n\n\n<p id=\"cda3\">Gemma \u7cfb\u5217\u6a21\u578b<br>\u6b64\u6a21\u578b\u7531 Google \u5b98\u65b9\u6240\u958b\u6e90\u51fa\u4f86\u7684 SOTA AI \u6a21\u578b<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"74b5\">\u6a21\u578b\u958b\u6e90\u72c0\u6cc1 \/ License<\/h2>\n\n\n\n<p id=\"9282\">Gemma \u76ee\u524d\u63a1\u7528 Google \u6240\u64b0\u5beb\u7684 License \u6388\u6b0a\u65b9\u5f0f \u2014\u00a0Gemma Terms of Use\uff0c\u7d71\u6574\u76f8\u95dc\u5167\u5bb9\u4e26\u7406\u89e3\u5f8c\uff0c\u662f\u4e00\u500b\u53ef\u5546\u7528\u7684\u6a21\u578b\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"d954\">\u53c3\u6578\u91cf<\/h2>\n\n\n\n<p id=\"94db\">2B, 7B<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"72e2\">\u6a21\u578b\u7a2e\u985e<\/h2>\n\n\n\n<p id=\"98b9\">\u76ee\u524d\u958b\u6e90\u51fa\u4f86\u7e3d\u5171\u6709\u56db\u500b\u6a21\u578b\uff0c\u4e5f\u4e00\u4f75\u63d0\u4f9b HuggingFace \u9023\u7d50\uff1a<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>gemma-7b: 7B \u57fa\u790e\u6a21\u578b\u3002<\/li>\n\n\n\n<li>gemma-7b-it: \u91dd\u5c0d\u6307\u4ee4\u9032\u884c\u5fae\u8abf\u7684 7B \u57fa\u790e\u6a21\u578b\u7248\u672c\u3002<\/li>\n\n\n\n<li>gemma-2b: 2B \u57fa\u790e\u6a21\u578b\u3002<\/li>\n\n\n\n<li>gemma-2b-it: \u91dd\u5c0d\u6307\u4ee4\u9032\u884c\u5fae\u8abf\u7684 2B \u57fa\u790e\u6a21\u578b\u7248\u672c\u3002<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"f03e\">\u6a21\u578b\u8868\u73fe<\/h2>\n\n\n\n<p id=\"050c\">\u6211\u5011\u5f9e HuggingFace \u7684\u00a0Gemma \u6587\u7ae0\u4ecb\u7d39\u4e2d\uff0c\u53ef\u4ee5\u770b\u5230\u5c0f\u6a21\u578b\u7684\u6bd4\u8f03\u8868\u683c\uff1a<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img data-recalc-dims=\"1\" decoding=\"async\" src=\"https:\/\/i0.wp.com\/miro.medium.com\/v2\/resize%3Afit%3A700\/1%2AEeyE1txVACY7sEmYfPdrIQ.png?w=640&#038;ssl=1\" alt=\"\"\/><\/figure>\n<\/div>\n\n\n<p id=\"9dc6\">\u5c31\u73fe\u5728\u7684 7B \u8868\u73fe\u4e0a\uff0c\u6bd4 Mistral-7B \u548c Llama-7B \u4f86\u5f97\u597d\uff0c\u800c\u4e14\u5f88\u63a5\u8fd1\u65bc Llama 2 70B \u7684\u6c34\u6e96\uff0c\u4f46\u662f\u8981\u6ce8\u610f\uff0cGemma 2B \u5c31\u5176\u6a21\u578b\u5927\u5c0f\u800c\u8a00\uff0c\u662f\u4e00\u500b\u6eff\u5fae\u5999\u7684\u6a21\u578b\uff0c\u4f46\u5b83\u5728\u6392\u884c\u699c\u4e0a\u7684\u8868\u73fe\uff0c\u4e0d\u5982\u5177\u6709\u76f8\u4f3c\u5927\u5c0f\u7684\u6a21\u578b\uff08\u4f8b\u5982 Phi 2\uff09\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"0da8\">\u76f8\u95dc\u6a21\u578b\u7db2\u8def\u8cc7\u6e90<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li>HuggingFace Playground:<\/li>\n<\/ul>\n\n\n\n<p id=\"d945\">https:\/\/huggingface.co\/chat?model=google\/ gemma-7b-it<\/p>\n\n\n\n<h1 class=\"wp-block-heading\" id=\"8112\">II. \u6211\u7684\u89c0\u9ede<\/h1>\n\n\n\n<p id=\"7684\">Google \u958b\u767c\u8005\u95dc\u4fc2\u5c08\u6848\u7d93\u7406\u4e0a\u5b98\u6797\u5091\u5728\u81c9\u66f8\u4e0a\u5206\u4eab\u7684\u7d50\u8ad6\uff0c\u5df2\u7d93\u5beb\u5f97\u975e\u5e38\u6e05\u695a\uff0c\u5728\u6b64\u5206\u4eab\u85c9\u7531\u4ed6\u6240\u6574\u7406\u51fa\u4f86\u7684\u8cc7\u8a0a\uff0c\u52a0\u4e0a\u6211\u7684\u60f3\u6cd5\u88dc\u5145\uff1a<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u6709\u51fa 2B \u8ddf 7B \u5169\u500b\u7248\u672c\uff1a2B \u611f\u89ba\u76ee\u524d\u9084\u6c92\u5c07\u80fd\u529b\u8abf\u6574\u5230\u6700\u597d\uff0c\u4f46\u5982\u679c\u5141\u8a31\uff0c\u6216\u8a31\u662f\u672a\u4f86\u53ef\u4ee5\u653e\u5728\u5c0f\u578b\u88dd\u7f6e\u4e0a\u7684\u5927\u578b\u8a9e\u8a00\u6a21\u578b\uff0c\u800c 7B \u6574\u9ad4\u72c0\u614b\u5c31\u8868\u73fe\u5f88\u597d\uff0c\u5927\u5bb6\u53ef\u4ee5\u53bb\u5617\u8a66\u73a9\u73a9\u770b\uff0c\u6709\u4e9b\u6211\u5728 ChatGPT \u4e0a\u9762\u6240\u554f\u7684\u554f\u984c\uff0c\u6b64\u6a21\u578b\u4e5f\u80fd\u5920\u5354\u52a9\u505a\u5230<\/li>\n\n\n\n<li>Gemma \u6709\u63d0\u4f9b fine-tuning interface \u7d66 TensorFlow, PyTorch and JAX through Keras 3.0 \u7b49\uff0c\u4ee5\u4e0b\u5716\u7247\u662f\u4f7f\u7528 HuggingFace \u7684 trl \u5957\u4ef6\u4f86\u505a Fine-tune\u7684\u6307\u4ee4\uff0c\u63d0\u4f9b\u7d66\u5927\u5bb6\u505a\u53c3\u8003\uff1a<\/li>\n<\/ul>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/miro.medium.com\/v2\/resize:fit:700\/0*mcbmS3WGrI9-YvGC\" alt=\"\"\/><figcaption class=\"wp-element-caption\">\u6b64\u5716\u7247\u7531 JimmyLiao \u6240\u63d0\u4f9b\u7684\u8cc7\u8a0a<\/figcaption><\/figure>\n<\/div>\n\n\n<ul class=\"wp-block-list\">\n<li>\u53ef\u4ee5\u5728 Google Colab, Kaggle Notebook\u4e2d\u4f7f\u7528\uff0c\u7576\u7136\u5176\u5b83\u751f\u614b\u7cfb\u5982 HuggingFace \u7b49\u4e5f\u6709\u517c\u9867\u3002<\/li>\n\n\n\n<li>\u56e0\u70ba\u9019\u662f\u4e00\u500b\u958b\u6e90\u6a21\u578b\uff0c\u6240\u4ee5\u53ef\u4ee5\u8dd1\u5728\u81ea\u5df1\u7684\u6a5f\u5668\u74b0\u5883\u4e0a\uff0c\u6216\u8005\u4f7f\u7528 GCP \u76f8\u95dc\u7684\u670d\u52d9\u74b0\u5883\u505a\u904b\u884c\uff0c\u50cf\u662f Google Vertex AI \u548c GKE \u4e0a<\/li>\n\n\n\n<li>\u7562\u7adf\u662f Google \u6240\u958b\u6e90\u51fa\u4f86\u7684\u6a21\u578b\uff0c\u5b98\u65b9\u6709\u8aaa\uff0c\u6b64\u6a21\u578b\u4e5f\u5df2\u7d93\u91dd\u5c0d NVidia \u548c TPU \u512a\u5316\uff0c\u800c\u4e14 \u5b98\u65b9\u4e5f\u63d0\u4f9b GGUF \u6a21\u578b\uff0c\u53ef\u4ee5\u8b93\u5927\u5bb6\u5728\u5df2\u7d93\u512a\u5316\u904e\u7684\u63a8\u8ad6\u6a21\u578b\u4e0a\u9762\u505a\u4f7f\u7528\u3002<\/li>\n\n\n\n<li>\u662f\u5426\u80fd\u5920\u7e41\u9ad4\u4e2d\u6587\u554f\u7b54\uff1f7B \u6a21\u578b\u7684\u7b54\u6848\u662f\u53ef\u4ee5\uff0c\u4f46\u5f88\u5bb9\u6613\u6709\u7c21\u9ad4\u4e2d\u6587\u8a9e\u8a00\u3002<\/li>\n<\/ul>\n\n\n\n<p id=\"857a\">\u7e3d\u6b78\u4e00\u53e5\uff0cGemma \u6a21\u578b\u7562\u7adf\u662f Google \u7b2c\u4e00\u500b\u57fa\u65bc Gemini \u7684\u958b\u6e90 LLM \u6a21\u578b\uff0c\u76f8\u4fe1\u95dc\u6ce8\u5ea6\u4e00\u5b9a\u6703\u5f88\u9ad8\uff0c\u5c31\u76ee\u524d\u770b\u8d77\u4f86\uff0c7B \u6a21\u578b\u6027\u80fd\u7a0d\u512a\u65bc Mistral 7B\uff0c\u800c\u4e14\u4e5f\u662f\u4e00\u500b\u53ef\u5546\u7528\u7684 LLM \u6a21\u578b\uff01\u5927\u5bb6\u53ef\u4ee5\u518d\u82b1\u4e00\u4e9b\u6642\u9593\u505a\u6e2c\u8a66\uff0c\u4e26\u4e14\u4e00\u540c\u5206\u4eab\u4e86\u89e3\u66f4\u591a Gemma \u7684\u80fd\u529b\uff01<\/p>\n\n\n\n<p>\u8cc7\u6599\u4f86\u6e90: <a href=\"https:\/\/blog.infuseai.io\/quick-demo-gemma-brief-intro-5890117cfbe0\">https:\/\/blog.infuseai.io\/quick-demo-gemma-brief-intro-5890117cfbe0<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>2024-02-21 | Simon Liu Google \u5728 2\/21 \u7684\u4eca\u5929\uff0c\u516c\u4f48\u4ed6\u5011\u65b0\u51fa\u4e86\u958b\u6e90\u6a21\u578b \u2014 Gemma\uff0c\u4ee5\u4e0b\u70ba\u5927\u5bb6\u7d71\u6574\u76f8\u95dc\u6a21\u578b\u8cc7\u8a0a\uff1a I. Gemma \u6a21\u578b\u4ecb\u7d39 &hellip;<\/p>\n","protected":false},"author":4,"featured_media":7088,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[579,4],"tags":[40],"class_list":["post-7087","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-579","category-industry-news","tag-40"],"gutentor_comment":0,"jetpack_featured_media_url":"https:\/\/i0.wp.com\/aict.nkust.edu.tw\/digitrans\/wp-content\/uploads\/2024\/10\/%E8%9E%A2%E5%B9%95%E6%93%B7%E5%8F%96%E7%95%AB%E9%9D%A2-2024-10-04-164128.png?fit=674%2C363&ssl=1","jetpack-related-posts":[],"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=\/wp\/v2\/posts\/7087","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=7087"}],"version-history":[{"count":1,"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=\/wp\/v2\/posts\/7087\/revisions"}],"predecessor-version":[{"id":7089,"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=\/wp\/v2\/posts\/7087\/revisions\/7089"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=\/wp\/v2\/media\/7088"}],"wp:attachment":[{"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=7087"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=7087"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/aict.nkust.edu.tw\/digitrans\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=7087"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}