{"id":6343,"date":"2026-01-21T19:12:50","date_gmt":"2026-01-21T10:12:50","guid":{"rendered":"https:\/\/secondlife.lol\/?p=6343"},"modified":"2026-01-21T19:12:51","modified_gmt":"2026-01-21T10:12:51","slug":"m2-24gb-translategemma-12b-local-translation-server","status":"publish","type":"post","link":"https:\/\/secondlife.lol\/zh\/m2-24gb-translategemma-12b-local-translation-server\/","title":{"rendered":"Mac M2 24GB\ub85c TranslateGemma 12B \ub85c\uceec \ubc88\uc5ed \uc11c\ubc84 \uad6c\ucd95 \ub3c4\uc804\uae30"},"content":{"rendered":"<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img decoding=\"async\" width=\"600\" height=\"344\" src=\"https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-78-600x344.png\" alt=\"TranslateGemma 12B \uc378\ub124\uc77c\" class=\"wp-image-6345\" srcset=\"https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-78-600x344.png 600w, https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-78-300x172.png 300w, https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-78-768x440.png 768w, https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-78-18x10.png 18w, https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-78.png 1200w\" sizes=\"(max-width: 600px) 100vw, 600px\" \/><\/figure>\n<\/div>\n\n\n<p>MacBook M2 24GB \ubaa8\ub378\ub85c \u201c<a href=\"https:\/\/ollama.com\/library\/translategemma:12b\" target=\"_blank\" rel=\"noopener\">TranslateGemma 12B<\/a>\ub97c <a href=\"https:\/\/docs.vllm.ai\/en\/latest\/\" target=\"_blank\" rel=\"noopener\">vLLM<\/a>\ub85c \ub3cc\ub824\uc11c \ub85c\uceec \ubc88\uc5ed API \uc11c\ubc84\u201d\ub97c \ub9cc\ub4e4\uace0 \uc2f6\ub2e4\uba74, \uba3c\uc800 \ud604\uc2e4 \uccb4\ud06c\uac00 \ud544\uc694\ud569\ub2c8\ub2e4. vLLM\uc740 \ud604\uc7ac macOS\uc758 Metal(MPS) GPU \uac00\uc18d\uc744 \uc9c0\uc6d0\ud558\uc9c0 \uc54a\uc544 M2\uc5d0\uc11c \uc0ac\uc2e4\uc0c1 CPU \uc11c\ube59\uc774 \ub418\uace0, 12B\ub294 \uccb4\uac10 \uc18d\ub3c4\uac00 \uae30\ub300\ubcf4\ub2e4 \ub9ce\uc774 \ub290\ub9b4 \uc218 \uc788\uc5b4\uc694.\u00a0<\/p>\n\n\n\n<p>M2 24GB\uc5d0\uc120 \u201cvLLM(\uc815\ud1b5)\u201d\ubcf4\ub2e4, (1) vLLM\uc740 \uac1c\ubc1c\uc6a9\/\ud14c\uc2a4\ud2b8\uc6a9 + (2) \uc2e4\uc0ac\uc6a9\uc740 MLX\/<a href=\"https:\/\/secondlife.lol\/open-webui-ollama-setup-macbook-part2\/\" data-type=\"post\" data-id=\"5141\">Ollama<\/a>\/llama.cpp(OpenAI \ud638\ud658 \uc11c\ubc84)\ub85c 12B \uc591\uc790\ud654\uac00 \uc131\uacf5 \ud655\ub960\uc774 \ub192\uc2b5\ub2c8\ub2e4.\u00a0<\/p>\n\n\n<style>.wp-block-kadence-advancedheading.kt-adv-heading6343_bff48d-dd, .wp-block-kadence-advancedheading.kt-adv-heading6343_bff48d-dd[data-kb-block=\"kb-adv-heading6343_bff48d-dd\"]{font-style:normal;}.wp-block-kadence-advancedheading.kt-adv-heading6343_bff48d-dd mark.kt-highlight, .wp-block-kadence-advancedheading.kt-adv-heading6343_bff48d-dd[data-kb-block=\"kb-adv-heading6343_bff48d-dd\"] mark.kt-highlight{font-style:normal;color:#f76a0c;-webkit-box-decoration-break:clone;box-decoration-break:clone;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;}.wp-block-kadence-advancedheading.kt-adv-heading6343_bff48d-dd img.kb-inline-image, .wp-block-kadence-advancedheading.kt-adv-heading6343_bff48d-dd[data-kb-block=\"kb-adv-heading6343_bff48d-dd\"] img.kb-inline-image{width:150px;vertical-align:baseline;}<\/style>\n<h2 class=\"kt-adv-heading6343_bff48d-dd wp-block-kadence-advancedheading\" data-kb-block=\"kb-adv-heading6343_bff48d-dd\"><strong>TranslateGemma<\/strong>\ub780?<\/h2>\n\n\n\n<p>TranslateGemma\ub780 \uad6c\uae00\uc774 \uacf5\uac1c\ud55c <strong>\ubc88\uc5ed \ud2b9\ud654 \uc624\ud508 \ubaa8\ub378 \uc81c\ud488\uad70<\/strong>\uc73c\ub85c, 4B\/12B\/27B\uac00 \uc788\uace0 55\uac1c \uc5b8\uc5b4 \ubc88\uc5ed\uc744 \ubaa9\ud45c\ub85c \ud569\ub2c8\ub2e4. \uc774 \uc911\uc5d0\uc11c 12B\uac00 \u201c\uc77c\ubc18 \ub178\ud2b8\ubd81 \uae30\ubc18 \ub85c\uceec \uac1c\ubc1c\u201d \ud3ec\uc9c0\uc158\uc785\ub2c8\ub2e4.\u00a0<\/p>\n\n\n\n<p>\uc5ec\uae30\uc11c 12B\ub294 \ud30c\ub77c\ubbf8\ud130 \uaddc\ubaa8(120\uc5b5)\ub97c \ub73b\ud558\uace0, \uc2e4\uc804\uc5d0\uc11c\ub294 \uba54\ubaa8\ub9ac(\ud2b9\ud788 \uac00\uc18d\uae30 VRAM\/\ud1b5\ud569 \uba54\ubaa8\ub9ac) + \uc591\uc790\ud654(4bit\/8bit) + \uc11c\ube59 \uc5d4\uc9c4 \uc870\ud569\uc774 \uc131\ud328\ub97c \uac00\ub985\ub2c8\ub2e4.&nbsp;<\/p>\n\n\n<style>.wp-block-kadence-advancedheading.kt-adv-heading6343_ee30ab-24, .wp-block-kadence-advancedheading.kt-adv-heading6343_ee30ab-24[data-kb-block=\"kb-adv-heading6343_ee30ab-24\"]{font-style:normal;}.wp-block-kadence-advancedheading.kt-adv-heading6343_ee30ab-24 mark.kt-highlight, .wp-block-kadence-advancedheading.kt-adv-heading6343_ee30ab-24[data-kb-block=\"kb-adv-heading6343_ee30ab-24\"] mark.kt-highlight{font-style:normal;color:#f76a0c;-webkit-box-decoration-break:clone;box-decoration-break:clone;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;}.wp-block-kadence-advancedheading.kt-adv-heading6343_ee30ab-24 img.kb-inline-image, .wp-block-kadence-advancedheading.kt-adv-heading6343_ee30ab-24[data-kb-block=\"kb-adv-heading6343_ee30ab-24\"] img.kb-inline-image{width:150px;vertical-align:baseline;}<\/style>\n<h2 class=\"kt-adv-heading6343_ee30ab-24 wp-block-kadence-advancedheading\" data-kb-block=\"kb-adv-heading6343_ee30ab-24\"><strong><strong>TranslateGemma<\/strong><\/strong> 12B<\/h2>\n\n\n\n<p>12B \ubaa8\ub378\uc774 WMT24++\uc5d0\uc11c \uc131\ub2a5\uc774 \uc88b\ub2e4\ub294 \uacb0\uacfc\uac00 \uc18c\uac1c\ub418\uace0 \u00a0\u201c\uc801\uc740 \uc790\uc6d0\uc73c\ub85c \uace0\ud488\uc9c8 \ubc88\uc5ed\u201d\uc774 \uac00\ub2a5\ud574\uc838 \ubaa8\ubc14\uc77c \ub178\ud2b8\ubd81 \ud074\ub77c\uc6b0\ub4dc\uae4c\uc9c0 \ubc94\uc704\uac00 \ub113\uc5b4\uc84c\ub2e4\uace0 \ud569\ub2c8\ub2e4.\u00a0<\/p>\n\n\n\n<p>\ub2e4\ub9cc! M2 24GB\ub294 \u201c\uac00\ub2a5\u201d \uc601\uc5ed\uc774\uc9c0\ub9cc, \uc5b4\ub5a4 \uc5d4\uc9c4\uc73c\ub85c \ub3cc\ub9ac\ub0d0\uac00 \ub9e4\uc6b0 \uc911\uc694\ud569\ub2c8\ub2e4. vLLM\uc740 \uc6d0\ub798 \uace0\uc131\ub2a5 GPU \uc11c\ubc84\uc6a9 \uc131\uaca9\uc774 \uac15\ud558\uace0, macOS GPU(MPS)\ub97c \uc544\uc9c1 \ubabb \uc501\ub2c8\ub2e4.&nbsp;<\/p>\n\n\n<style>.wp-block-kadence-advancedheading.kt-adv-heading6343_b93452-ca, .wp-block-kadence-advancedheading.kt-adv-heading6343_b93452-ca[data-kb-block=\"kb-adv-heading6343_b93452-ca\"]{font-style:normal;}.wp-block-kadence-advancedheading.kt-adv-heading6343_b93452-ca mark.kt-highlight, .wp-block-kadence-advancedheading.kt-adv-heading6343_b93452-ca[data-kb-block=\"kb-adv-heading6343_b93452-ca\"] mark.kt-highlight{font-style:normal;color:#f76a0c;-webkit-box-decoration-break:clone;box-decoration-break:clone;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;}.wp-block-kadence-advancedheading.kt-adv-heading6343_b93452-ca img.kb-inline-image, .wp-block-kadence-advancedheading.kt-adv-heading6343_b93452-ca[data-kb-block=\"kb-adv-heading6343_b93452-ca\"] img.kb-inline-image{width:150px;vertical-align:baseline;}<\/style>\n<h2 class=\"kt-adv-heading6343_b93452-ca wp-block-kadence-advancedheading\" data-kb-block=\"kb-adv-heading6343_b93452-ca\">\uc804\uccb4 \uad6c\uc870<\/h2>\n\n\n\n<p>M2 24GB \uae30\uc900\uc73c\ub85c \u201c\ubaa9\ud45c\u201d\ub97c 2\ub2e8\uacc4\ub85c \ub098\ub220 \uc7a1\ub294 \uac8c \uc548\uc804\ud569\ub2c8\ub2e4.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img decoding=\"async\" width=\"600\" height=\"344\" src=\"https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-77-600x344.png\" alt=\"\uc804\uccb4 \uad6c\uc870\" class=\"wp-image-6344\" srcset=\"https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-77-600x344.png 600w, https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-77-300x172.png 300w, https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-77-768x440.png 768w, https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-77-18x10.png 18w, https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-77.png 1200w\" sizes=\"(max-width: 600px) 100vw, 600px\" \/><\/figure>\n<\/div>\n\n<style>.wp-block-kadence-advancedheading.kt-adv-heading6343_09e121-02, .wp-block-kadence-advancedheading.kt-adv-heading6343_09e121-02[data-kb-block=\"kb-adv-heading6343_09e121-02\"]{font-style:normal;}.wp-block-kadence-advancedheading.kt-adv-heading6343_09e121-02 mark.kt-highlight, .wp-block-kadence-advancedheading.kt-adv-heading6343_09e121-02[data-kb-block=\"kb-adv-heading6343_09e121-02\"] mark.kt-highlight{font-style:normal;color:#f76a0c;-webkit-box-decoration-break:clone;box-decoration-break:clone;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;}.wp-block-kadence-advancedheading.kt-adv-heading6343_09e121-02 img.kb-inline-image, .wp-block-kadence-advancedheading.kt-adv-heading6343_09e121-02[data-kb-block=\"kb-adv-heading6343_09e121-02\"] img.kb-inline-image{width:150px;vertical-align:baseline;}<\/style>\n<h3 class=\"kt-adv-heading6343_09e121-02 wp-block-kadence-advancedheading\" data-kb-block=\"kb-adv-heading6343_09e121-02\">A\uc548(\uc694\uad6c\uc0ac\ud56d: \u2018vLLM\ub85c \uad6c\ud604\u2019 \ucda9\uc871 \/ \uac1c\ubc1c\u00b7\ud14c\uc2a4\ud2b8\uc6a9)<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>vLLM OpenAI \ud638\ud658 \uc11c\ubc84\ub97c \ub744\uc6b4\ub2e4<\/li>\n\n\n\n<li>\ub2e8, M2\uc5d0\uc11c\ub294 GPU \uac00\uc18d\uc774 \uc544\ub2c8\ub77c CPU \ucabd\uc73c\ub85c \ub3cc \uac00\ub2a5\uc131\uc774 \ub192\uc74c \u2192 12B\ub294 \ub290\ub9b4 \uc218 \uc788\uc74c &nbsp;<\/li>\n<\/ul>\n\n\n<style>.wp-block-kadence-advancedheading.kt-adv-heading6343_294844-fd, .wp-block-kadence-advancedheading.kt-adv-heading6343_294844-fd[data-kb-block=\"kb-adv-heading6343_294844-fd\"]{font-style:normal;}.wp-block-kadence-advancedheading.kt-adv-heading6343_294844-fd mark.kt-highlight, .wp-block-kadence-advancedheading.kt-adv-heading6343_294844-fd[data-kb-block=\"kb-adv-heading6343_294844-fd\"] mark.kt-highlight{font-style:normal;color:#f76a0c;-webkit-box-decoration-break:clone;box-decoration-break:clone;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;}.wp-block-kadence-advancedheading.kt-adv-heading6343_294844-fd img.kb-inline-image, .wp-block-kadence-advancedheading.kt-adv-heading6343_294844-fd[data-kb-block=\"kb-adv-heading6343_294844-fd\"] img.kb-inline-image{width:150px;vertical-align:baseline;}<\/style>\n<h3 class=\"kt-adv-heading6343_294844-fd wp-block-kadence-advancedheading\" data-kb-block=\"kb-adv-heading6343_294844-fd\">B\uc548(\uc2e4\uc0ac\uc6a9 \uc131\uacf5\ub960 \ucd5c\uc0c1 \/ \ub85c\uceec \ubc88\uc5ed \uc11c\ubc84 \uc6b4\uc601\uc6a9)<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>12B\ub97c \uc591\uc790\ud654(GGUF\/MLX 4bit \ub4f1)\ud574\uc11c<\/li>\n\n\n\n<li>llama.cpp \uacc4\uc5f4(OpenAI \ud638\ud658 \uc11c\ubc84) \ub610\ub294 Ollama\/MLX\ub85c \ube60\ub974\uac8c \ub3cc\ub9b0\ub2e4 &nbsp;<\/li>\n<\/ul>\n\n\n<style>.wp-block-kadence-advancedheading.kt-adv-heading6343_301b8d-07, .wp-block-kadence-advancedheading.kt-adv-heading6343_301b8d-07[data-kb-block=\"kb-adv-heading6343_301b8d-07\"]{font-style:normal;}.wp-block-kadence-advancedheading.kt-adv-heading6343_301b8d-07 mark.kt-highlight, .wp-block-kadence-advancedheading.kt-adv-heading6343_301b8d-07[data-kb-block=\"kb-adv-heading6343_301b8d-07\"] mark.kt-highlight{font-style:normal;color:#f76a0c;-webkit-box-decoration-break:clone;box-decoration-break:clone;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;}.wp-block-kadence-advancedheading.kt-adv-heading6343_301b8d-07 img.kb-inline-image, .wp-block-kadence-advancedheading.kt-adv-heading6343_301b8d-07[data-kb-block=\"kb-adv-heading6343_301b8d-07\"] img.kb-inline-image{width:150px;vertical-align:baseline;}<\/style>\n<h2 class=\"kt-adv-heading6343_301b8d-07 wp-block-kadence-advancedheading\" data-kb-block=\"kb-adv-heading6343_301b8d-07\">\uc124\uce58\/\uc900\ube44\ubb3c<\/h2>\n\n\n<style>.wp-block-kadence-advancedheading.kt-adv-heading6343_6bbc83-ab, .wp-block-kadence-advancedheading.kt-adv-heading6343_6bbc83-ab[data-kb-block=\"kb-adv-heading6343_6bbc83-ab\"]{font-style:normal;}.wp-block-kadence-advancedheading.kt-adv-heading6343_6bbc83-ab mark.kt-highlight, .wp-block-kadence-advancedheading.kt-adv-heading6343_6bbc83-ab[data-kb-block=\"kb-adv-heading6343_6bbc83-ab\"] mark.kt-highlight{font-style:normal;color:#f76a0c;-webkit-box-decoration-break:clone;box-decoration-break:clone;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;}.wp-block-kadence-advancedheading.kt-adv-heading6343_6bbc83-ab img.kb-inline-image, .wp-block-kadence-advancedheading.kt-adv-heading6343_6bbc83-ab[data-kb-block=\"kb-adv-heading6343_6bbc83-ab\"] img.kb-inline-image{width:150px;vertical-align:baseline;}<\/style>\n<h3 class=\"kt-adv-heading6343_6bbc83-ab wp-block-kadence-advancedheading\" data-kb-block=\"kb-adv-heading6343_6bbc83-ab\">\uacf5\ud1b5 \uc900\ube44\ubb3c<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>macOS (Apple Silicon) + RAM 24GB<\/li>\n\n\n\n<li>\ud130\ubbf8\ub110 \uae30\ubcf8 \uc0ac\uc6a9<\/li>\n\n\n\n<li>Hugging Face \ubaa8\ub378 \uc811\uadfc(\ub77c\uc774\uc120\uc2a4 \ub3d9\uc758\uac00 \ud544\uc694\ud55c \uacbd\uc6b0\uac00 \uc788\uc74c) &nbsp;<\/li>\n<\/ul>\n\n\n<style>.wp-block-kadence-advancedheading.kt-adv-heading6343_3fb30b-04, .wp-block-kadence-advancedheading.kt-adv-heading6343_3fb30b-04[data-kb-block=\"kb-adv-heading6343_3fb30b-04\"]{font-style:normal;}.wp-block-kadence-advancedheading.kt-adv-heading6343_3fb30b-04 mark.kt-highlight, .wp-block-kadence-advancedheading.kt-adv-heading6343_3fb30b-04[data-kb-block=\"kb-adv-heading6343_3fb30b-04\"] mark.kt-highlight{font-style:normal;color:#f76a0c;-webkit-box-decoration-break:clone;box-decoration-break:clone;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;}.wp-block-kadence-advancedheading.kt-adv-heading6343_3fb30b-04 img.kb-inline-image, .wp-block-kadence-advancedheading.kt-adv-heading6343_3fb30b-04[data-kb-block=\"kb-adv-heading6343_3fb30b-04\"] img.kb-inline-image{width:150px;vertical-align:baseline;}<\/style>\n<h3 class=\"kt-adv-heading6343_3fb30b-04 wp-block-kadence-advancedheading\" data-kb-block=\"kb-adv-heading6343_3fb30b-04\">M2\uc5d0\uc11c vLLM \uad00\ub828 \u201c\uc911\uc694\ud55c \uc804\uc81c\u201d<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>vLLM\uc740 Apple Metal(MPS) GPU \ubc31\uc5d4\ub4dc\ub97c \uc9c0\uc6d0\ud558\uc9c0 \uc54a\ub294\ub2e4\ub294 \uc774\uc288\/\ub17c\uc758\uac00 \uacf5\uac1c\ub3fc \uc788\uc2b5\ub2c8\ub2e4. \uadf8\ub798\uc11c macOS\uc5d0\uc120 CPU \uc704\uc8fc\uac00 \ub429\ub2c8\ub2e4. &nbsp;<\/li>\n\n\n\n<li>vLLM CPU \uacf5\uc2dd \ubb38\uc11c\ub294 x86 \uc911\uc2ec \uc548\ub0b4\uac00 \uc788\uace0(Apple Silicon\uacfc \uacb0\uc774 \ub2e4\ub984), M2\uc5d0\uc11c \u201c\ub531 \ub9de\uac8c\u201d \uc4f0\ub824\uba74 \ube4c\ub4dc\/\ud658\uacbd \uc774\uc288\uac00 \uc0dd\uae38 \uc218 \uc788\uc5b4\uc694. &nbsp;<\/li>\n<\/ul>\n\n\n\n<p>\ud83d\udc49 \uacb0\ub860: **\u201cvLLM\uc740 \uad6c\ud604 \uccb4\ud5d8\/\uac1c\ubc1c \ud50c\ub85c\uc6b0 \ud655\uc778\uc6a9\u201d**\uc73c\ub85c \uc7a1\uace0, \uc2e4\uc0ac\uc6a9\uc740 B\uc548\uc774 \uc2a4\ud2b8\ub808\uc2a4\uac00 \uc801\uc2b5\ub2c8\ub2e4.<\/p>\n\n\n<style>.wp-block-kadence-advancedheading.kt-adv-heading6343_fa2546-fc, .wp-block-kadence-advancedheading.kt-adv-heading6343_fa2546-fc[data-kb-block=\"kb-adv-heading6343_fa2546-fc\"]{font-style:normal;}.wp-block-kadence-advancedheading.kt-adv-heading6343_fa2546-fc mark.kt-highlight, .wp-block-kadence-advancedheading.kt-adv-heading6343_fa2546-fc[data-kb-block=\"kb-adv-heading6343_fa2546-fc\"] mark.kt-highlight{font-style:normal;color:#f76a0c;-webkit-box-decoration-break:clone;box-decoration-break:clone;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;}.wp-block-kadence-advancedheading.kt-adv-heading6343_fa2546-fc img.kb-inline-image, .wp-block-kadence-advancedheading.kt-adv-heading6343_fa2546-fc[data-kb-block=\"kb-adv-heading6343_fa2546-fc\"] img.kb-inline-image{width:150px;vertical-align:baseline;}<\/style>\n<h2 class=\"kt-adv-heading6343_fa2546-fc wp-block-kadence-advancedheading\" data-kb-block=\"kb-adv-heading6343_fa2546-fc\">\uc2e4\uc804 \uc0ac\uc6a9\ubc95 (Step-by-step)<\/h2>\n\n\n\n<p>\uc544\ub798\ub294 M2 24GB\uc5d0 \ub9de\ucd98 2\ud2b8\ub799\uc73c\ub85c \uc815\ub9ac\ud588\uc2b5\ub2c8\ub2e4. (\u201cvLLM \uad6c\ud604\u201d\uc740 \ud2b8\ub799 1\uc5d0 \ud3ec\ud568)<\/p>\n\n\n<style>.wp-block-kadence-advancedheading.kt-adv-heading6343_423a79-ad, .wp-block-kadence-advancedheading.kt-adv-heading6343_423a79-ad[data-kb-block=\"kb-adv-heading6343_423a79-ad\"]{font-style:normal;}.wp-block-kadence-advancedheading.kt-adv-heading6343_423a79-ad mark.kt-highlight, .wp-block-kadence-advancedheading.kt-adv-heading6343_423a79-ad[data-kb-block=\"kb-adv-heading6343_423a79-ad\"] mark.kt-highlight{font-style:normal;color:#f76a0c;-webkit-box-decoration-break:clone;box-decoration-break:clone;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;}.wp-block-kadence-advancedheading.kt-adv-heading6343_423a79-ad img.kb-inline-image, .wp-block-kadence-advancedheading.kt-adv-heading6343_423a79-ad[data-kb-block=\"kb-adv-heading6343_423a79-ad\"] img.kb-inline-image{width:150px;vertical-align:baseline;}<\/style>\n<h3 class=\"kt-adv-heading6343_423a79-ad wp-block-kadence-advancedheading\" data-kb-block=\"kb-adv-heading6343_423a79-ad\">\ud2b8\ub799 1) vLLM\ub85c \u201cOpenAI \ud638\ud658 \ubc88\uc5ed \uc11c\ubc84\u201d \ud615\ud0dc \ub9cc\ub4e4\uae30 (\uac1c\ubc1c\/\ud14c\uc2a4\ud2b8\uc6a9)<\/h3>\n\n\n\n<p><strong>Step 1. vLLM \uc124\uce58<\/strong><\/p>\n\n\n\n<p>pip install -U vllm<\/p>\n\n\n\n<p><strong>Step 2. \uc11c\ubc84 \uc2e4\ud589 (OpenAI \ud638\ud658)<\/strong><\/p>\n\n\n\n<p>vllm serve google\/translategemma-12b-it  &#8211;host 0.0.0.0 &#8211;port 8000<\/p>\n\n\n\n<p><strong>\ucf54\ub4dc \ud574\uc124<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>vllm serve\ub294 OpenAI \ud638\ud658 API \uc11c\ubc84\ub97c \ub744\uc6c1\ub2c8\ub2e4. &nbsp;<\/li>\n\n\n\n<li>\ub2e4\ub9cc M2\uc5d0\uc120 MPS GPU \uac00\uc18d\uc774 \uc548 \ub418\uc5b4\uc11c, \uc704 \ubc29\uc2dd\uc740 12B\uac00 CPU\ub85c \ucc98\ub9ac\ub420 \uac00\ub2a5\uc131\uc774 \ub192\uace0 \uc18d\ub3c4\uac00 \ub9cc\uc871\uc2a4\ub7fd\uc9c0 \uc54a\uc744 \uc218 \uc788\uc2b5\ub2c8\ub2e4. &nbsp;<\/li>\n\n\n\n<li>\u201c\uadf8\ub798\ub3c4 vLLM\ub85c \uad6c\ud604\ud588\ub2e4\u201d\ub294 \ud615\ud0dc(\uc544\ud0a4\ud14d\ucc98\/\uc5f0\ub3d9 \ubc29\uc2dd \ud655\uc778)\ub294 \uc774 \ud2b8\ub799\uc73c\ub85c \ucda9\uc871 \uac00\ub2a5\ud569\ub2c8\ub2e4.<\/li>\n<\/ul>\n\n\n\n<p><strong>Step 3. \ubc88\uc5ed \ud638\ucd9c(curl)<\/strong><\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>curl http:\/\/localhost:8000\/v1\/chat\/completions \\\n\n\u00a0 -H \"Content-Type: application\/json\" \\\n\n\u00a0 -d '{\n\n\u00a0 \u00a0 \"model\": \"google\/translategemma-12b-it\",\n\n\u00a0 \u00a0 \"messages\": &#91;\n\n\u00a0 \u00a0 \u00a0 {\n\n\u00a0 \u00a0 \u00a0 \u00a0 \"role\": \"user\",\n\n\u00a0 \u00a0 \u00a0 \u00a0 \"content\": \"\uc774 \ubb38\uc7a5\uc744 \uc601\uc5b4\ub85c \uc790\uc5f0\uc2a4\ub7fd\uac8c \ubc88\uc5ed\ud574\uc918.\"\n\n\u00a0 \u00a0 \u00a0 }\n\n\u00a0 \u00a0 ],\n\n\u00a0 \u00a0 \"max_tokens\": 200\n\n\u00a0 }'<\/code><\/pre>\n\n\n\n<p>\u26a0\ufe0f \ucc38\uace0: TranslateGemma\ub294 \u201c\uc804\uc6a9 \ud15c\ud50c\ub9bf\u201d \ud615\ud0dc\uac00 \ub354 \uc798 \ub9de\ub294 \uacbd\uc6b0\uac00 \uc788\uc2b5\ub2c8\ub2e4. vLLM\/\ud074\ub77c\uc774\uc5b8\ud2b8\uc5d0\uc11c \ud15c\ud50c\ub9bf\uc774 \uc790\ub3d9 \uc801\uc6a9\ub418\uc9c0 \uc54a\uac70\ub098 \uacb0\uacfc\uac00 \ub4e4\ucb49\ub0a0\ucb49\ud558\uba74, \uc544\ub798 \ud2b8\ub799 2 \ubc29\uc2dd\ucc98\ub7fc \u201c\ub85c\uceec \ub7f0\ud0c0\uc784 + \uba85\uc2dc\uc801 \ud504\ub86c\ud504\ud2b8 \uac00\uc774\ub4dc\u201d\ub85c \uc548\uc815\ud654\ub97c \ucd94\ucc9c\ud569\ub2c8\ub2e4. <\/p>\n\n\n<style>.wp-block-kadence-advancedheading.kt-adv-heading6343_a2493e-d4, .wp-block-kadence-advancedheading.kt-adv-heading6343_a2493e-d4[data-kb-block=\"kb-adv-heading6343_a2493e-d4\"]{font-style:normal;}.wp-block-kadence-advancedheading.kt-adv-heading6343_a2493e-d4 mark.kt-highlight, .wp-block-kadence-advancedheading.kt-adv-heading6343_a2493e-d4[data-kb-block=\"kb-adv-heading6343_a2493e-d4\"] mark.kt-highlight{font-style:normal;color:#f76a0c;-webkit-box-decoration-break:clone;box-decoration-break:clone;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;}.wp-block-kadence-advancedheading.kt-adv-heading6343_a2493e-d4 img.kb-inline-image, .wp-block-kadence-advancedheading.kt-adv-heading6343_a2493e-d4[data-kb-block=\"kb-adv-heading6343_a2493e-d4\"] img.kb-inline-image{width:150px;vertical-align:baseline;}<\/style>\n<h3 class=\"kt-adv-heading6343_a2493e-d4 wp-block-kadence-advancedheading\" data-kb-block=\"kb-adv-heading6343_a2493e-d4\">\ud2b8\ub799 2) M2 24GB\uc5d0\uc11c \u201c\uc9c4\uc9dc \uc4f8\ub9cc\ud55c \uc18d\ub3c4\u201d\ub85c 12B \ubc88\uc5ed \uc11c\ubc84 \ub9cc\ub4e4\uae30 (\ucd94\ucc9c)<\/h3>\n\n\n\n<p>\uc5ec\uae30\uc11c\ubd80\ud130\ub294 \uc131\uacf5\ub960\uc774 \ud655 \uc62c\ub77c\uac11\ub2c8\ub2e4. \ud3ec\uc778\ud2b8\ub294 12B\ub97c \u2018\uc591\uc790\ud654\u2019\ud574\uc11c \uba54\ubaa8\ub9ac \ubd80\ub2f4\uc744 \uc904\uc774\ub294 \uac83\uc774\uc5d0\uc694.<\/p>\n\n\n\n<p><strong>\uc635\uc158 2-A) llama.cpp(GGUF) + OpenAI \ud638\ud658 \uc11c\ubc84(\ud30c\uc774\uc36c)\ub85c \uc11c\ube59<\/strong><\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>GGUF(\uc591\uc790\ud654) \ubaa8\ub378 \uc900\ube44<br>Hugging Face\uc5d0 <a href=\"https:\/\/huggingface.co\/bullerwins\/translategemma-12b-it-GGUF\" target=\"_blank\" rel=\"noopener\">TranslateGemma 12B GGUF<\/a>(Q4 \ub4f1) \ubcc0\ud658\ubcf8\ub4e4\uc774 \uc774\ubbf8 \uc62c\ub77c\uc640 \uc788\uc2b5\ub2c8\ub2e4. \u00a0<\/li>\n\n\n\n<li>OpenAI \ud638\ud658 \uc11c\ubc84 \uc2e4\ud589(\uac00\uc7a5 \uc26c\uc6b4 \uae38: llama-cpp-python)<\/li>\n<\/ol>\n\n\n\n<pre class=\"wp-block-code\"><code>pip install \"llama-cpp-python&#91;server]\"\n\npython -m llama_cpp.server --model \/path\/to\/translategemma-12b-it-Q4_K_M.gguf<\/code><\/pre>\n\n\n\n<ul class=\"wp-block-list\">\n<li>llama-cpp-python\ub294 OpenAI API \ud638\ud658 \uc6f9 \uc11c\ubc84\ub97c \uc81c\uacf5\ud569\ub2c8\ub2e4. &nbsp;<\/li>\n<\/ul>\n\n\n\n<ol start=\"3\" class=\"wp-block-list\">\n<li>(\ub3d9\uc77c\ud55c OpenAI SDK \ubc29\uc2dd\uc73c\ub85c) \ud638\ucd9c\ud574\uc11c \ubc88\uc5ed \uacb0\uacfc \ubc1b\uae30<br>\u2192 \uc774\ubbf8 \ub9ce\uc740 \uc571\ub4e4\uc774 OpenAI \ud074\ub77c\uc774\uc5b8\ud2b8\ub85c \ubd99\uae30 \ub54c\ubb38\uc5d0, \u201c\ub0b4 \ub85c\uceec \ubc88\uc5ed API\u201d\ucc98\ub7fc \uc4f0\uae30 \uc88b\uc2b5\ub2c8\ub2e4.<\/li>\n<\/ol>\n\n\n\n<p><strong>\ucf54\ub4dc \ud574\uc124<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>GGUF\ub294 \ub85c\uceec \uc2e4\ud589 \uce5c\ud654 \ud3ec\ub9f7\uc774\uace0, 12B\uae09 \ubaa8\ub378\uc744 4bit(Q4)\ub85c \uc904\uc5ec M2 \uac19\uc740 \ud658\uacbd\uc5d0\uc11c \ub3cc\ub9ac\ub824\ub294 \ubaa9\uc801\uc5d0 \uc798 \ub9de\uc2b5\ub2c8\ub2e4. &nbsp;<\/li>\n\n\n\n<li>\u201cOpenAI \ud638\ud658 API\u201d\ub97c \uc720\uc9c0\ud558\uba74, \uae30\uc874 \ucf54\ub4dc\/\uc5d0\uc774\uc804\ud2b8 \ud234\uccb4\uc778\uc5d0 \ubd99\uc774\uae30 \uc27d\uc2b5\ub2c8\ub2e4. &nbsp;<\/li>\n<\/ul>\n\n\n\n<p><strong>\uc635\uc158 2-B) MLX(Apple Silicon \ucd5c\uc801\ud654)\ub85c 12B 4bit \uc2e4\ud589 (M2\uc5d0 \ud2b9\ud788 \uc720\ub9ac)<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Hugging Face\uc5d0 mlx-community\/<a href=\"https:\/\/huggingface.co\/mlx-community\/translategemma-12b-it-4bit\" target=\"_blank\" rel=\"noopener\">translategemma-12b-it-4bit<\/a>\uac00 \uacf5\uac1c\ub418\uc5b4 \uc788\uc2b5\ub2c8\ub2e4. \u00a0<\/li>\n\n\n\n<li>MLX\ub294 Apple Silicon\uc5d0 \ucd5c\uc801\ud654\ub41c \uacbd\ub85c\ub77c, \u201c\uccb4\uac10 \uc18d\ub3c4\/\uba54\ubaa8\ub9ac \ud6a8\uc728\u201d \uba74\uc5d0\uc11c M2\uc5d0 \uc720\ub9ac\ud55c \uc120\ud0dd\uc774 \ub420 \uc218 \uc788\uc5b4\uc694.<\/li>\n<\/ul>\n\n\n\n<p>(\uc774 \uc635\uc158\uc740 \u201c\uc11c\ubc84 \ud615\ud0dc(OpenAI \ud638\ud658)\u201d\uae4c\uc9c0 \ud55c \ubc88\uc5d0 \ub9cc\ub4e4\ub824\uba74 \ubcc4\ub3c4 \ub798\ud551\uc774 \ud544\uc694\ud558\ub2c8, \ube60\ub978 \ub85c\uceec \ubc88\uc5ed \uc2e4\ud589\/\uac80\uc99d \ubaa9\uc801\uc774\uba74 \uba3c\uc800 MLX\ub85c \ud488\uc9c8\/\uc18d\ub3c4 \ud655\uc778 \u2192 \uc774\ud6c4 \uc11c\ubc84\ud654\ub97c \ucd94\ucc9c\ud569\ub2c8\ub2e4.)&nbsp;<\/p>\n\n\n\n<p><strong>\uc635\uc158 2-C) Ollama\ub85c TranslateGemma \ubc14\ub85c \uc2e4\ud589 (\ucd08\uac04\ub2e8)<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Ollama \ub77c\uc774\ube0c\ub7ec\ub9ac\uc5d0 TranslateGemma\uac00 \uc62c\ub77c\uc640 \uc788\uc2b5\ub2c8\ub2e4. &nbsp;<\/li>\n\n\n\n<li>\u201c\uc77c\ub2e8 \uc9c0\uae08 \ub2f9\uc7a5 \ub3cc\ub824\ubcf4\uae30\u201d\uc5d0 \ucd5c\uace0\ub85c \ud3b8\ud569\ub2c8\ub2e4.<\/li>\n<\/ul>\n\n\n<style>.wp-block-kadence-advancedheading.kt-adv-heading6343_ad4b11-e3, .wp-block-kadence-advancedheading.kt-adv-heading6343_ad4b11-e3[data-kb-block=\"kb-adv-heading6343_ad4b11-e3\"]{font-style:normal;}.wp-block-kadence-advancedheading.kt-adv-heading6343_ad4b11-e3 mark.kt-highlight, .wp-block-kadence-advancedheading.kt-adv-heading6343_ad4b11-e3[data-kb-block=\"kb-adv-heading6343_ad4b11-e3\"] mark.kt-highlight{font-style:normal;color:#f76a0c;-webkit-box-decoration-break:clone;box-decoration-break:clone;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;}.wp-block-kadence-advancedheading.kt-adv-heading6343_ad4b11-e3 img.kb-inline-image, .wp-block-kadence-advancedheading.kt-adv-heading6343_ad4b11-e3[data-kb-block=\"kb-adv-heading6343_ad4b11-e3\"] img.kb-inline-image{width:150px;vertical-align:baseline;}<\/style>\n<h2 class=\"kt-adv-heading6343_ad4b11-e3 wp-block-kadence-advancedheading\" data-kb-block=\"kb-adv-heading6343_ad4b11-e3\"><strong>\ubc14\ub85c \uc368\uba39\ub294 \ud301 3\uac00\uc9c0<\/strong><\/h2>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img decoding=\"async\" width=\"600\" height=\"344\" src=\"https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-79-600x344.png\" alt=\"\ubc14\ub85c \uc368\uba39\ub294 \ud301 3\uac00\uc9c0\" class=\"wp-image-6346\" srcset=\"https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-79-600x344.png 600w, https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-79-300x172.png 300w, https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-79-768x440.png 768w, https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-79-18x10.png 18w, https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-79.png 1200w\" sizes=\"(max-width: 600px) 100vw, 600px\" \/><\/figure>\n<\/div>\n\n\n<ol class=\"wp-block-list\">\n<li>M2 24GB\ub294 \u2018FP16\/ BF16 \uc815\ud488 12B\u2019\ubcf4\ub2e4 \u20184bit 12B\u2019\uac00 \ud604\uc2e4\uc801<br>\u201c12B \ub178\ud2b8\ubd81 \ub85c\uceec\u201d \uba54\uc2dc\uc9c0\ub97c M2\uc5d0\uc11c \uc9c4\uc9dc\ub85c \uccb4\uac10\ud558\ub824\uba74, \ubcf4\ud1b5\uc740 \uc591\uc790\ud654\uac00 \ud544\uc694\ud569\ub2c8\ub2e4. &nbsp;<\/li>\n\n\n\n<li>vLLM\uc740 \u2018\uc5f0\ub3d9 \ud615\ud0dc \ud655\uc778\u2019\uc5d0 \uc4f0\uace0, \uc6b4\uc601\uc740 MLX\/llama.cpp\/Ollama\ub85c \uac00\uc790<br>vLLM\uc774 MPS\ub97c \ubabb \uc4f0\ub294 \ud55c, M2\uc5d0\uc11c 12B\ub97c \u201c\ucf8c\uc801\ud558\uac8c\u201d \uc11c\ube59\ud558\ub294 \uac74 \uae30\ub300\uce58\ub97c \ub0ae\ucd94\ub294 \uac8c \uc548\uc804\ud569\ub2c8\ub2e4. &nbsp;<\/li>\n\n\n\n<li>\ubc88\uc5ed \uc11c\ubc84\ub294 \u201c\uc18d\ub3c4\u201d\ubcf4\ub2e4 \u201c\uc7ac\ud604\uc131\u201d\uc774 \ub354 \uc911\uc694\ud560 \ub54c\uac00 \ub9ce\ub2e4<br>\uc0ac\ub0b4 \ubb38\uc11c \ubc88\uc5ed\/\uc790\ub3d9\ud654 \ud30c\uc774\ud504\ub77c\uc778\uc774\uba74,<br>\n<ul class=\"wp-block-list\">\n<li>\uc785\ub825 \uae38\uc774 \uc81c\ud55c<\/li>\n\n\n\n<li>\ud0c0\uc784\uc544\uc6c3\/\uc7ac\uc2dc\ub3c4<\/li>\n\n\n\n<li>\ub3d9\uc77c \ubb38\uc7a5 \uce90\uc2dc<br>\ub97c \uba3c\uc800 \uc7a1\uc544\ub450\uba74 \uc6b4\uc601\uc774 \ud3b8\ud574\uc9d1\ub2c8\ub2e4.<\/li>\n<\/ul>\n<\/li>\n<\/ol>\n\n\n\n<p><strong>\uc628\ub77c\uc778 \ubc18\uc751\/\ud6c4\uae30 \uc694\uc57d<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>(\uae0d\uc815) \u201c\ub85c\uceec\uc5d0\uc11c\ub3c4 \ubc88\uc5ed \ubaa8\ub378\uc744 \uad74\ub9b4 \uc218 \uc788\ub294 \ud06c\uae30\u201d\ub77c\ub294 \uc778\uc2dd\uc774 \ud655\uc0b0 \uc911\uc774\uace0, \ub178\ud2b8\ubd81~\ud074\ub77c\uc6b0\ub4dc\uae4c\uc9c0 \ud65c\uc6a9 \ud3ed\uc774 \ub298\uc5b4\ub098\uace0 \uc788\uc2b5\ub2c8\ub2e4.<\/li>\n\n\n\n<li>(\ud604\uc2e4) M2 \uac19\uc740 \ud658\uacbd\uc5d0\uc11c\ub294 vLLM\ubcf4\ub2e4 \ub85c\uceec \ub7f0\ud0c0\uc784(MLX\/llama.cpp\/Ollama) \ucabd\uc774 \ub354 \uc2e4\uc6a9\uc801\uc774\ub77c\ub294 \ud750\ub984\uc774 \uac15\ud569\ub2c8\ub2e4(\ud2b9\ud788 vLLM\uc758 macOS GPU \ubbf8\uc9c0\uc6d0 \uc774\uc288). &nbsp;<\/li>\n<\/ul>\n\n\n<style>.wp-block-kadence-advancedheading.kt-adv-heading6343_e15907-13, .wp-block-kadence-advancedheading.kt-adv-heading6343_e15907-13[data-kb-block=\"kb-adv-heading6343_e15907-13\"]{font-style:normal;}.wp-block-kadence-advancedheading.kt-adv-heading6343_e15907-13 mark.kt-highlight, .wp-block-kadence-advancedheading.kt-adv-heading6343_e15907-13[data-kb-block=\"kb-adv-heading6343_e15907-13\"] mark.kt-highlight{font-style:normal;color:#f76a0c;-webkit-box-decoration-break:clone;box-decoration-break:clone;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;}.wp-block-kadence-advancedheading.kt-adv-heading6343_e15907-13 img.kb-inline-image, .wp-block-kadence-advancedheading.kt-adv-heading6343_e15907-13[data-kb-block=\"kb-adv-heading6343_e15907-13\"] img.kb-inline-image{width:150px;vertical-align:baseline;}<\/style>\n<h2 class=\"kt-adv-heading6343_e15907-13 wp-block-kadence-advancedheading\" data-kb-block=\"kb-adv-heading6343_e15907-13\">\ub9ac\uc2a4\ud06c &amp; \uc8fc\uc758\uc0ac\ud56d (TOS\/\ubcf4\uc548\/\ube44\uc6a9)<\/h2>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img decoding=\"async\" width=\"600\" height=\"344\" src=\"https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-80-600x344.png\" alt=\"\ub9ac\uc2a4\ud06c &amp; \uc8fc\uc758\uc0ac\ud56d (TOS\/\ubcf4\uc548\/\ube44\uc6a9)\" class=\"wp-image-6347\" srcset=\"https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-80-600x344.png 600w, https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-80-300x172.png 300w, https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-80-768x440.png 768w, https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-80-18x10.png 18w, https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-80.png 1200w\" sizes=\"(max-width: 600px) 100vw, 600px\" \/><\/figure>\n<\/div>\n\n\n<p><strong>1) TOS\/\ub77c\uc774\uc120\uc2a4<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\ubaa8\ub378\uc740 \ubc30\ud3ec \ucc44\ub110(HF\/Kaggle \ub4f1)\uc5d0\uc11c \ub77c\uc774\uc120\uc2a4\/\uc0ac\uc6a9\uc870\uac74 \ub3d9\uc758\uac00 \ud544\uc694\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4. \uc6b4\uc601\/\uc0c1\uc6a9\uc774\uba74 \ubc18\ub4dc\uc2dc \ud655\uc778\ud558\uc138\uc694. &nbsp;<\/li>\n<\/ul>\n\n\n\n<p><strong>2) \ubcf4\uc548 &amp; \ud504\ub77c\uc774\ubc84\uc2dc<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\ubc88\uc5ed \uc694\uccad \uc6d0\ubb38\uc774 \uace7 \ub370\uc774\ud130\uc785\ub2c8\ub2e4.<br>\n<ul class=\"wp-block-list\">\n<li>\ub85c\uadf8\uc5d0 \uc6d0\ubb38 \uc800\uc7a5 \uc5ec\ubd80<\/li>\n\n\n\n<li>\ub0b4\ubd80\ub9dd\/TLS<\/li>\n\n\n\n<li>\uc811\uadfc \uc81c\uc5b4(\ub85c\uceec\uc774\ub77c\ub3c4 \ud3ec\ud2b8 \ub178\ucd9c \uc8fc\uc758)<br>\ub97c \ucd5c\uc18c \uccb4\ud06c\ud558\uc138\uc694.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<p><strong>3) \ube44\uc6a9\/\uc131\ub2a5(\ub9e5\ubd81 \uc790\uc6d0)<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>M2 24GB\ub294 \ud1b5\ud569 \uba54\ubaa8\ub9ac\ub77c \uc5ec\ub7ec \uc571(\ube0c\ub77c\uc6b0\uc800\/IDE\/\ub3c4\ucee4) \ucf1c\uba74 \ubc14\ub85c \ube61\ube61\ud574\uc9d1\ub2c8\ub2e4.<\/li>\n\n\n\n<li>\uadf8\ub798\uc11c \uc11c\ubc84\ub294 \ub2e8\ub3c5 \uc2e4\ud589, \uac1c\ubc1c\uc740 \ubd84\ub9ac(\ub610\ub294 \uacbd\ub7c9 \ubaa8\ub378 4B\ub85c \uac1c\ubc1c)\ud558\ub294 \uc804\ub7b5\uc774 \ud3b8\ud574\uc694. &nbsp;<\/li>\n<\/ul>\n\n\n\n<p><strong>4) \u201c\uc548\uc804\ud558\uac8c \uac80\uc99d\u201d \uccb4\ud06c\ub9ac\uc2a4\ud2b8<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\ub85c\uceec \ud3ec\ud2b8(8000 \ub4f1) \uc678\ubd80 \ub178\ucd9c \uc5ec\ubd80 \uc810\uac80<\/li>\n\n\n\n<li>\uc785\ub825 \uae38\uc774 \uc81c\ud55c\/\ud0c0\uc784\uc544\uc6c3 \uc124\uc815<\/li>\n\n\n\n<li>\ubc88\uc5ed \ud488\uc9c8 \uc0d8\ud50c\ub9c1(\uc22b\uc790\/\ub2e8\uc704\/\uace0\uc720\uba85\uc0ac\/\uc804\ubb38\uc6a9\uc5b4)<\/li>\n\n\n\n<li>\uce90\uc2dc\/\uc7ac\uc2dc\ub3c4\/\uc2e4\ud328 \ucc98\ub9ac(\ud3f4\ubc31) \uc124\uacc4<\/li>\n<\/ul>\n\n\n<style>.wp-block-kadence-advancedheading.kt-adv-heading6343_9d7c56-78, .wp-block-kadence-advancedheading.kt-adv-heading6343_9d7c56-78[data-kb-block=\"kb-adv-heading6343_9d7c56-78\"]{font-style:normal;}.wp-block-kadence-advancedheading.kt-adv-heading6343_9d7c56-78 mark.kt-highlight, .wp-block-kadence-advancedheading.kt-adv-heading6343_9d7c56-78[data-kb-block=\"kb-adv-heading6343_9d7c56-78\"] mark.kt-highlight{font-style:normal;color:#f76a0c;-webkit-box-decoration-break:clone;box-decoration-break:clone;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;}.wp-block-kadence-advancedheading.kt-adv-heading6343_9d7c56-78 img.kb-inline-image, .wp-block-kadence-advancedheading.kt-adv-heading6343_9d7c56-78[data-kb-block=\"kb-adv-heading6343_9d7c56-78\"] img.kb-inline-image{width:150px;vertical-align:baseline;}<\/style>\n<h2 class=\"kt-adv-heading6343_9d7c56-78 wp-block-kadence-advancedheading\" data-kb-block=\"kb-adv-heading6343_9d7c56-78\">FAQ<\/h2>\n\n\n\n<ol class=\"wp-block-list\">\n<li>M2 24GB\uc5d0\uc11c vLLM\ub85c 12B\ub97c \u2018\ube60\ub974\uac8c\u2019 \ub3cc\ub9b4 \uc218 \uc788\ub098\uc694?<br>\ud604 \uc2dc\uc810\uc5d0\uc120 vLLM\uc774 macOS MPS GPU\ub97c \uc9c0\uc6d0\ud558\uc9c0 \uc54a\uc544 CPU \uc704\uc8fc\uac00 \ub418\uace0, 12B\ub294 \ube60\ub974\uae30 \uc5b4\ub835\uc2b5\ub2c8\ub2e4. &nbsp;<\/li>\n\n\n\n<li>\uadf8\ub7fc \u201cvLLM\ub85c \uad6c\ud604\u201d \uc694\uad6c\ub97c \ub9cc\uc871\ud558\ub824\uba74?<br>\ud2b8\ub799 1\ucc98\ub7fc vLLM OpenAI \ud638\ud658 \uc11c\ubc84\ub85c \uc5f0\ub3d9 \ud615\ud0dc\ub97c \ub9cc\ub4e4\uace0, \uc2e4\uc0ac\uc6a9\/\uc6b4\uc601\uc740 \ud2b8\ub799 2(MLX\/llama.cpp\/Ollama)\ub85c \ubd84\ub9ac\ud558\ub294 \uac8c \uac00\uc7a5 \ud604\uc2e4\uc801\uc785\ub2c8\ub2e4. &nbsp;<\/li>\n\n\n\n<li>M2 24GB\uc5d0\uc11c 12B\uac00 \ub3cc\uc544\uac00\uac8c \ud558\ub824\uba74 \ubb34\uc5c7\uc774 \ud575\uc2ec\uc778\uac00\uc694?<br>\ub300\ubd80\ubd84\uc740 \uc591\uc790\ud654(4bit\/8bit) + \ub85c\uceec \ub7f0\ud0c0\uc784 \uc120\ud0dd(GGUF\/MLX\/Ollama)\uc785\ub2c8\ub2e4. &nbsp;<\/li>\n\n\n\n<li>OpenAI SDK\ub85c \ubd99\uace0 \uc2f6\uc740\ub370 vLLM \ub9d0\uace0\ub3c4 \ubc29\ubc95\uc774 \uc788\ub098\uc694?<br>llama-cpp-python\uc740 OpenAI API \ud638\ud658 \uc11c\ubc84\ub97c \uc81c\uacf5\ud569\ub2c8\ub2e4. &nbsp;<\/li>\n\n\n\n<li>\uae30\uc0ac\uc5d0\uc11c \ub9d0\ud55c \u201812B\ub294 \uc77c\ubc18 \ub178\ud2b8\ubd81 \ub85c\uceec \uac1c\ubc1c\u2019\uc774\ub791 \ub2e4\ub978\ub370\uc694?<br>\uae30\uc0ac \uba54\uc2dc\uc9c0\ub294 \u201c\uac00\ub2a5\uc131\/\ud3ec\uc9c0\uc154\ub2dd\u201d\uc774\uace0&nbsp; , \uc2e4\uc81c \uccb4\uac10\uc740 \ud558\ub4dc\uc6e8\uc5b4(\ud2b9\ud788 GPU \uac00\uc18d \uac00\ub2a5 \uc5ec\ubd80) + \uc591\uc790\ud654 + \ub7f0\ud0c0\uc784\uc5d0 \uc88c\uc6b0\ub429\ub2c8\ub2e4. M2\uc5d0\uc11c\ub294 \uadf8 \ubcc0\uc218\uac00 \ud2b9\ud788 \ud06c\uac8c \uc791\ub3d9\ud569\ub2c8\ub2e4. &nbsp;<\/li>\n<\/ol>\n\n\n<style>.wp-block-kadence-advancedheading.kt-adv-heading6343_67a317-66, .wp-block-kadence-advancedheading.kt-adv-heading6343_67a317-66[data-kb-block=\"kb-adv-heading6343_67a317-66\"]{font-style:normal;}.wp-block-kadence-advancedheading.kt-adv-heading6343_67a317-66 mark.kt-highlight, .wp-block-kadence-advancedheading.kt-adv-heading6343_67a317-66[data-kb-block=\"kb-adv-heading6343_67a317-66\"] mark.kt-highlight{font-style:normal;color:#f76a0c;-webkit-box-decoration-break:clone;box-decoration-break:clone;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;}.wp-block-kadence-advancedheading.kt-adv-heading6343_67a317-66 img.kb-inline-image, .wp-block-kadence-advancedheading.kt-adv-heading6343_67a317-66[data-kb-block=\"kb-adv-heading6343_67a317-66\"] img.kb-inline-image{width:150px;vertical-align:baseline;}<\/style>\n<h2 class=\"kt-adv-heading6343_67a317-66 wp-block-kadence-advancedheading\" data-kb-block=\"kb-adv-heading6343_67a317-66\">\ub9c8\ubb34\ub9ac<\/h2>\n\n\n\n<p>\uc815\ub9ac\ud558\uba74, MacBook M2 24GB\uc5d0\uc11c\ub294<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u201cvLLM\ub85c \uad6c\ud604\u201d\uc740 \uac00\ub2a5\uc740 \ud55c\ub370(\uc11c\ubc84 \ud615\ud0dc \ud655\uc778), \uc18d\ub3c4\/\uc6b4\uc601\uc740 \uae30\ub300\ub97c \ub0ae\ucd94\ub294 \uac8c \uc548\uc804 &nbsp;<\/li>\n\n\n\n<li>\u201c\uc9c4\uc9dc \uc4f0\ub294 \ub85c\uceec \ubc88\uc5ed \uc11c\ubc84\u201d\ub294 12B \uc591\uc790\ud654 + MLX\/llama.cpp\/Ollama\uac00 \uc815\ub2f5\uc5d0 \uac00\uae5d\uc2b5\ub2c8\ub2e4 &nbsp;<\/li>\n<\/ul>\n\n\n\n<p>\ub2e4\uc74c \ud3b8 \uc608\uace0: \u201cM2 24GB\uc5d0\uc11c 12B \ubc88\uc5ed \uc11c\ubc84 \uc6b4\uc601 \ucd5c\uc801\ud654: Q4 vs Q8, \uc18d\ub3c4\u00b7\uba54\ubaa8\ub9ac\u00b7\ud488\uc9c8 \ud2b8\ub808\uc774\ub4dc\uc624\ud504\u201d  <\/p>\n","protected":false},"excerpt":{"rendered":"<p>MacBook M2 24GB \ubaa8\ub378\ub85c \u201cTranslateGemma 12B\ub97c vLLM\ub85c \ub3cc\ub824\uc11c \ub85c\uceec \ubc88\uc5ed&#8230;<\/p>","protected":false},"author":3,"featured_media":6345,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_kad_blocks_custom_css":"","_kad_blocks_head_custom_js":"","_kad_blocks_body_custom_js":"","_kad_blocks_footer_custom_js":"","_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"_kad_post_classname":"","footnotes":""},"categories":[7],"tags":[1471,1469,916,1467,1468,1470,1472],"class_list":["post-6343","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-coding","tag-llama-cpp","tag-mlx","tag-ollama","tag-translategemma","tag-vllm","tag-1470","tag-1472"],"taxonomy_info":{"category":[{"value":7,"label":"\uc778\uacf5\uc9c0\ub2a5(AI)"}],"post_tag":[{"value":1471,"label":"llama.cpp"},{"value":1469,"label":"MLX"},{"value":916,"label":"Ollama"},{"value":1467,"label":"TranslateGemma"},{"value":1468,"label":"vLLM"},{"value":1470,"label":"\ub85c\uceec\uc11c\ube59"},{"value":1472,"label":"\ubc88\uc5ed\ubaa8\ub378"}]},"featured_image_src_large":["https:\/\/secondlife.lol\/wp-content\/uploads\/2026\/01\/image-78-600x344.png",600,344,true],"author_info":{"display_name":"TERE","author_link":"https:\/\/secondlife.lol\/zh\/author\/tere\/"},"comment_info":0,"category_info":[{"term_id":7,"name":"\uc778\uacf5\uc9c0\ub2a5(AI)","slug":"ai-coding","term_group":0,"term_taxonomy_id":7,"taxonomy":"category","description":"","parent":20,"count":69,"filter":"raw","cat_ID":7,"category_count":69,"category_description":"","cat_name":"\uc778\uacf5\uc9c0\ub2a5(AI)","category_nicename":"ai-coding","category_parent":20}],"tag_info":[{"term_id":1471,"name":"llama.cpp","slug":"llama-cpp","term_group":0,"term_taxonomy_id":1471,"taxonomy":"post_tag","description":"","parent":0,"count":1,"filter":"raw"},{"term_id":1469,"name":"MLX","slug":"mlx","term_group":0,"term_taxonomy_id":1469,"taxonomy":"post_tag","description":"","parent":0,"count":1,"filter":"raw"},{"term_id":916,"name":"Ollama","slug":"ollama","term_group":0,"term_taxonomy_id":916,"taxonomy":"post_tag","description":"","parent":0,"count":7,"filter":"raw"},{"term_id":1467,"name":"TranslateGemma","slug":"translategemma","term_group":0,"term_taxonomy_id":1467,"taxonomy":"post_tag","description":"","parent":0,"count":1,"filter":"raw"},{"term_id":1468,"name":"vLLM","slug":"vllm","term_group":0,"term_taxonomy_id":1468,"taxonomy":"post_tag","description":"","parent":0,"count":1,"filter":"raw"},{"term_id":1470,"name":"\ub85c\uceec\uc11c\ube59","slug":"%eb%a1%9c%ec%bb%ac%ec%84%9c%eb%b9%99","term_group":0,"term_taxonomy_id":1470,"taxonomy":"post_tag","description":"","parent":0,"count":1,"filter":"raw"},{"term_id":1472,"name":"\ubc88\uc5ed\ubaa8\ub378","slug":"%eb%b2%88%ec%97%ad%eb%aa%a8%eb%8d%b8","term_group":0,"term_taxonomy_id":1472,"taxonomy":"post_tag","description":"","parent":0,"count":1,"filter":"raw"}],"_links":{"self":[{"href":"https:\/\/secondlife.lol\/zh\/wp-json\/wp\/v2\/posts\/6343","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/secondlife.lol\/zh\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/secondlife.lol\/zh\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/secondlife.lol\/zh\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/secondlife.lol\/zh\/wp-json\/wp\/v2\/comments?post=6343"}],"version-history":[{"count":7,"href":"https:\/\/secondlife.lol\/zh\/wp-json\/wp\/v2\/posts\/6343\/revisions"}],"predecessor-version":[{"id":6354,"href":"https:\/\/secondlife.lol\/zh\/wp-json\/wp\/v2\/posts\/6343\/revisions\/6354"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/secondlife.lol\/zh\/wp-json\/wp\/v2\/media\/6345"}],"wp:attachment":[{"href":"https:\/\/secondlife.lol\/zh\/wp-json\/wp\/v2\/media?parent=6343"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/secondlife.lol\/zh\/wp-json\/wp\/v2\/categories?post=6343"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/secondlife.lol\/zh\/wp-json\/wp\/v2\/tags?post=6343"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}