AIGC浪潮下的AI技术变革-Google+王顺

AlGC浪潮下的·LLM和生成式Al入门LLM和生成式Al入门什么是大语言模型?机器学习算法用来生成下一个单词百亿甚至千亿参数模型，基于PB数量级的海量数据在大规模分布式GPUs/TPUs上预训练大语言模型通常在大规模语料上预训练并在特定任Goreadthishuuuuuugepileofbooks.Acatisasmall,domesticatedcarnivorousmammal.当下LLM通常和LargeModel或者是GenerativeAl等价使用3,000+Google/DeepmindresearchersandARITHMETICLANGUAGEUNDERSTANDINGsource:https://blog.google/technology/ai/google-palm-2-ai-large-language-model/InfoQ极客传媒ViTParti-350MParti-750MParti-3BParti-20BDraftapackinglistformyweekendfishingandcampingtripidiomsfor“let'sAllowdataanalyststomarketreportswhileHelpmycustomersunderstandmyfinancialproductswhilebeingsafe,explainable,andinteractionwithCanyouguaranteegeneratecontentwhile基于生成式AI的新一代产品矩阵Examples:Summarizeananalystreport,writeablogpost基础大模型Examples:WriteSQLcodetocompleteadataanalysistask,FinishthispythonfunctionExamples:AdcampaignswithAl-generatedvisuals,imageforwebsitevirtualassistantAudioandVideoRoadmapExamples:MusicforYoutubevideo,syntheticspeakerfornewsbroadcastInfoQ极客传媒MLdevelopmentPredictionservingContinuousservingtrainingdeploymentdeployment囚②Q|#甲withpre-builttemplates.CustomizepopularopensourceOnestopshoptodiscoverandtest-drivelargefoundationAPIaccesstotask-specificsolutionsdocumentAl,andothermodalitiesGenerativeAlStudio!pipinstallgoogle-cloud-aiplatformfromgoogle.colabimportauthasgoogleauthGenerativeAlStudio!pipinstallgoogle-cloud-aiplatformfromgoogle.colabimportauthasgoogleauthfromgoogle.cloudimportaiplatformfromgoogle.cloud.aiplatform.gapic.schemaimportpredictfromtobufimportjsonformatfromtobuf.structpb2importValuedef Temperature?Wewanttocreateamulti-mediacampaignthathighlightsthesimpleingredientsgranolabar.Wewanttohighlight:·Weuseonly6simpleingredients:organicoats,organicalmonds,biodynamic,cranberries,free-rangeeggspredictlargelanguagemodelsample(apiendpoint:str,project:str,endpointid:str,content:str,temperature:float,maxdecodesteps:int,topp:float,topk:int,location:str="us-central¹",):#TheAIPlatformservicesrequireregionalAPIendpoints.clientoptions={"apiendpoint":apiendpoint}·Ourpackagingismadeoutof100%compostablematerials.·Weuserainwaterharvestinginouroatandalmondfarmingtoreducetheneec·Weusesolarenergytopowerirrigationsystemsandotherfarmequipment·Whereverwecan,wesupportlocalfarmersBlogHeadlineBlogPost:InstagramCaption:InstagramHashtags:TopK②#Initializeclientthatwillbeusedtocreateandsendrequests.#Thisclientonlyneedstobecreatedonce,andcanbereusedformultiplerequestclient=aiplatform.gapic.PredictionServiceClient(clientoptions=clientoptionsinstancedict={"content":content}instance=jsonformat.ParseDict(instancedict,Value())instances=[instance]parametersdict={RESETCREFRESHOUTPUT盲CLEAROUTPUTOutputBlogHeadline:"temperature":temperature,"maxDecodeSteps":maxdecodesteps,"topP":topp"topK":topk,parameters=jsonformat.ParseDict(parametersdict,Value())endpoint=client.endpointpath(BlogPost:AtCymbal,webelievethatthebestfoodissimpleandsustainable.That'swhywesustainablysourceoureggsfromlocalfarmerswhousesustainablefarmingpractices.Ourmostpopulargranolabarismadewithjustsixsimple,organicingredients:oats,almonds,honey,wholegrainflour,cranberries,andeggs.wheneverpossible,andweusesustPROMPTDESIGNTUNINGWewanttocreateamulti-mediacampaignthathighlightsthesimpleingredientsandsustainablesourcingpracticesfromourmostpopulargranolabar.Wewanttohighlight:·Weuseonly6simpleingredients:organicoats,organicalmonds,biodynamic,localhoney,organicwholegrainflour,driedorganiccranberries,free-rangeeggs·Ourpackagingismadeoutof100%compostablematerials.·Weuserainwaterharvestinginouroatandalmondfarmingtoreducetheneedforirrigation.·Weusesolarenergytopowerirrigationsystemsandotherfarmequipment·Whereverwecan,wesupportlocalfarmersBlogHeadline:InstagramCaption:InstagramHashtags:OutputOutputBlogBlogHeadline:6SimpleIngredients,100%Sustainable:OurNewGranolaBarisaVAtCymbal,webelievethatthebestfoodissimpleandsustainable.That'swhywesustainablefarmingpractices.Ourmostpopulargranolabarismadewithjustsixflour,cranberries,andeggs.WesourceouringredientsfromlocalfarmersCustomlanguagetasksinafewsentencesZero/few-shotpromptingwithagalleryofpre-builtpromptsMulti-purpose&versatilechatfunctionalityIn-browserassistanttoaskquestions,summarizetext,brainstormideas,&muchmoreCustomizeonyourdataTask-specifictuningonuser'scustomdataReadyforenterpriseuseentityextraction,extractivequestionanswering,entityextraction,extractivequestionanswering,chatbotsInfoQ极客传媒Generatelmagesimageswithyourproductsorlogos.EditImagesCustomizeandadapttoyourspecificationswithcapabilitieslikemask-freeedit,andupscalingCaption&ClassifylmagesCrafttheperfectdescriptionandaccuratelylabelyourcontentReadyforenterprise-useGenerativeimagesatscalewithbuilt-ncontentmoderation.ImagesgenerateduserandsafeforenterpriseuseCustomizeCodeywithyourowncodebaseTunetheCodeymodelwithyourowncodebaseandembedintoapplicationsCodeCompletionandGenerationandthenextfewlinesofcodeandgeneratecodefromnaturallanguagedescriptionsMulti-tunecodechatbotAskacodingbotforassistancewithyourcodingquestionsDataprivacy+recitationchecksYourcodewillneverbesharedwithGoogleorothers.Built-nrecitationcheckshelpidentifythesourcesusedinyourcodemodels.UseCases:Text-to-Codetunedwithyourowncodebase,improvedevelopervelocity,troubleshootanddebug,andimprovecodequalityoutputGetHuman4◆◆语VertexAIWorkbench概览言视觉语音语MyFirstProject搜索(/)资源、文档、产品等开始使用我的提示调整设计并测试您自己的提示+创建提示发起对话+创建聊天提示②:调整模型+创建经调整的模型自由格式结构化保存<>查看代码←Untitledprompt<>VIEWCODE我们期待您的反馈!CLEARCONVERSATIONabout2inch·Theyhavelotimesperseithanfemales·Theyarefoumountains.·Hummingbirabout2inch·Theyhavelotimesperseithanfemales·Theyarefoumountains.·Hummingbirflowertoflov●蜂鸟是杂食性动物，主要以花蜜和昆虫为食roleintheec·Theyareajoroleintheec·TheyareajoTemperature②0.2TokenlimitTokenlimit②Top-K②词元限制②2561—●4040StartaconversationTop-P?RESETPARAMETERSTop-P②REPORTINAPPROPRIATETop-P②ContentprocessedthroughVertexAlisModelmaydisplayinaceurateoroffensveinformationthatdoesntrepresentGoogle'sview.GooglemodelscurrentlyonlysupportModelmaydisplayinaceurateoroffensveinformationthatdoesntrepresentGoogle'sview.GooglemodelscurrentlyonlysupportEnglish.重置参数重置参数提交UsethecommandlineUsethecommandlineinterface(CLl)torequestamodelresponse(如果尚未安装),或打开CloudShell并跳至第3步。2.运行以下命令以使用您的Google帐号进行身份验证。sgcloudauthapplication-defaultlogin3.EnterthefollowingtorequestamodelresponseAPIENDPOINT=""-XPOST\-H"Authorization:Bearer$(gcloudauthprint-access-token)"\-H"Content-Type:application/json"\"instances":[{"content":"writeanoutlineofanessayabouthummingbirds.],"parameters":{"temperature":0.2,"maxOutputTokens":256,"topP":0.8,"topK":40_2.在笔记本中使用以下代码请求模型响应fromgooglecolabimportauthasgooglgoogleauth.authenticateuser()importvertexaifromvertexai.preview.languagemodelsimportTextGenerationModeldefpredictlargelanguagemodelsample(__temperature:float,maxdecodesteps:int,content:str,location:str="us-central1",__tunedmodelname:str__):"""PredictusingaLargeLanguageModel."""vertexai.init(project=projectid,location=location)__model=TextGenerationModel.frompretrained(modelname)iftunedmodel__model=model.gettunedmodel(tunedmodelname)response=model.predict(content,temperature=temperaturemaxoutputtokens=maxdecodesteps,print(f"ResponsefromModel:{response.text}")predictlargelanguagemodelsample("m","text-bison@001",0.2,256,0.8,40*'',"us-central1")InfoQ极客传媒文生图参数1024×1024结果数量*结果数量*8<修改图片导出历史记录重置四Writeyourprompt.纵横比Square图片分辨率默认为1024结果数量*—4Negativeprompt将图片分辨率提高2倍或4倍提高图片分辨率检测提取检测提取使用Google先进的大型模型生成文查看找的模型您创建或导入的模型会显示在VertexAl的模型注册表中。65识别5翻译2嵌入2Q搜索模型3分割3少代码/无代码开源9少代码/无代码开源9预训练的多任务模型，可以针对特定任务进一步调整或自定义。笔记本支持2流水线支持21一键式部署1←创建经调整的模型←创建经调整的模型模型调整功能会根据现有模型创建和部署一个更适合您车型详细信息2调整数据集调整数据集调整数据集是一个JSONL文件，其中包含模型提示和响应示例(每行一个)。建议您至少使用100-500个示例。您可以上传文件，或选择CloudStorage中已有的文件。将JSONL文件上传到CloudStorageCloudStorage中的现有JSONL文件车型详细信息开始微调开始微调新模型的名称。不超过128个字符。基本模型·一个inputtext字段，其中包含提示·一个outputtext字段，其中包含模型应生成的示例响应工作目录*数据集位置*;gs://shunaiml/浏览在流水线调整运行期间存储工件的CloudStorage位置。继续将存储JSONL文件的CloudStorage位置。