多媒体信息处理Multimedia Lecture 02-2024 MM Development 169 多媒体科技进展

JimmyLiu刘江2024-02-28CS330MIP–Lecture02多媒体科技进展MultimediaTechnology

DevelopmentLecture02ContentsReview

ofLecture01

LatestMIPTechnologiesLatestMultimediaDevelopmentCS330ModuleCoverageWhatWillCS330Cover?MMConceptsMM

AlgorithmsMM TechnologyMMApplicationsMMProjectsStudyObjectivesandAssessment*Latesubmissionwillnotbeaccepted.ExtraBonusupto10%maybegiventostudentsdoneexcellentintheprojectorhomeworkHowToStudyOURCS330Module

-How

MuchYouAreInspiredtoLearnbyYourselfActiveLearningHowmuchWEthinkandLearn,DFSvsWFSCollaborativeStudyStudyasacollaborativegroupHowToStudyOURCS330Module

-SuggestedWayofStudyingCS330Homework01(PPT)SubmittedBySunday

Night–

TemplateWillbeProvidedonBBTellmeaboutyourselfProduceoneyourownAIGCcontentwithpromptsHomework1Tellmeaboutyourselfnotsuitableforthiscourse,maybequitbeforemidtermprofoundpassionforcraftingnarratives,pursuingChatGPT-aidedfictionwritingpleasuretotakethecourseduetothekindteacherandhelpfulTAsinterestedinVR/XRtechnologyinterestedinAIGCartcontentsinIMEDlabwishcourseprojectsareallpracticalandmeaningful,ratherthansimplybasedonascoringsheetexchangestudent,hopetheprofessorcanhelpassignagroup2ProduceyourownAIGCcontentwithpromptsStudentsgeneratecontentof:

askquestions12pictures9stories4poems1self-introduction1

AIclone12AIGC:pictureby冯泽欣Apositiveoutgoingcollegeseniorstudent,HeisaChinese.Halflonghair.HisfaceisPentagon.Hedressedcasually.HestudyComputerScience.Helovesportanddoingresearch.Hedoesn'twearglasses.Shorterhair.我使用了StableDiffusion进行图像的绘制，以下是我的Prompt:2AIGC:pictureby郑博方ThisismetellingGPT4togenerateanimageillustratingpowerfulapplicationsofmultimediaGPT:Here'sanimageillustratingpowerfulapplicationsofmultimedia,showcasingadynamiccollagewithvariousscenes.Itemphasizesthetransformativeimpactofmultimediaineducation,entertainment,art,andcommunicationthroughafuturisticcityscapeanddiversesettings.Letmeknowifthere'sanythingelseyou'dliketoaddormodify!2AIGC:storyby蒋竞成2AIGC:poemby曹栗2AIGC:self-introductionby陈蕾2AIGC:codeby张煜邦请用c语言帮我写一个代码，我输入一个数字，你给我判断他是否为质数ChatGPT：以下是一个用C语言编写的程序，它接受用户输入的一个数字，然后判断该数字是否为质数：（见右侧）这个程序包含了一个isPrime函数，用于判断输入的数字是否为质数。在main函数中，我们从用户获取一个整数输入，然后调用isPrime函数来检查该数字是否为质数，并打印相应的结果。2AIGC:

AI

clone

by张伟祎ProduceoneyourownAIGCcontentwithprompts在轻颜app中，使用8张生活照片和1张证件照生成AI分身图像，提供的照片中选择了不同角度和大主体的照片，大部分是正面脸，还有一张是45度左右的侧脸。右图为最终得到的AI分身：包括轻颜相机在内的多个app都开发了类似AIGC功能。通过少样本学习个性化训练方案生成用户形象，并基于用户形象模型，快速生成场景妆造。AI真人写真是一个基于StableDiffusion和AI人脸相关技术,实现定制化人像Lora模型训练和指定图像生成链路的集合。2Lora2AIGC:

AI

clone

by张伟祎ProduceoneyourownAIGCcontentwithprompts此处为提供的几张有代表性的照片（不同角度）：2AIGC:

AI

clone

by张伟祎ProduceoneyourownAIGCcontentwithprompts此处为生成的图像（上面为较像的，下面为不太像的）一些评判：训练时间十分长，首次生成AI分身耗时2小时40分钟。在进行不同风格照片生成时，基本每组（4-5张）耗时不超过5分钟，但均无法实现更夸张的表情，但五官位置的复现还比较准确。Lecture02ContentsReview

ofLecture01

LatestMIPTechnologiesLatestMultimediaDevelopmentLatestMIPTechnologiesAIGCGenerativeAIandMIPAIforMultimediaConcept1:AIGC

ChatGPTAIGC

Gemini–Example1-1AIGC

Gemini–Example1-2AIGC

Gemini–Example1-3AIGC-2

ChatGPTAIGC

Gemini–Example2-1AIGC

Gemini–Example2-2AIGC

Gemini–Example2-3AIGC

Technologies-1GeminiAIGC

Technologies-2GeminiLatestMIPTechnologiesAIGCGenerativeAIandMIPAIforMultimediaConcept2:GenerativeAI

-WikiGenerativeAIChatGPTGenerativeAIChatGPTConceptRelationship:

GenerativeAIandMIP-GeminiGenerativeAIandMIP-GeminiGenerativeAIandMIP-GeminiGenerativeAIandMIP-GeminiGenerativeAIandMIP-GeminiLatestMIPTechnologiesAIGCGenerativeAIandMIPAIforMultimediaSome

EarlierGenerativeAITechnologiesforMultimediabeforeChatGPTandGemini,SORAGPTsforMultimediaVersionYearReleasedParametersDeveloperKeyFeaturesConcernsGPT-12018117millionOpenAICoherenttextgenerationLimitedcapabilitiesGPT-220191.5billionOpenAIImprovednaturallanguageprocessingandtextgenerationPotentialformisuseduetorealismGPT-32020175billionOpenAIRemarkableabilitiesinunderstanding,responding,creatingtextformats,andtranslatinglanguagesPotentialmisuse,ethicalconsiderationsGPT-3.5/ChatGPT2022175billionOpenAIAdvancedcapabilitieslikecodegenerationandquestionansweringOngoingdevelopmentofresponsibleuseGPT-420231760

BillionparametersOpenAIMultimodal,factualaccuracyfocus,improvedsteerabilityPotentialmisuse,ethicalconsiderationsHumanVSAI

inSomeMultimediaModalityBenchmarksLecture02ContentsReview

ofLecture01

LatestMIPTechnologiesLatestMultimediaDevelopmentLatestMultimediaDevelopmentSurveySomeLatestMultimediaSystemsMetaverseMojoStoryS1:WhatistheLatestMultimedia(System)DevelopmentinYourMind?ChatGPTonMultimediaLatestDevelopmentChatGPTonMultimediaLatestDevelopmentChatGPTonMultimediaLatestDevelopment多媒体显示标准ExamplesofMultimediaLatestDevelopment

BesidesSORA

andVision-ProExamplesofMultimediaLatestDevelopmentGeminionMultimediaLatestDevelopment2024GeminionMultimediaLatestDevelopment2024GeminionMultimediaLatestDevelopment2024GeminionMultimediaLatestDevelopment2024GeminionMultimediaLatestDevelopment2024Homework02(PPT)PleaseListTop3Technologies/Algorithms/TopicsYouLiketoLearnfromtheClassAnySuggestionstome?请用c语言帮我写一个代码，我输入一个数字，你给我判断他是否为质数ChatGPT：以下是一个用C语言编写的程序，它接受用户输入的一个数字，然后判断该数字是否为质数：#include<stdio.h>//函数声明intisPrime(intnum);intmain(){intnum;

//从用户获取输入printf("请输入一个整数：");scanf("%d",&num);

//判断输入的数字是否为质数if(isPrime(num))printf("%d是质数。\n",num);elseprintf("%d不是质数。\n",num);

return0;}//判断数字是否为质数的函数intisPrime(intnum){inti;

//质数必须大于1if(num<=1)return0;

//判断是否能被2到(num-1)之间的任何整数整除for(i=2;i*i<=num;i++){if(num%i==0)return0;//不是质数}

retur