写在前面
2023年初,ChatGPT非常火,中国也有很多企业尝试接入ChatGPT或类似的功能,当时公司也想在微信公众号也搞一个企业知识问答的聊天系统,当时已经有团队在搞,研究方向是开源模型参数微调,但效果不理想,总是回答不了知识库相关的问题,然后我们团队也安排研究一下ChatGPT,研究API来时,发现ChatGPT微调的功能比较难,然后另想方案,从上下文工程入手,通过对用户提问搜索到相关知识库问题,作上下文与问题一起传给ChatGPT,并要求ChatGPT基于我的上下文来回答,发现效果挺不错的,上线后效果也非常不错,回答准确性很高,现在回顾起来,当时能想到这个方案确实不错,因为当时互联网基本没有现成的方案可以参考,就是凭着多年工作经验与不断的API实践得到的效果,希望这个方案对你实践也有帮忙,本文最早写于2023-04-10,修改于2026-03-30,补充了相关RAG的信息,当时不知道我的实现方案就是现在大家普遍说的RAG模式。
1. 项目背景:从模型微调到 RAG 技术
公司在推进对外智能问答系统时,其实已经有另一个团队在搞,他们尝试通过模型微调(Fine-tuning)来开发出相应的业务问答功能,具体做法是把企业内部 WIKI 数据放到大模型中训练,得到自己的微调模型,然后使用这个模型来回答问题。然而,实际效果不理想,主要问题如下:
- 微调精度有限:在涉及企业流程、制度和技术文档的问答场景中,微调后的模型回答准确率较差,总是回答不了公司相关问题。
- 知识更新受限:企业知识库文档不断变化,微调的做法要不停地更新模型参数来适配不断变化的内容,使得模型更新缓慢,知识容易滞后。
- 实施成本高:微调需要大量整理问答数据和 GPU 资源,对初期探索时间的成本较高。
因此,我的团队转向基于 RAG(Retrieval-Augmented Generation) 的方案。RAG 不需要把知识库内容放进大模型训练,而是通过向量检索将相关文档动态注入模型上下文,使模型在生成回答时能参考上下文内容,最后能做出更准确的回答。
这一方案的优势在于:无需训练模型,只需构建知识向量库即可接入知识;文档更新时只需更新向量,无需重新训练;实现成本低,上线周期短。实际测试中,RAG 在企业内部问答场景下回答更准确、稳定,尤其在流程说明、制度查询和技术文档问答中,表现明显优于微调模型。
2. 理论基础:文字向量与相似度检索
RAG 技术的核心在于知识检索增强,其主要思想是将文本转换为向量,然后通过向量相似度找到最相关的知识片段,所以在简介这个方案前,先对相关的理论进行简单学习。
2.1. 文本向量化
- 每段文档或用户问题,都会被转换成一个高维向量(embedding),相当实现了文本到数字的转化,然后数字是能计算的,方便后面计算文本的相似度。
- 向量化的核心思想是:语义相似的文本在向量空间中距离更近,而不只是基于关键词匹配,见2.2小节的相似度计算。
- 向量的生成通常做法:有很多种常用算法,如PyTorch的embedding算法或Word2Vec等,这里使用 OpenAI Embedding 接口 将文本转为向量,因为这个算法是基本语义来做的,对一个文本能生成长度是1536的向量数组,常用RAG足够了。
为了更直观的了解向量,下面使用openAI 的 text-embedding-3-small 接口,对二个句子进行向量生成,如下面所示:
句子 A:「刘德华是如何进入演艺圈的?1981 年考入第 10 期无线电视艺员训练班,后以电视剧演员出道,再逐步拓展至电影与歌坛。」(1536维):
[-0.021666711196,-0.019870605320,-0.010096007027,0.023141408339,0.034787736833,0.026260960847,-0.038587920368,0.100128188729,-0.004355557263,0.023198127747,-0.041556224227,-0.028624258935,-0.018187936395,-0.022574217990,0.005898790434,0.030987557024,-0.030420364812,-0.013432982378,-0.008488964289,0.012648368254,-0.012723993510,0.034749925137,0.024691732600,-0.016476910561,0.024748450145,-0.010039287619,-0.005851524416,0.032178658992,0.015692295507,0.021420927718,-0.050253156573,-0.009897490032,-0.001534961746,0.040270589292,0.033691167831,0.005520662758,0.016004251316,-0.004858939443,-0.014756429009,-0.039816834033,-0.000553602411,0.013234465383,-0.040384028107,-0.040610902011,0.006059494801,0.024786263704,0.004962924868,0.041442785412,-0.006262738258,0.029115824029,0.000152875800,0.058004774153,-0.003424417926,0.036054465920,-0.001669669640,-0.021326396614,-0.004275205079,-0.012733446434,-0.005875157658,0.040346212685,0.013196652755,0.019454665482,0.014453927055,0.022536404431,-0.012317506596,-0.015767920762,-0.035260397941,-0.014283769764,0.049610339105,0.050669096410,-0.003145548981,-0.043068733066,0.018169030547,0.022196089849,-0.008073024452,0.016675427556,-0.006990633905,0.006759030744,-0.043106544763,-0.013678765856,-0.026790339500,-0.028170505539,0.012005550787,0.000347995549,-0.020645767450,0.026582369581,0.010701010935,-0.016297299415,-0.000245192117,-0.031630374491,0.027300812304,0.019813885912,-0.005081089679,-0.015276354738,0.002229771111,-0.012383678928,0.046585317701,-0.012931963429,0.039589960128,0.010946793482,0.006305277813,0.032273191959,0.020116388798,-0.006976454053,0.001145017566,0.002212046413,-0.042161226273,0.025750489905,-0.015181822702,0.033464290202,-0.026166429743,-0.000527310767,-0.052673172206,-0.037529163063,-0.008238455281,0.002183686942,0.069386415184,-0.065756388009,-0.009821863845,0.017743637785,-0.042917482555,0.031422402710,0.015711201355,-0.047001261264,-0.019511383027,0.027281906456,0.017100820318,0.010218897834,0.010795542970,-0.006513247732,-0.026884872466,0.009571354836,-0.036791816354,-0.040308400989,0.033010538667,-0.010559213348,-0.013206106611,0.005790078547,0.024975327775,-0.009656433016,0.054979752749,0.000335292832,-0.002242769348,-0.006707038265,0.000402055972,-0.002356207464,0.007070986088,-0.000113955248,0.022007025778,-0.014794241637,-0.032878194004,0.017998874187,-0.018651142716,-0.012015004642,-0.047190323472,0.010823902674,-0.026242054999,-0.003682017326,0.030666148290,0.000175474837,0.021080613136,-0.018745675683,-0.026922684163,0.005109448917,-0.013518061489,-0.022498592734,0.043560300022,-0.010814448819,0.000633954536,0.070445172489,0.001661398099,0.003724556882,0.025901740417,-0.011343827471,0.019813885912,0.006820476614,0.014520099387,-0.024710638449,-0.007534192409,-0.021817961708,-0.016401283443,0.018150124699,0.016533628106,0.003920710646,-0.049307838082,0.014860413969,0.000754482695,-0.043144360185,0.068441092968,-0.038115262985,0.016268938780,0.006598326378,-0.049875028431,0.013281731866,-0.022422965616,0.026090804487,0.015900265425,0.031044274569,0.029040198773,-0.017412776127,0.026336586103,0.008550410159,-0.036224622279,0.029210356995,-0.028605353087,0.038947142661,-0.040346212685,-0.028397383168,0.035770870745,-0.035978838801,0.024824077263,0.006239105482,-0.000686537940,-0.047908764333,-0.017781449482,0.019331773743,0.034541957080,-0.021156238392,-0.004038875457,0.005624648184,0.009481549263,0.005979142617,-0.007018993609,-0.003731646575,0.028794417158,-0.001375439111,-0.045110620558,-0.007208057214,0.033558823168,0.050026278943,-0.015181822702,-0.007335675415,-0.041178096086,-0.025826115161,-0.028246130794,-0.020532328635,-0.017270978540,0.001402617083,-0.017214259133,0.016637613997,-0.008148649707,-0.006016955245,-0.017639651895,0.023046877235,0.020192014053,0.021231863648,0.019530290738,-0.021383116022,-0.030004424974,0.018556611612,0.008507871069,-0.020589048043,0.021628897637,0.011419453658,0.005917696748,0.062504492700,0.058874465525,-0.047001261264,0.020834829658,-0.027489876375,0.084851831198,-0.004674602300,0.019284507260,-0.023595161736,-0.013518061489,0.047757513821,-0.035751964897,-0.008177009411,-0.038228698075,0.017233164981,-0.028075974435,0.011882659979,-0.021666711196,0.009784051217,0.027055028826,-0.040081523359,0.073205500841,-0.004516261630,0.023614067584,0.004544620868,-0.003920710646,0.000732031360,-0.044921558350,-0.054639436305,0.002632713411,0.002698885743,-0.034371796995,-0.028680978343,-0.022309528664,0.011324921623,0.021591085941,-0.020532328635,-0.010228351690,-0.004712414928,0.009160140529,0.035354930907,0.019908417016,0.011060232297,-0.009717878886,0.006815749686,0.021212957799,0.051576603204,0.041329346597,-0.001564502949,-0.025013139471,0.022763280198,0.022952344269,-0.000713124988,0.004665149376,-0.038947142661,0.044732496142,0.046925634146,0.031290058047,0.015200729482,-0.036054465920,0.025353455916,-0.009888036177,0.003372425446,-0.035279303789,-0.070180483162,-0.031214432791,0.003797818907,-0.040724340826,-0.004010515753,-0.004790403880,0.006187112536,0.021326396614,0.027281906456,-0.055509131402,-0.045829065144,-0.021817961708,-0.011116951704,-0.027792377397,0.007846147753,0.010426868685,0.032537877560,-0.054904125631,-0.041026845574,0.032273191959,0.048060018569,-0.059895411134,0.011589610949,-0.021780150011,0.003970339894,-0.030288020149,0.055849444121,0.031157713383,-0.032594598830,-0.032084126025,0.012884697877,0.039022766054,-0.015333074145,0.029550671577,0.021458741277,-0.035071335733,-0.034901175648,-0.017630198970,0.004173583351,0.041253719479,0.017337150872,-0.012317506596,-0.015049478039,0.005095269531,0.049383465201,0.010994059965,0.039400894195,-0.035903215408,-0.001416796818,-0.015654481947,-0.003556762589,0.037756040692,0.054336935282,0.006844109390,0.056946016848,0.006744850893,-0.009656433016,0.043976239860,-0.041518408805,-0.010010927916,0.034126013517,0.003859264776,0.015134557150,-0.001784289605,0.022158276290,-0.018150124699,0.009859677404,0.015002212487,-0.042085602880,0.025315642357,0.010965700261,0.005331599154,-0.025939552113,0.023009063676,-0.008791466244,-0.041783098131,-0.032254282385,0.012723993510,0.075738959014,0.004863666371,-0.030136769637,0.028416289017,-0.032613504678,0.002149418928,-0.034655392170,0.064054816961,-0.033464290202,0.015767920762,0.006929188035,-0.006673952099,-0.015616669320,-0.052295047790,-0.012430944480,0.023859851062,-0.016703786328,0.005114175845,-0.041064657271,-0.016580894589,0.000108047003,0.000185961966,0.007335675415,0.048173453659,-0.007364034653,-0.006380903069,-0.017384415492,-0.039930272847,-0.021061707288,-0.017838168889,0.025769395754,0.016410738230,0.033936951309,-0.021685617045,0.067760467529,-0.051727853715,0.048929709941,-0.076873339713,-0.059517282993,0.007496379316,0.050858162344,0.027773471549,0.018736222759,0.008777286857,0.050895974040,-0.057740084827,-0.018405361101,-0.008309354074,-0.000667040702,0.009065609425,0.017308790237,0.013990720734,0.009358657524,0.010587573051,-0.064584195614,-0.027376437560,-0.046736571938,0.022252809256,-0.052030358464,0.048816271126,-0.014964399859,-0.035562898964,-0.036564938724,-0.104741342366,-0.006031135097,-0.005180348177,-0.035052426159,-0.004556437489,0.060122288764,0.047870952636,-0.018915832043,0.029720827937,-0.008488964289,-0.035071335733,-0.028094880283,0.005411951337,0.007198604289,-0.033199600875,0.043787173927,0.015087290667,-0.021326396614,0.010360696353,-0.041820913553,0.020494515076,-0.032764755189,-0.024767357856,-0.001790197799,0.007434933912,0.023916570470,-0.025845021009,-0.060349162668,-0.023519536480,0.005544296000,-0.024181259796,0.000093941075,0.009221586399,-0.002186050173,-0.043824989349,-0.007803608198,0.001415615203,0.021061707288,-0.025731582195,0.003705650335,0.043030921370,0.020267639309,0.007581458427,-0.009665886872,0.024427043274,0.021231863648,0.007387667894,0.047606263310,0.003072286723,-0.032972726971,0.024256885052,0.055962882936,-0.008143923245,0.003098282963,-0.013234465383,0.004350830801,-0.016089329496,0.023689692840,-0.013536968268,0.013659859076,-0.003807272296,0.005426131189,0.001781926258,-0.012761806138,-0.028964573517,0.046282816678,0.033558823168,0.024370323867,0.010303976946,0.001106614014,0.036319155246,-0.028718790039,0.027111748233,0.000586393173,0.002386930399,0.030874118209,-0.003679654095,0.037321195006,-0.010984607041,0.004705325235,-0.011249296367,0.021307490766,-0.002694159048,0.026563463733,-0.006716491189,0.007950132713,-0.041858725250,-0.031535841525,0.010578119196,-0.047152511775,0.029739735648,-0.037756040692,-0.005473396741,0.020910456777,0.004161766730,0.030722867697,-0.009580807760,-0.011986644939,-0.013215559535,-0.003880534321,0.044543430209,-0.008063570596,0.025504706427,-0.035033520311,0.033672261983,-0.033653356135,-0.042690604925,-0.055055376142,-0.029134731740,-0.010067647323,-0.040724340826,-0.019397946075,-0.024521574378,0.009812410921,-0.014907680452,-0.016902303323,0.029304888099,0.039552144706,0.026657994837,0.026865964755,-0.006144573446,-0.011495078914,0.026884872466,-0.000668222376,0.016023157164,-0.044883746654,-0.044770307839,0.004355557263,-0.020589048043,-0.044883746654,0.010672651231,0.016032610089,-0.030514895916,-0.000651679293,-0.050517845899,-0.023500630632,-0.005085816141,0.006617232691,0.001810285845,-0.013934002258,0.015304714441,0.005922423210,0.017053553835,0.001848098589,0.012449851260,-0.039589960128,0.018424266949,0.006787390448,0.012326959521,-0.011391093954,0.024616105482,0.006262738258,-0.006395082921,0.031460214406,0.031762719154,0.053278177977,-0.001010900480,0.004662785679,0.038153074682,-0.034182734787,-0.007236416917,-0.000482112693,0.003875807859,0.009254672565,0.012090629898,-0.005695546977,-0.022479685023,-0.021099518985,-0.000445186161,-0.000799976173,-0.020362170413,-0.008073024452,0.024294698611,0.001112522325,0.016174407676,0.003712740261,-0.031119901687,-0.044581241906,0.007198604289,-0.011778674088,0.017573479563,0.000759800139,-0.020267639309,-0.022404059768,0.042047787458,0.025183297694,0.010445774533,-0.041367158294,-0.009533542208,-0.036943066865,-0.016439097002,0.011419453658,0.004717141856,0.034541957080,0.021099518985,-0.011192576960,-0.029607390985,0.007727982476,0.023519536480,0.010256711394,0.018093405291,0.024181259796,0.030288020149,0.010464681312,0.020040761679,-0.028151599690,0.036451499909,-0.017412776127,-0.026393305510,-0.045942503959,0.016042063013,0.040799967945,0.007638177369,0.005983869080,0.020967174321,-0.049723777920,-0.033350855112,0.008106110618,0.032065220177,0.001770109753,-0.015673389658,0.047265950590,-0.027792377397,0.012071723118,-0.001108386554,0.025769395754,0.017630198970,-0.014501193538,0.031384591013,-0.001434521517,0.006347816903,0.006224925630,0.008361346088,0.002540544840,0.028321756050,-0.017129179090,-0.020362170413,-0.002376295626,-0.014936040156,0.052635360509,-0.016798317432,0.003384242067,0.011183124036,0.012913057581,-0.032424442470,0.008734747767,-0.017894888297,0.029701922089,0.030855212361,-0.011012965813,0.004986557644,-0.025504706427,-0.006418715697,-0.028510820121,0.015550496988,0.031876157969,-0.001220643171,-0.027811285108,0.007368761580,0.031838342547,-0.039854649454,-0.007411300670,-0.029059104621,-0.056227572262,-0.003648931161,-0.001487695728,-0.018480986357,-0.002152964007,0.000463501725,0.020607953891,-0.011920472607,0.002533454914,0.060235723853,0.003074649954,-0.047039072961,0.018443172798,-0.021345302463,0.011012965813,0.005653007422,-0.037207756191,0.020040761679,0.014642991126,0.020626859739,0.018896926194,0.029059104621,-0.004568254109,-0.019000912085,0.002420016564,-0.028907854110,-0.000121709818,-0.022933438420,0.000537945598,-0.008446425200,-0.020532328635,0.009746238589,-0.013735485263,0.025050953031,-0.007538918871,0.041026845574,-0.015295261517,0.001529053436,0.022782187909,-0.003412601538,0.021231863648,-0.041518408805,-0.016495816410,-0.016004251316,0.016306752339,-0.010445774533,-0.024086726829,-0.013347904198,-0.008517323993,0.019700447097,0.038323231041,0.003138459055,-0.013177746907,0.021269677207,0.009486275725,0.005917696748,-0.010946793482,-0.036602750421,0.018641689792,-0.009698973037,0.011731408536,-0.016325658187,-0.020570140332,-0.041367158294,0.032424442470,0.017828715965,0.012695633806,-0.016268938780,0.007746889256,-0.009439010173,0.001164514804,-0.000841333880,-0.014056893066,0.037964008749,-0.023708600551,0.018443172798,0.009599714540,-0.002162417164,-0.020910456777,0.033331945539,0.009221586399,0.047076884657,0.013319544494,0.039779022336,0.007855600677,-0.025807207450,0.045148435980,-0.005468670279,-0.007680716924,-0.013867829926,0.000716669951,-0.012147349305,-0.003889987711,0.014227050357,-0.000984904240,0.004743137863,0.003592212219,-0.014936040156,0.030231300741,0.002183686942,-0.023292658851,0.013697671704,0.028170505539,-0.032518971711,0.025032047182,0.005993322469,-0.029966611415,0.009992022067,0.013726031408,-0.033407572657,0.011655783281,0.003140822286,0.021628897637,-0.022782187909,-0.041858725250,0.021477647126,-0.022385153919,-0.036943066865,-0.009311391972,-0.009391743690,-0.050933785737,0.003674927633,0.068214215338,0.000858467829,-0.030685054138,0.034258358181,-0.001478242571,-0.019360132515,-0.012544383295,0.007033173461,0.009004163556,0.059441655874,0.039892461151,-0.006125667132,0.040951218456,0.022574217990,0.013253372163,0.025788301602,-0.015663934872,-0.001172195538,-0.033539917320,0.019076537341,-0.024767357856,-0.000100513993,0.031044274569,-0.012809072621,0.004161766730,-0.056681327522,0.020418889821,-0.029720827937,-0.046963445842,0.017488401383,-0.016354018822,0.022593123838,-0.007312042173,0.047681890428,-0.003209357848,-0.013612593524,-0.005832618102,-0.009032523260,0.002018256113,-0.004629699513,-0.021212957799,0.022952344269,0.016684880480,0.029872080311,-0.019048176706,-0.007217510603,0.012298599817,-0.025221111253,-0.025050953031,-0.013262825087,-0.009675339796,-0.004435909446,0.033313039690,0.023519536480,-0.017204806209,-0.017100820318,-0.000214912361,-0.021383116022,0.037793852389,-0.027262998745,0.007661810145,-0.032632410526,-0.029683016241,-0.004341377411,0.010568666272,-0.009755691513,-0.004688782152,0.036319155246,-0.029872080311,-0.019889511168,0.009680066258,-0.009462643415,-0.027868004516,-0.002935215365,-0.075549893081,0.039136204869,-0.008233727887,0.010804995894,-0.013962361030,0.015181822702,-0.020740298554,-0.046093754470,-0.019218334928,-0.010871168226,0.033275227994,0.009245219640,-0.006754304282,-0.012761806138,-0.031195526943,0.065756388009,-0.018982004374,-0.034371796995,0.003871081164,-0.013669312932,-0.012185161933,-0.021666711196,-0.028907854110,0.003017930780,0.019662635401,0.004513897933,0.003266077023,0.023992195725,0.010010927916,-0.008224274963,0.003533129813,-0.023065783083,-0.010351242498,-0.042766232044,0.021572180092,0.016628161073,0.031044274569,-0.006475435104,0.063336372375,0.017847621813,0.032178658992,-0.022838907316,-0.014094705693,-0.020456703380,0.069991417229,-0.041329346597,-0.006891375408,-0.008451151662,0.006877195556,0.009453189559,-0.014123065397,-0.018377000466,-0.002670526039,0.056114133447,0.001110158977,0.022990157828,0.019492477179,0.036848533899,0.012478210963,0.037737134844,0.038550108671,0.014104159549,0.004797494039,-0.005657733884,0.033653356135,-0.010918434709,-0.030779585242,-0.010313429870,0.003677290864,0.050064094365,-0.001306903549,0.023557348177,-0.011258749291,-0.017469495535,0.026355493814,-0.039816834033,0.022952344269,-0.044165302068,0.051274102181,-0.034863363951,0.019757166505,0.049232210964,0.031214432791,-0.024635013193,0.013716578484,0.030685054138,0.013650406152,0.033974763006,-0.019057631493,0.018197391182,0.037623696029,0.029512858018,0.009665886872,-0.028170505539,0.054752875119,0.056832578033,-0.013934002258,-0.025410173461,0.001609405619,-0.037188850343,0.056114133447,0.016429644078,0.020286545157,-0.007028446533,0.004131043795,0.023689692840,-0.017460040748,0.007482199930,0.030458178371,-0.005846797954,0.052295047790,0.003887624247,-0.025334548205,0.010162179358,0.003088829806,0.012090629898,-0.015966437757,-0.012156802230,-0.018736222759,-0.009632800706,-0.028435194865,-0.002498005517,0.020248733461,0.028340663761,-0.008077750914,-0.030533803627,0.034220546484,-0.005024370272,0.010493041016,0.006669225637,0.007694896311,0.041178096086,0.018679503351,0.026563463733,0.008484237827,-0.021969214082,0.005312692840,0.003679654095,0.059857599437,0.040837779641,-0.033199600875,-0.005681367125,0.006371450145,-0.070067040622,-0.000443118275,-0.015314167365,-0.013858376071,-0.014605178498,-0.013177746907,-0.016004251316,0.013971814886,0.008947444148,-0.006782663520,0.005010190420,-0.012582195923,0.001465244452,0.007364034653,0.025580331683,0.018963098526,-0.017970513552,0.026279868558,-0.031082088128,0.006206019316,-0.016448549926,-0.027678940445,0.016883397475,0.012374225073,-0.017422229052,0.019851699471,0.012440397404,0.016146048903,0.013347904198,-0.057021640241,-0.057286329567,-0.003065196797,0.018868567422,0.064017005265,0.002653982956,0.063298560679,0.044127490371,-0.026544557884,-0.017923247069,-0.014813148417,0.015077837743,0.011863753200,0.023992195725,-0.051425352693,0.033766794950,-0.044732496142,0.022044839337,0.029853172600,0.037207756191,0.016977928579,0.019832791761,0.002203774871,-0.008725293912,0.006087854039,0.001526690205,-0.025050953031,-0.032424442470,-0.017894888297,-0.008739474230,-0.028586445376,0.012100082822,-0.009183773771,-0.048438142985,0.059403844178,0.014359395020,-0.017063006759,-0.033918045461,0.004575343803,0.022706562653,-0.012818525545,-0.001735841972,-0.032027408481,-0.000357153331,0.015730107203,-0.010464681312,0.009935302660,-0.003495316952,0.005289059598,-0.009316118434,-0.021364208311,0.001667306409,0.029664110392,0.023179221898,0.017166992649,-0.017270978540,0.026941591874,0.028718790039,-0.020192014053,-0.034731019288,0.008276267909,-0.026639088988,0.013640953228,0.013149387203,-0.008229001425,0.004220849369,0.004263388459,-0.014236504212,-0.019303413108,-0.007047352847,0.006291097961,-0.006688131951,0.031403496861,-0.010663198307,0.008356619626,0.015077837743,-0.021799055859,0.003795455676,-0.007278956007,-0.007231690455,-0.002568904310,0.007368761580,-0.019208882004,0.046963445842,-0.029342701659,-0.002422379795,-0.004906205460,-0.036961972713,0.021931400523,-0.020343264565,-0.001669669640,0.029512858018,0.024256885052,0.021042801440,0.009231040254,0.001692121034,-0.050026278943,-0.017828715965,0.026034085080,-0.019643727690,0.000556556566,0.020626859739,-0.017081914470,0.022706562653,0.049421276897,0.008375526406,0.001911907690,0.036300249398,0.043787173927,-0.031516935676,-0.000299104839,0.020097481087,-0.023198127747,-0.055282253772,-0.035827588290,-0.024597199634,-0.029267076403,0.000267495721,0.039779022336,0.015049478039,-0.010975153185,-0.010247257538,0.013555874117,0.012241880409,-0.020475609228,0.019085990265,0.000106274536,0.013631499372,0.002376295626,-0.043862801045,-0.011438359506,-0.004069598392,-0.031554747373,-0.003868717933,0.002162417164,-0.057966958731,-0.001238367870,-0.006938641425,-0.004175946582,0.004442999139,0.001815012423,-0.015673389658,0.019700447097,-0.001988714794,-0.003225900931,-0.014255410060,-0.022366248071,0.024143446237,-0.006149299908,0.034598674625,-0.018377000466,-0.017592385411,0.015862451866,0.016278393567,0.034296173602,-0.012563289143,-0.022933438420,0.024502668530,0.022895624861,-0.037056505680,0.017601840198,-0.003495316952,0.012790165842,0.005648280960,-0.018377000466,-0.002928125439,-0.018197391182,0.020948268473,0.001811467460,-0.003282620106,0.035392742604,0.000480635616,0.016335111111,0.025013139471,0.023708600551,0.004244482145,0.000353608368,0.043900612742,0.010464681312,0.050593473017,0.015597763471,-0.011882659979,-0.014567365870,-0.001244276064,0.023330472410,-0.024370323867,-0.004811673425,0.006933914963,-0.044392179698,0.004906205460,-0.020059669390,0.018244655803,0.015616669320,-0.036697283387,0.018575517461,-0.021420927718,0.054185684770,-0.033653356135,-0.003336976049,0.024672824889,0.026128616184,0.025826115161,0.023916570470,0.042652793229,0.010615931824,-0.007241143379,0.012856338173,-0.026090804487,0.028038160875,-0.007146611344,-0.016883397475,0.026884872466,-0.022271715105,-0.005383591633,0.000788159727,-0.002469645813,0.027641126886,0.003949069884,0.019161615521,0.028983479366,-0.033218510449,0.018537705764,-0.020740298554,-0.016996834427,-0.009160140529,-0.003299163189,0.014983305708,-0.002956485143,-0.018358094618,0.003951433580,-0.011088592000,0.024899702519,-0.013650406152,-0.022876719013,-0.000138622170,0.015266901813,-0.008522050455,-0.019511383027,0.012118989602,0.033653356135,-0.011296561919,-0.032556787133,-0.032140847296,-0.025429081172,-0.003466957482,-0.008503144607,0.015588309616,0.027584407479,0.016590347514,0.010587573051,0.028019255027,-0.000204572934,-0.029531765729,0.018840206787,-0.005653007422,0.024275790900,0.006782663520,0.015437059104,-0.022101558745,0.004438272677,-0.013026495464,-0.008134469390,0.002151782392,-0.003110099351,0.025750489905,-0.014746976085,-0.027697846293,0.010303976946,0.013669312932,0.008862365037,0.006272191647,0.031895063818,0.000948863919,-0.040232777596,-0.007439660374,-0.018688956276,-0.013017042540,0.002239224268,0.002403473482,0.009774598293,0.006045314949,-0.018443172798,0.011617970653,0.004218486138,0.032084126025,0.004606066737,0.030193489045,-0.011513984762,0.021988119930,0.015115650371,-0.029664110392,0.040459651500,-0.024578293785,0.005081089679,0.015635576099,-0.018027232960,0.026809247211,-0.021969214082,0.006007502321,0.020324358717,-0.004324834328,-0.041102468967,0.013489701785,0.003176271683,0.000068461770,-0.033842418343,0.004750228021,0.010738823563,0.010833355598,-0.019095443189,0.003979792818,0.015909718350,0.018187936395,-0.019757166505,-0.029267076403,-0.014435021207,-0.005459217355,0.021326396614,0.002729608677,0.007690169849,0.002175415400,0.004473722074,-0.017913794145,0.048778459430,-0.012809072621,-0.028019255027,-0.023651881143,-0.022668749094,-0.018074499443,0.008106110618,-0.009954208508,0.032632410526,-0.005298512988,0.008725293912,-0.009273579344,-0.008871818893,-0.017176445574,-0.005331599154,-0.005775899161,0.020929362625,0.000902188825,0.010861715302,0.018944192678,0.012969776057,-0.022025931627,0.030798492953,0.000449912768,0.055887259543,-0.006820476614,-0.016543082893,0.017696371302,0.041707474738,0.009812410921,0.043257795274,0.013896188699,-0.009041976184,0.028416289017,0.005875157658,-0.016892850399,0.026185335591,0.014671350829,-0.000056017536,-0.009590260684,-0.016675427556,0.029550671577,-0.008914357983,-0.001836282085,0.035052426159,0.020891549066,0.037604790181,0.011031872593,0.024842983112,-0.023708600551,-0.004986557644,0.017762543634,0.006111487281,-0.003067560028,0.037926197052,0.018065046519,0.021666711196,0.062164176255,-0.051311913878,-0.023443911225,-0.038606826216,0.005780625623,-0.015966437757,0.024824077263,0.001224188134,0.025013139471,0.006083127577,0.014690256678,-0.002469645813,0.002559451154,-0.020891549066,0.024105634540,0.028208319098,0.021874681115,-0.016665972769,-0.014803695492,0.023784225807,-0.017195351422,-0.030061144382,-0.004702962004,0.008451151662,-0.023425003514,-0.027565501630,0.003025020706,-0.006957547739,0.036148998886,0.013026495464,0.016354018822,0.040459651500,0.000400283519,0.010275617242,-0.016004251316,-0.014425567351,-0.008115563542,-0.017913794145,-0.043598111719,-0.006215472240,0.008413339034,0.050820346922,-0.018537705764,-0.031176619232,0.015815187246,0.005416677799,-0.013328997418,-0.011873206124,-0.000983722624,0.026487838477,-0.036546032876,-0.037226662040,0.030798492953,-0.029569577426,0.002011166187,0.032500065863,-0.017573479563,-0.046434067190,0.030420364812,-0.007335675415,-0.019180521369,-0.018102858216,0.020910456777,-0.034333985299,-0.032121937722]
句子 B:「刘德华首次获得香港电影金像奖最佳男主角是凭哪部作品?」(1536维)
[-0.020594121888,-0.010135771707,-0.043089762330,0.036875873804,0.002744043712,-0.006918470841,-0.016451528296,0.084617562592,-0.003915514797,-0.014677344821,-0.021935371682,0.023123821244,-0.008535610512,-0.023225687444,0.017606021836,0.035008311272,-0.004465172533,0.007792829536,0.001257421449,0.020152699202,-0.024414137006,0.031120384112,0.074770413339,0.001577878138,0.008162097074,0.004008892924,-0.052868999541,-0.000339026272,0.047164443880,0.080950349569,-0.022478662431,-0.022852174938,0.051782418042,0.043599098921,0.002074480057,0.023972712457,-0.022903108969,-0.023701068014,-0.001467522234,-0.038335967809,-0.039592325687,0.002165735932,0.005462620873,-0.043361406773,0.014244409278,-0.041391979903,0.015560192056,0.009906570427,-0.006566180382,0.017673933879,-0.027809705585,0.047843560576,0.047571912408,0.022156083956,0.001251054695,-0.022614484653,-0.035891156644,0.029015131295,-0.000799550267,-0.024838583544,-0.021476970986,0.012784315273,-0.003325534752,0.048862230033,-0.030950605869,-0.037385206670,-0.064413934946,0.013098404743,0.050390236080,0.035483688116,0.038403879851,0.016867486760,0.020831812173,0.017351355404,-0.004588261712,-0.000712538778,0.007720673457,0.018539803103,-0.025874231011,-0.053310424089,-0.092495284975,-0.015424369834,0.015458324924,-0.000615977333,-0.035823248327,-0.014685832895,0.009201990440,-0.013786007650,-0.011256309226,-0.037283342332,0.004231727216,0.006629847456,-0.007100982592,-0.024787649512,-0.005819155369,-0.021307190880,0.035313911736,-0.018081402406,-0.014830145054,0.040339354426,0.029864024371,0.017521133646,0.037521030754,-0.001754023251,-0.004221116193,0.038166187704,0.000935372955,0.027741793543,0.035110175610,0.053004823625,-0.034414086491,0.003648113692,-0.070084534585,-0.006795381196,-0.000460789248,0.004545817152,0.000667441403,-0.005454131868,-0.010653595440,-0.004745306913,0.001013895497,0.055211942643,-0.032274875790,-0.060509029776,-0.040780775249,0.040712866932,0.025263028219,-0.007877718657,-0.018947271630,-0.010772440583,-0.080610796809,0.015857303515,-0.006727470085,-0.039694193751,0.026892902330,0.016281750053,0.010772440583,0.015110279433,0.013913341798,-0.016010105610,0.017707889900,-0.003679947229,-0.030441271141,-0.003777569858,-0.035008311272,0.048013336957,-0.007117960136,0.009414213710,-0.011035596952,0.061799343675,0.004085293040,0.011774132960,0.005755488295,0.027911571786,-0.069744974375,0.005938000046,0.018234202638,0.007988074794,0.007682473399,0.017979534343,0.087469838560,-0.020967634395,-0.065194912255,-0.007686717901,0.040780775249,-0.011426087469,0.036026980728,-0.014583966695,-0.002516965149,0.063055701554,0.019864074886,-0.011137464084,0.028302062303,-0.037487074733,-0.003106945194,-0.016094993800,0.071442760527,-0.037724763155,-0.025534674525,-0.010619640350,0.003813647665,0.050016723573,0.043972611427,-0.006353957579,-0.003134533996,0.005326797720,0.015297035687,-0.024108536541,0.068216972053,0.028285084292,0.077554784715,0.031969275326,-0.053921625018,0.000982592581,-0.063021749258,0.048828274012,0.005016952287,0.038030367345,-0.002574265236,-0.029286777601,0.011578888632,0.012758848257,-0.008692654781,-0.008794521913,-0.012266490608,0.009753770195,-0.037419162691,-0.077554784715,-0.005738510750,-0.054498873651,0.006014400627,-0.021426036954,-0.005386220291,-0.020339455456,0.017809756100,-0.022054215893,0.033327504992,-0.015636593103,0.007143427152,0.026383565739,0.043055806309,0.041765492409,0.031188296154,-0.003688436234,0.014558499679,0.016875974834,-0.009609458968,-0.000150147796,-0.012894671410,-0.020729945973,-0.040543086827,-0.037113562226,-0.060169473290,-0.029133977368,-0.035823248327,-0.014592454769,0.049745075405,-0.020186653361,0.000041582451,0.010093326680,-0.028522774577,-0.011383643374,-0.013786007650,-0.011595865712,0.036706093699,0.004944796674,0.071918137372,0.015746949241,-0.008280942217,0.024006668478,0.034363150597,0.018556781113,0.026926856488,-0.033276569098,-0.005199464038,0.033191680908,0.006888759322,-0.005475353915,0.015492280945,0.029575400054,0.032682344317,0.004380283412,0.035110175610,-0.062138900161,-0.031731586903,0.003272478934,-0.036400493234,-0.028726508841,0.014940501191,0.033480305225,-0.039490461349,0.004066193011,0.012436268851,0.047877512872,0.030237536877,-0.012130668387,0.025976099074,0.047334223986,-0.018777493387,-0.025144184008,0.018675625324,0.007198605221,-0.023072887212,-0.027487127110,-0.028607664630,0.016561884433,-0.035415779799,0.000028666689,-0.050695836544,0.047300267965,0.029133977368,-0.039524417371,-0.025127205998,-0.011145953089,0.015738459304,0.040339354426,-0.013539829291,0.017622999847,0.016825040802,0.052902955562,0.022257950157,0.039830017835,-0.007457517087,0.046009950340,0.000416487688,0.062784060836,-0.027996461838,-0.018336068839,0.015110279433,-0.018828427419,-0.003525024513,-0.034872487187,-0.020577143878,0.018115356565,0.002797099529,-0.012105201371,-0.017911624163,0.003448624164,-0.023174753413,-0.025364896283,-0.014320809394,-0.001393244136,-0.013480406255,0.026706146076,0.002521209652,0.009499102831,0.039286725223,0.003972814884,-0.018132334575,-0.012037290260,-0.023599199951,0.008060230874,0.009168034419,-0.014142542146,0.028794420883,-0.000222303614,-0.017003308982,-0.002574265236,0.009745281190,-0.014999923296,-0.058607511222,-0.013191782869,-0.001880296040,0.029066065326,0.025857253000,0.015908237547,0.053819760680,0.003898537019,-0.027690859511,0.014371743426,-0.013293650001,-0.013870896772,-0.013497384265,-0.015882771462,-0.066960610449,-0.012003334239,-0.038947168738,0.002200752730,0.021629771218,0.025381874293,-0.019762208685,-0.007283494342,0.010984663852,-0.008501654491,0.061799343675,-0.013174805790,-0.034532930702,0.007606073283,0.067673675716,-0.005577221047,0.005029685795,0.045432705432,-0.030712915584,0.029948912561,0.033650081605,-0.012173112482,0.014473610558,0.000160626296,-0.030678959563,-0.028828375041,-0.007767362520,-0.011884489097,0.003183345310,-0.032240923494,-0.026774056256,-0.034600842744,0.013208760880,-0.015721481293,0.035551600158,-0.020254565403,0.034295242280,0.004847174045,0.020118743181,0.007296227384,-0.069541238248,0.013599251397,0.024736715481,0.073004722595,0.010483817197,0.021867459640,0.007185871713,0.007105227094,0.038539700210,-0.012071245350,0.052631311119,0.022376796231,-0.037385206670,0.029558422044,-0.025517696515,0.003056011628,-0.017894646153,-0.009660392068,0.034481998533,-0.009634925053,0.007156160194,-0.014660366811,0.024261336774,0.021918393672,0.021035546437,-0.020254565403,0.040712866932,0.004435461015,-0.040543086827,0.011842045002,-0.025195118040,0.048217073083,0.024159468710,-0.014388721436,0.033412393183,-0.013650184497,0.003516535508,0.064549751580,-0.017809756100,0.019728252664,-0.079931676388,-0.044380079955,0.011078041978,0.035076223314,-0.017232509330,0.036943785846,0.015033879317,0.014575477690,-0.010373461060,-0.042172960937,-0.040237486362,-0.000026279180,0.001094009727,0.020441321656,0.008752077818,0.005186730530,-0.025144184008,-0.024821605533,-0.036332581192,-0.038607612252,-0.003266112413,-0.022546574473,0.003890048014,-0.005284353159,-0.006455824245,-0.000193918793,-0.011663777754,0.000525251962,-0.026315655559,-0.041052423418,0.034125462174,-0.009685859084,0.041391979903,0.026485433802,-0.000695030380,0.001539678080,0.018607715145,0.027249436826,-0.058267954737,0.006723225582,-0.014830145054,0.004125615582,-0.008263964206,-0.083870537579,-0.013115382753,-0.046043906361,0.007746140473,-0.012521158904,-0.030984561890,-0.011052574962,0.003510168754,0.035959068686,0.037453118712,-0.028200196102,-0.010874307714,-0.033599149436,0.008845455945,-0.021901415661,0.034125462174,0.001534372452,-0.017945578322,-0.052257798612,0.029847046360,0.004881129600,-0.037724763155,0.034040573984,0.081154085696,0.029354689643,0.037147518247,-0.007092493586,0.016969352961,0.049473430961,0.008786032908,0.004339960869,-0.011757155880,-0.047741692513,0.025721430779,0.036570273340,-0.019694296643,0.025602586567,0.010237638839,0.009295368567,0.022122127935,0.005016952287,-0.016553396359,-0.012852226384,-0.002686743392,0.010763951577,0.048624537885,-0.059184756130,-0.013590762392,0.008658699691,0.009626436047,-0.017096687108,0.002272908576,-0.000291276112,0.018217224628,0.001794345677,0.025212096050,0.002620954299,0.022784264758,0.019524518400,-0.012538135983,-0.011782621965,0.023429421708,0.011493998580,-0.004732573405,-0.018777493387,0.027741793543,-0.005284353159,-0.011010130867,-0.011510976590,-0.006752936635,0.005657865666,-0.006850559264,-0.045874129981,0.011443065479,-0.028913265094,0.013667162508,-0.000982062076,-0.016850508749,0.030899671838,0.008998256177,0.004074682016,0.002119046869,0.015263079666,0.038234099746,0.026400543749,-0.001980040921,-0.037079606205,-0.014923523180,-0.006498268805,0.012869204395,0.019235894084,-0.004204138182,-0.032750256360,0.000886031135,0.016672240570,-0.009660392068,0.008238498122,-0.006893003825,-0.035042267293,0.026179831475,0.030322425067,0.028505796567,-0.009982971475,-0.015840327367,-0.034278262407,-0.018217224628,0.014388721436,0.017589043826,-0.002395997988,-0.002674010117,0.013140849769,-0.043768875301,-0.010424395092,0.032223943621,-0.015696015209,0.000636138546,-0.001307293889,-0.040373306721,0.015246101655,0.004974507727,0.001508905669,0.000490235165,-0.004995729774,0.002190141706,0.049371562898,-0.026468455791,0.010101815686,0.033989638090,-0.007814051583,0.070899471641,0.001561961486,0.007627295330,-0.014779211022,0.022257950157,-0.007707940415,0.005101841409,-0.001156615443,0.020746922120,0.045466661453,-0.017979534343,0.014864101075,0.033480305225,-0.034142442048,-0.022325862199,-0.023768978193,-0.000486521283,-0.006723225582,0.009100123309,0.043191630393,-0.036468405277,-0.026196809486,-0.002777999500,-0.011808088981,-0.045636437833,-0.043191630393,0.021731637418,-0.043768875301,0.026281699538,0.018420958892,-0.032427679747,-0.015780903399,0.002340819919,0.006056845188,-0.006073823199,0.000197367408,-0.023089865223,-0.033616125584,0.053717892617,-0.000860033790,0.043972611427,-0.050492100418,-0.035653468221,-0.038607612252,-0.005437153857,0.009414213710,0.000266074610,-0.006298779510,0.021935371682,0.010543240234,-0.024074580520,0.003312801477,0.014083120041,0.010322527960,0.030305447057,0.029694246128,-0.004477906041,0.027588993311,0.000576716091,-0.037622898817,-0.009176523425,-0.002215608489,-0.017521133646,-0.052801087499,0.044787548482,0.009643414058,0.036196760833,0.002930799965,-0.012164623477,-0.042886029929,-0.017020286992,-0.017240999267,-0.012572092004,0.022852174938,-0.018030468374,0.022122127935,-0.035347867757,-0.008777543902,0.011256309226,-0.004218993708,0.044957324862,-0.014821656048,0.015611126088,0.006578913890,-0.001932290616,-0.016205349937,0.005789444316,-0.011044085957,0.040067706257,0.014329298399,0.053004823625,-0.017300421372,-0.028149262071,-0.021409058943,-0.003317045979,-0.025534674525,0.003433768637,-0.006786892191,0.003438012907,0.015483791940,-0.022207017988,0.001715823193,0.052121974528,0.021188346669,0.014244409278,-0.016069527715,0.033870793879,-0.012886182405,0.037962455302,0.007703695912,0.010067860596,0.034244306386,-0.015016901307,0.022784264758,-0.019728252664,-0.003858214477,0.013616229407,-0.032563500106,0.014999923296,0.028420908377,-0.022173061967,-0.014269876294,0.002370531205,0.000222966817,-0.026672190055,0.007224071771,0.015135746449,0.004791995976,-0.000808039156,-0.007729162462,-0.021001590416,-0.014252898283,0.005407442804,0.012461735867,0.032852124423,-0.020831812173,-0.037385206670,-0.016731662676,0.012555113994,-0.040135618299,0.027622949332,0.000477501802,0.008208787069,0.004864151590,-0.014634899795,-0.003351001535,0.015984637663,-0.002404486760,-0.015449835919,-0.016324194148,-0.017860690132,-0.003263990162,0.029507489875,-0.000324701221,-0.010067860596,0.026077965274,0.006816603709,0.021035546437,-0.008480432443,-0.018709581345,-0.021476970986,-0.035755336285,0.021001590416,-0.077283136547,-0.009235946462,-0.027198502794,0.003522902261,0.031476918608,0.013072938658,-0.000710416585,0.020662033930,0.008437987417,-0.021001590416,-0.006939692888,0.028013439849,0.015500769950,0.048217073083,-0.027300368994,-0.011120486073,-0.000556554878,-0.051171217114,-0.046111818403,0.006663803011,0.041493844241,0.005178241991,0.007249538321,-0.000457075337,0.038098275661,0.020356433466,-0.001010181615,0.014329298399,-0.061222098768,-0.017894646153,0.014439654537,-0.028319040313,-0.005488087423,0.006833581254,0.013064449653,0.029864024371,-0.009830170311,0.010848840699,0.012716403231,-0.049405518919,0.033072836697,-0.009634925053,-0.003694802755,-0.007100982592,0.036536317319,-0.017079709098,-0.033310525119,-0.022563552484,-0.022037239745,0.013378539123,-0.011001641862,-0.037351250648,0.040746819228,-0.018302112818,-0.018403980881,-0.016782596707,0.013947296888,-0.026179831475,-0.009940526448,-0.005420175847,-0.025908187032,-0.022223995999,-0.011884489097,0.006689269561,-0.011052574962,-0.018794471398,0.004337838851,0.008794521913,-0.024974405766,0.009066167288,-0.017359843478,-0.021476970986,0.012351379730,-0.000840933761,-0.002780121518,0.000023875091,0.030526159331,0.030543137342,-0.004745306913,0.012631514110,0.001868623774,-0.014779211022,-0.025229074061,0.009864126332,0.017385309562,0.035721380264,-0.012071245350,0.003370101564,0.010942218825,0.009719814174,-0.016179883853,0.016935396940,-0.019609406590,0.016595840454,-0.065364688635,0.020288521424,-0.049541343004,-0.030203580856,0.007393850014,-0.020407365635,0.024957427755,-0.019439628348,-0.035313911736,-0.026434499770,-0.043089762330,0.059422448277,-0.030186602846,0.005696066190,0.010772440583,0.019796162844,0.023242665455,-0.012826759368,-0.023497333750,-0.019049137831,-0.004486394580,-0.027639927343,-0.011400620453,-0.015415880829,0.011867512017,0.000796897453,-0.031663674861,0.033412393183,-0.015042368323,0.009244434536,0.020169677213,-0.024991383776,-0.002057502279,0.026672190055,-0.008425254375,-0.005950733554,-0.024532981217,-0.011196887121,-0.006447335705,0.015246101655,0.042852073908,-0.008569565602,0.022223995999,0.028234152123,-0.035449735820,0.010033904575,-0.006218134426,-0.028760464862,-0.014049164020,0.031578786671,-0.026196809486,0.039388593286,0.027809705585,-0.008467698470,-0.026655212045,0.014320809394,-0.038879256696,-0.003459235420,0.009151056409,0.020695989951,-0.013005026616,0.006833581254,-0.027317347005,-0.025330940261,0.022631462663,-0.029184909537,0.021748615429,-0.015916727483,0.027215480804,0.024668805301,0.029948912561,-0.002642176580,-0.005454131868,-0.023344533518,-0.021256258711,0.009337812662,-0.004098026548,-0.009066167288,-0.019982919097,-0.018760515377,0.024244358763,-0.016061037779,-0.006918470841,0.019965942949,0.018913315609,-0.002909577684,0.003344634781,0.004541572649,-0.004272049293,-0.071714401245,-0.003665091703,0.021069502458,0.008616254665,-0.035755336285,0.053242512047,0.006854803767,0.003974937368,-0.006973648444,0.028234152123,-0.028811397031,0.023752000183,-0.029881002381,-0.005190975033,-0.014252898283,-0.012656981125,-0.002232586266,-0.009278390557,-0.020339455456,-0.002306864364,0.005806421861,-0.020050831139,0.001716884319,0.024193424731,0.035619512200,0.030492203310,0.026383565739,0.009142568335,-0.028590686619,0.002188019454,0.035381823778,0.022088171914,-0.006625602953,-0.029796112329,0.000485990720,0.017707889900,0.028217174113,0.009949015453,-0.017232509330,0.021663727239,0.011061063968,0.064889311790,-0.001897273818,-0.020814834163,0.002349308925,0.068556524813,0.026655212045,-0.007669739891,0.024957427755,0.030288470909,-0.008387054317,0.000496601861,-0.009473635815,0.011850534007,-0.033650081605,0.006901492830,0.037724763155,-0.024770671502,0.017877668142,0.027843661606,0.001966246404,0.029864024371,0.013930319808,-0.019558474422,-0.033446349204,-0.022037239745,-0.003870947985,0.034380130470,0.025568630546,-0.010118793696,-0.005806421861,0.018098380417,0.006073823199,0.013353073038,-0.015127257444,0.027368281037,0.012325913645,0.042071092874,0.026740100235,-0.024991383776,-0.016765618697,0.005432909355,0.023293599486,-0.021918393672,-0.016850508749,-0.007181627210,-0.002909577684,0.005814910866,0.011061063968,0.023140799254,0.017113665119,0.003092089435,0.019252872095,0.012258001603,0.004074682016,0.022971021011,0.037521030754,-0.003327657003,0.046553242952,-0.032105099410,0.007843762636,-0.024023646489,-0.041086379439,-0.006511002313,0.019218917936,0.031952299178,0.011358176358,-0.032953992486,-0.031952299178,0.002476642607,-0.011918445118,-0.014668855816,0.010237638839,0.005339531228,-0.027588993311,-0.017979534343,-0.026858946308,0.001488744514,-0.007758873980,0.024617871270,-0.022495640442,-0.001286071492,0.019541496411,0.018879359588,-0.007147671655,-0.012640003115,-0.020560165867,0.005887066480,0.008297920227,0.003981303889,-0.040848687291,-0.004537328146,0.011493998580,0.018692603335,0.008786032908,-0.029999846593,-0.044142387807,0.002901088679,0.013819963671,-0.031697630882,-0.055891055614,0.009456657805,0.009804703295,0.008191809058,0.000489704602,0.042105048895,-0.000848892087,-0.013064449653,-0.041324067861,0.009125590324,0.003389201593,0.011960890144,0.022954043001,-0.036162804812,0.043123718351,-0.025976099074,0.013624718413,-0.014685832895,0.041629668325,-0.023514311761,0.016833530739,0.007504206151,-0.004791995976,0.017342865467,0.030186602846,-0.002510598395,-0.023752000183,-0.024685781449,-0.000588918920,0.000030457320,0.008658699691,0.030016824603,0.000931659073,0.016892952845,0.019066115841,-0.038268055767,-0.035042267293,0.045975994319,0.003149389755,-0.019558474422,-0.011434576474,-0.048115205020,0.012869204395,-0.023599199951,-0.027538059279,0.031850431114,-0.025874231011,0.026383565739,-0.003130289726,-0.012045779265,0.016324194148,-0.004146838095,0.018251180649,-0.002121169120,-0.038403879851,0.024634849280,0.022886130959,-0.010466839187,0.003363735043,-0.001422955422,-0.033293548971,-0.001619261689,0.041867356747,0.011943912134,0.048522673547,-0.015636593103,-0.006782647688,-0.017622999847,0.008701143786,0.010814885609,-0.018268158659,0.017589043826,-0.005161263980,-0.011757155880,-0.008145119995,-0.012894671410,0.027419215068,-0.001031934517,-0.004376038909,-0.010772440583,-0.001832545851,-0.029371665791,0.016061037779,-0.002183774952,-0.001245749183,0.030984561890,-0.021103458479,-0.010967685841,-0.020220609382,-0.004528839141,-0.010933729820,-0.005797932856,0.021443014964,0.009617947042,-0.044515900314,-0.012937115505,-0.015246101655,0.043191630393,0.004987241235,0.003758469829,0.015483791940,0.008153609000,0.003448624164,0.031341094524,-0.005186730530,-0.018726559356,0.037215430290,-0.003482579952,-0.005492331926,0.025025339797,0.008989767171,0.005140041467,-0.029507489875,-0.041765492409,0.003153634258,-0.017096687108,-0.027385259047,-0.006752936635,-0.025381874293,0.012427780777,-0.011859023012,-0.002867133124,0.009414213710,-0.016706196591,0.023361509666,-0.006116267759,0.010729996487,0.015840327367,-0.027758771554,0.017860690132,-0.003983426373,-0.017181575298,0.000767186226,0.012470224872,-0.058030262589,0.032953992486,0.023072887212,0.013497384265,0.002637932310,-0.031069450080,-0.035381823778,0.009337812662,-0.034006617963,-0.022274928167,-0.008777543902,-0.017606021836,0.001326393918,0.008450720459,0.023650133982,-0.006311512552,-0.007296227384,0.016621306539,0.009269901551,-0.012249512598,0.009295368567,-0.005080619361,-0.003317045979,0.007877718657,-0.021324168891,0.000208243844,0.018539803103,0.015976149589,0.008862433955,-0.013701118529,-0.025959121063,-0.013556806371,-0.011833555996,0.036740049720,0.000836158695,-0.014507565647,0.004643439781,-0.001749778865,0.010390439071,-0.005314064678,0.010679062456,-0.017707889900,0.040101662278,-0.017215531319,0.024210402742,0.003873070236,-0.022767286748,0.008471943438,0.011078041978,0.023599199951,-0.004982996732,-0.025908187032,-0.004435461015,0.002266541822,0.036807961762,-0.053072735667,0.027198502794,0.008777543902,-0.042953941971,0.020594121888,-0.047673780471,0.036536317319,-0.031646698713,0.010084838606,0.047266311944,0.033225636929,0.019999897107,0.008786032908,0.024397158995,0.017037265003,0.029439577833,0.007037315518,-0.000826078118,0.030560115352,-0.020933678374,-0.009108612314,0.001861195895,0.011324220337,-0.018590737134,0.031256206334,0.000371390284,0.010823374614,-0.034940399230,-0.016434550285,0.033633105457,-0.017156109214,0.027504103258,-0.021120434627,-0.026858946308,-0.006540713832,0.009830170311,0.020458299667,0.017724867910,-0.015093301423,0.030067758635,-0.007958363742,0.030729893595,-0.024855561554,-0.035721380264,0.013047471642,-0.029371665791,-0.013276671991,0.024957427755,0.008365831338,-0.000226945995,-0.024668805301,-0.024499025196,-0.023616177961,-0.023429421708,-0.025687474757,-0.038030367345,0.003662969451,0.032852124423,-0.008624743670,0.008319142275,0.017487177625,0.012351379730,-0.031409006566,0.011281776242,-0.015984637663,-0.008094185963,-0.008645965718,-0.001353982952,0.002735554706,0.008904878050,-0.022122127935,-0.038539700210,0.018556781113,-0.012037290260,-0.002932922216,0.009787726216,0.006935448386,-0.033836837858,0.053072735667,0.019677318633,-0.041459891945,0.027877615765,-0.016858996823,-0.008845455945,0.029201887548,-0.011485510506,-0.016561884433,0.005454131868,0.008039007895,0.012996537611,-0.002665521111,-0.032801192254,0.032274875790,0.011876000091,0.016892952845,-0.025806318969,0.028251128271,-0.040237486362,0.047877512872,-0.025466762483,-0.005360753741,0.017894646153,-0.043972611427,-0.018200246617,0.028336018324,-0.003556857817,0.022223995999,-0.030050780624,-0.018947271630,0.011833555996,0.006472802255,-0.020933678374,-0.002292008605,-0.007440539077,0.047877512872,-0.015025390312,0.042071092874,-0.013259694912,0.012665470131,0.002578509739,-0.012894671410,0.019320784137,0.004533083644,-0.024091558531,-0.014575477690,0.005190975033,0.003745736321,0.041935268790,0.009312346578,-0.000249759963,-0.011111997999,-0.006175689865,-0.036774005741,0.024974405766,0.003039033618,-0.041493844241,-0.043599098921,-0.031493898481,-0.017088197172,-0.016544906422,-0.014074631035,0.056332480162,0.003616280388,-0.028369974345,-0.017826734111,0.002676132368,0.009881104343,-0.018709581345,-0.040407262743,0.032920036465,-0.021443014964,-0.017037265003,0.034685730934,-0.004647684284,-0.003590813605,0.035789292306,-0.008777543902,0.000560268760,-0.037317298353,-0.012266490608,0.015415880829,0.019015183672,-0.010050882585,0.028217174113,-0.042071092874,0.007228316274,-0.028556730598,-0.043463274837,-0.000438505813,0.047232355922,0.037215430290,0.020203631371,-0.008123897016,-0.014906545170,0.005390464794,0.001920618350,-0.025500718504,0.044210299850,-0.026808012277,0.064855359495,0.017707889900,0.018217224628,-0.004804729484,0.006591646932,-0.003949470352,-0.038913212717,0.001436749822,0.009125590324,0.013234227896,-0.015560192056,0.062987796962,-0.007924407721,-0.031137362123,0.022325862199,-0.024719737470,-0.007533917204,0.036740049720,-0.016476996243,0.005526287481,-0.009643414058,0.002514842898,0.014312320389,0.034753642976,0.009872615337,0.013582273386,0.021918393672,0.002977489028,0.000879664440,-0.024244358763,0.020322477445,0.016078015789,-0.017283443362,-0.006914226338,0.027266414836,-0.036807961762,-0.016544906422,0.020084787160,-0.008068718947,0.007440539077,0.020611099899,-0.006553446874,0.059863869101,0.005980445072,-0.010432884097,-0.005589954555,0.016757130623,0.016757130623,-0.046043906361,-0.036807961762,0.010509284213,-0.038539700210,0.029456555843,-0.000336108205,0.011697732843,0.012495691888,0.013038982637,0.005080619361,-0.029524467885,-0.022665418684,0.007355649956,0.008998256177,0.017156109214,0.068963997066,-0.033565193415,0.026417521760,0.037894543260,-0.015220635571,-0.012461735867,-0.007109471131,-0.010458351113,-0.021918393672,0.026434499770,0.016808062792,0.024634849280,-0.004452439025]
2.2. 向量相似度计算
知识问答系统在接收到用户的问题后,会把问题使用算法生成相对应的向量,如上面讲述的,然后把用户问题的向量与知识库向量数据库中对知识库向量执行相似度检索,得到与问题相关的知识库片段。然后说到相似度算法,常用方法包括余弦相似度(cosine similarity)、欧氏距离(Euclidean distance)等,用于衡量问题向量与知识库文档向量之间的语义接近度。
对于上面的二个句子A VS 句子B:使用相似计算结果如下:
点积 a·b等于0.484106 ,
余弦相似度 cos=(a·b)/(||a||*||b||):等于0.484106
因为其中||a||=1 ,||b||=1,所以点积等于余弦相似度,从||a||=1 ,||b||=1看出,Openai-embedding算法的归一化处理还行,所以我使用他的接口来求文本向量数字。
含义简述:点积或余弦相似度常见取值在 [-1, 1] 区间(具体取决于是否归一化及模型约定)。越接近 1 表示方向越一致、语义上通常越相似;越接近 -1 表示方向相反。此处 0.484106 接近0.5,说明两句语义上有一定联系,但也不是非常强,与直觉保持一致,还是挺准的。
余弦相似度公式(复习)
对两个非零向量 a = (a₁, …, aₙ)、b = (b₁, …, bₙ),它们夹角 θ 的余弦为:
cos θ = (a · b) / (||a|| · ||b||)
其中:点积:a · b = Σᵢ aᵢbᵢ
2.3. 向量数据库 Milvus
Milvus 是云原生、开源、分布式的高性能向量数据库,专为大规模高维向量的存储、检索与管理而设计,是当前 AI 应用(尤其 RAG、多模态检索)的主流基础设施之一,见下面的简单使用,然后这里的数据集也是下面例子的数据集,相当于企业的知识库。
__ __ _ _ ____ _ ___
| \/ (_) |_ ___ _ ___ / ___| | |_ _|
| |\/| | | \ \ / / | | / __| | | | | | |
| | | | | |\ V /| |_| \__ \ | |___| |___ | |
|_| |_|_|_| \_/ \__,_|___/ \____|_____|___|
Milvus cli version: 1.2.1
Pymilvus version: 2.6.11
Learn more: https://github.com/zilliztech/milvus_cli.
milvus_cli > connect -uri http://linux-main-01:19530
Connect Milvus successfully.
+---------+----------------------------+
| Address | http://linux-main-01:19530 |
| Alias | default |
+---------+----------------------------+
milvus_cli > query
Collection name (liudehua_qa): liudehua_qa
The query expression: id>=0
The names of partitions to query (split by "," if multiple, press Enter to skip) []:
Fields to return(split by "," if multiple) ['id', 'vector', 'original_text', 'category'] []: 'id', 'vector', 'original_text', 'category'
timeout []:
Guarantee timestamp. This instructs Milvus to see all operations performed before a provided timestamp. If no such timestamp is provided, then Milvus will search all operations performed to date. [0]:
Graceful time. Only used in bounded consistency level. If graceful_time is set, PyMilvus will use current timestamp minus the graceful_time as the guarantee_timestamp. This option is 5s by default if not set. [5]:
+----+-------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------+----------+
| id | vector | original_text | category |
+----+-------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------+----------+
| 1 | [-0.017655672505497932, -0.04849871248006821, 0.021437836810946465, '... (1536 dims total)'] | 问题:刘德华出生于何时何地? | 生平事业 |
| | | 答案:1961 年 9 月 27 日出生于中国香港新界大埔镇泰亨村。 | |
| 2 | [-0.01751026138663292, -0.06727197766304016, -0.01470047514885664, '... (1536 dims total)'] | 问题:刘德华在香港乐坛常被归入哪一类称谓? | 生平事业 |
| | | 答案:常与张学友、郭富城、黎明并称为香港乐坛「四大天王」,是上世纪九十年代极具代表性的偶像歌手之一。 | |
| 3 | [-0.0018939172150567174, -0.039922259747982025, -0.018039165064692497, '... (1536 dims total)'] | 问题:刘德华是如何进入演艺圈的? | 生平事业 |
| | | 答案:1981 年考入第 10 期无线电视艺员训练班,后以电视剧演员出道,再逐步拓展至电影与歌坛。 | |
| 4 | [0.04567236453294754, -0.03300224244594574, -0.01698267087340355, '... (1536 dims total)'] | 问题:刘德华除歌手、演员外还有哪些常见身份? | 生平事业 |
| | | 答案:还担任监制、制作人、填词等,并长期参与公益与慈善活动,公众形象较为正面。 | |
| 5 | [0.013363399542868137, -0.03833972290158272, -0.05541754886507988, '... (1536 dims total)'] | 问题:「华仔」通常指哪位艺人? | 生平事业 |
| | | 答案:「华仔」是影迷与歌迷对刘德华的亲切称呼,在华语圈广为人知。 | |
| 6 | [0.04419504851102829, -0.04446737840771675, -0.012984241358935833, '... (1536 dims total)'] | 问题:刘德华有哪些传唱度较高的歌曲? | 影乐代表 |
| | | 答案:如《忘情水》《中国人》《冰雨》《谢谢你的爱》《一起走过的日子》等在华语地区影响较大。 | |
| 7 | [-0.010981481522321701, -0.03219740465283394, -0.06267661601305008, '... (1536 dims total)'] | 问题:刘德华参演过哪部常被提及的警匪卧底题材电影? | 影乐代表 |
| | | 答案:《无间道》系列中其饰演的刘建明等角色深入人心,被视为香港电影经典之一。 | |
| 8 | [-0.005043107084929943, -0.04024449735879898, -0.0812249705195427, '... (1536 dims total)'] | 问题:刘德华首次获得香港电影金像奖最佳男主角是凭哪部作品? | 影乐代表 |
| | | 答案:2012 年凭电影《桃姐》首次夺得香港电影金像奖最佳男主角奖。 | |
| 9 | [0.005205986090004444, -0.04413096234202385, -0.07670435309410095, '... (1536 dims total)'] | 问题:刘德华早期有哪些令人印象深刻的银幕形象? | 影乐代表 |
| | | 答案:《天若有情》中骑摩托的「华弟」等角色成为一代观众的青春记忆。 | |
| 10 | [-0.010689610615372658, -0.05312051624059677, -0.022332055494189262, '... (1536 dims total)'] | 问题:刘德华是否参与过电影出品或扶持新人? | 影乐代表 |
| | | 答案:他曾通过映艺娱乐等公司参与出品与项目扶持,对香港电影产业有一定推动作用。 | |
+----+-------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------+----------+
milvus_cli >
3. 系统技术实现:基于 RAG 的企业知识问答链路设计
在确定 RAG 技术路线后,系统设计围绕「知识检索增强」展开,核心目标是高效组织企业知识库内容并与大模型能力结合,整个系统的设计如下图所示。
整体流程可概括为:
- 用户提交问题 → RAG 服务向量化问题(就是把用户的问题字符串,变成向量数组) ,如这里问题是: 刘德华是谁?那么生成的向量是:
[-0.043649021536,-0.042959827930,-0.031224366277,0.012778825127,-0.008945178241,0.022149963304,-0.041658014059,0.095338650048,-0.004273966886,-0.041160263121,-0.007830021903,-0.014166788198,-0.036240175366,-0.024925889447,0.034230023623,0.057011749595,-0.036201886833,0.007241334300,-0.010471936315,0.017832921818,-0.064746052027,0.036699637771,0.053948659450,0.010845250450,0.027491226792,-0.000374809664,-0.000499546761,-0.037005946040,0.017823349684,0.051115300506,0.029061058536,-0.008839883842,0.029482234269,0.052263960242,0.037484556437,0.010931399651,-0.019661204889,-0.003826468484,0.008394778706,0.002814213280,-0.017622334883,-0.021365048364,-0.027720957994,-0.046176072210,0.052417114377,-0.064669474959,0.021403336897,0.072978101671,-0.041275128722,0.019010297954,-0.002756780246,0.048588253558,-0.006221900228,0.073858737946,0.007250906434,-0.007418419234,-0.010299637914,0.025040755048,0.027261493728,0.053182888776,-0.002238687593,0.011285569519,-0.039111819118,0.024811021984,-0.057968962938,-0.029252503067,-0.039092674851,0.004537201021,-0.003974836785,0.025749094784,-0.010471936315,0.037982307374,0.016645975411,-0.000760986237,0.034000292420,-0.019431471825,0.007614648435,0.035455256701,-0.044070195407,0.000281630724,-0.057241480798,-0.018407251686,0.006442059763,0.004910515156,-0.031090356410,-0.005011022557,0.026208557189,0.031951848418,0.030382016674,-0.013391443528,0.079716898501,-0.011390862986,-0.019814359024,-0.052685134113,-0.012147063389,-0.026782887056,0.038403481245,0.035972155631,0.027318926528,-0.008988252841,0.036508195102,-0.003938941285,0.039935026318,0.017239449546,-0.019192168489,-0.002260224894,-0.012443800457,0.005140246823,-0.027586948127,0.055250473320,-0.025174764916,0.025136476383,-0.054408121854,-0.041236840189,-0.014616679400,-0.034670341760,0.015047426336,-0.022207396105,-0.017057579011,0.001149256714,-0.019192168489,0.014406091534,0.019220884889,-0.034593764693,-0.037235677242,0.023815518245,-0.027280637994,-0.021097026765,-0.000046252946,-0.019718637690,-0.056399129331,0.004506091587,-0.052570268512,-0.061568092555,0.055020742118,0.020178100094,0.017210733145,0.019192168489,0.015449455939,-0.027089195326,0.026380855590,0.022820014507,-0.019756926224,0.016330095008,0.008088470437,0.024140972644,-0.009222770110,0.014587962069,0.006513850763,-0.000372416602,-0.037082523108,-0.021365048364,0.027912400663,-0.029865119606,-0.076041191816,0.000186507430,0.032009281218,-0.023088036105,0.016540681943,0.001578208874,0.023758085445,0.014635823667,-0.004872226156,0.004250036553,0.013468020596,0.011065409519,0.057739231735,-0.042423784733,0.028716461733,0.056705441326,0.002393038478,-0.011074981652,0.033732268959,0.020867295563,0.050272952765,-0.020120667294,0.044644527137,-0.028544163331,0.011065409519,-0.017115011811,-0.040547642857,0.011745032854,0.014444380067,-0.003594343783,-0.020867295563,0.015133575536,-0.025423640385,-0.016004640609,0.030937202275,0.011658883654,0.052034229040,0.008035822771,-0.018416823819,-0.012424656190,0.001919216826,0.020388687029,0.019756926224,0.027165772393,0.037369687110,-0.032258160412,0.013324438594,0.004537201021,-0.032085858285,-0.011974764057,0.016693836078,0.040164757520,-0.008997824974,-0.035397823900,-0.006461204030,-0.045601740479,0.016636403278,-0.003838433651,-0.027012618259,-0.015401595272,-0.034287456423,0.023719796911,0.024562146515,-0.034134302288,0.036106165498,0.061032053083,-0.023413488641,0.032736767083,0.028142131865,-0.026897752658,-0.014291225933,-0.009639158845,-0.031071212143,0.020541843027,-0.042194053531,0.080942131579,0.001158230589,-0.032239016145,-0.074318200350,-0.047516170889,-0.018388107419,-0.041926033795,-0.001969470643,-0.019431471825,0.007217403967,-0.015956779942,-0.034708630294,-0.019680349156,-0.032334737480,0.009897607379,0.031415808946,0.020331254229,0.034230023623,-0.015056998469,0.000381390506,0.004829151556,0.029233358800,0.022973168641,0.044299926609,0.008768092841,-0.031186077744,0.043227847666,0.018895432353,-0.039207544178,0.027874112129,-0.030401160941,0.060074836016,-0.038862943649,0.002512690378,-0.011285569519,-0.056552283466,0.040164757520,-0.018809283152,-0.043993618339,-0.019220884889,0.044108483940,-0.002376287244,-0.003742712084,-0.000720304553,0.031817838550,0.009404641576,-0.011362146586,0.022666860372,0.011065409519,-0.043189559132,0.013554169796,-0.008471355774,-0.014176360331,0.000453181652,-0.007346628234,-0.032353881747,0.028773894534,0.010156054981,0.018895432353,-0.040471065789,0.007815663703,0.001377193606,-0.071752868593,-0.002377483761,-0.022513706237,-0.001179169747,0.088140390813,-0.023490065709,-0.007753444836,-0.020541843027,0.002352356911,0.008322987705,0.019029442221,0.037082523108,-0.002275779610,-0.024408992380,0.045142278075,0.014051921666,-0.031511530280,0.004403190687,0.002011348726,-0.000700562028,0.033502537757,0.008634082973,0.025040755048,-0.000249175122,-0.016243945807,-0.028410153463,0.002171682427,-0.028946192935,-0.023777229711,0.030611747876,0.009442930110,-0.057164903730,0.038097172976,-0.030018273741,-0.024121828377,0.046329226345,0.008753734641,-0.058773025870,-0.022035097703,0.020024945959,0.019086875021,-0.016741696745,-0.019058158621,0.020101523027,-0.033502537757,-0.048281945288,-0.026955185458,-0.007341842167,0.019383611158,-0.035838145763,0.014348658733,-0.010376214981,-0.050234664232,-0.036412473768,0.010242205113,0.005106743891,-0.036144454032,-0.011754604988,0.004168672953,0.011544018053,0.012501233257,0.004348150920,0.030707469210,-0.052263960242,0.026342567056,-0.004900943022,0.001001486555,0.054905876517,0.015095287003,0.012319361791,0.017564902082,0.015497317538,-0.005556635559,-0.004857867956,0.044797681272,-0.009232342243,0.012051342055,0.085383616388,-0.000929097179,0.012893691659,0.023681508377,-0.011678027920,0.019450616091,0.011141987517,-0.013113850728,0.011036693119,-0.013984916732,-0.023030601442,-0.021613923833,-0.026955185458,-0.021920232102,-0.015449455939,-0.010672952048,0.031473241746,-0.013515881263,0.041504859924,-0.026840319857,0.020541843027,-0.012807541527,0.043917041272,0.013075562194,0.053182888776,0.011333430186,-0.022111674771,-0.037101667374,0.026591444388,0.051613055170,0.020407831296,-0.023872951046,0.020120667294,-0.013027701527,-0.014453952201,-0.051421612501,0.030477738008,0.010893111117,-0.000966787571,0.014654967934,0.008911674842,-0.040777374059,0.003802538151,0.014109354466,0.005724147893,-0.018177520484,0.016540681943,-0.020675852895,0.005752864294,0.002249456244,0.027625236660,-0.012118346989,0.041887745261,0.001760079758,-0.028103843331,-0.017143728212,0.020407831296,-0.016521537676,-0.004410369787,0.000300625456,0.054867584258,0.005815083627,0.016397099942,0.026687165722,0.009624800645,0.046865265816,-0.068919509649,-0.008031036705,0.012376794592,0.026285134256,-0.001834264025,-0.013927483931,-0.006628716365,0.013056417927,-0.016215229407,0.011074981652,-0.032449603081,-0.022609427571,0.073629006743,0.029233358800,0.039513852447,-0.005221609958,0.017335170880,-0.037886586040,-0.026514865458,-0.018368963152,0.021135315299,0.005724147893,-0.019268745556,-0.001813923125,-0.019718637690,-0.018426395953,-0.053450908512,-0.010663378984,-0.044070195407,-0.046137779951,0.005288614891,-0.021633068100,0.050732415169,0.008045394905,-0.032564468682,0.015439883806,-0.001914430759,-0.000100657184,0.005633212626,0.008930820040,-0.038786366582,0.007092966232,-0.025576794520,-0.067541114986,0.050081510097,-0.031951848418,0.010223059915,-0.046980131418,-0.026591444388,0.007064249367,0.015956779942,0.042691808194,-0.002862073947,-0.048549965024,-0.008160261437,-0.008571864106,0.001389158890,-0.039667006582,-0.002919506980,-0.002495939145,-0.063788831234,0.039207544178,0.004419941921,-0.012702248059,0.024849312380,-0.025423640385,0.071867734194,-0.019527193159,0.010519796982,-0.007724727970,0.015717476606,0.003907831851,0.018397679552,0.011065409519,-0.027854967862,-0.008720232174,0.025825671852,0.038575779647,-0.029175924137,-0.013697751798,0.004348150920,0.009356779978,0.033598259091,0.028888760135,-0.004752574489,-0.027338070795,0.032009281218,0.011419579387,0.012510805391,-0.007404061034,0.009476432577,0.034651197493,-0.008222480305,0.026093691587,0.009045685641,0.010682524182,0.016674691811,-0.009974184446,0.021786222234,0.011668455787,0.003156417748,0.012807541527,-0.004386439454,-0.027644380927,0.039092674851,0.027778390795,-0.025710806251,0.005537490826,0.020829007030,0.026840319857,0.003709209617,-0.009888035245,-0.022839158773,0.009241914377,0.026974329725,-0.031645540148,0.018368963152,-0.005116316024,0.013362727128,0.006030457094,0.021747933701,0.010548513383,-0.002226722194,0.004513270687,0.003244960215,-0.000466044236,0.057088326663,-0.005958665628,-0.006183611229,-0.027606092393,0.000611421303,-0.030267151073,-0.006695721764,0.005776795093,-0.004829151556,0.015612183139,0.002144162543,0.008045394905,-0.012501233257,0.009390283376,0.013008557260,0.007408847101,0.044874258339,-0.005714575760,0.022360552102,0.044376503676,-0.022954024374,-0.026572298259,-0.019910080358,0.026265989989,0.000486684206,-0.031415808946,-0.014855982736,0.021556491032,-0.051383320242,-0.024026107043,0.011228136718,0.028907904401,0.007054677233,-0.000385578314,-0.023279478773,-0.029635388404,0.014157215133,0.005580565892,0.007394488901,-0.002219543094,0.016588542610,-0.000636548211,0.023202901706,0.013793474063,0.022973168641,-0.024906745180,0.057203192264,0.010797389783,0.009926323779,-0.005101957824,0.005992168561,-0.001487273374,0.007274836767,-0.007332270034,0.038116317242,0.042615227401,-0.017296882346,-0.016770413145,0.039016097784,-0.034344889224,0.005475271959,-0.025749094784,0.002988904947,-0.018158376217,-0.007069035433,0.011792893521,-0.048549965024,-0.000574329228,-0.015095287003,-0.000343700143,-0.036469906569,0.005537490826,0.028505874798,0.008361276239,0.028256997466,0.022609427571,-0.008255982772,-0.013420159929,0.009629586712,-0.040509354323,0.009098332375,0.011343002319,-0.016961855814,-0.007270050701,0.032813344151,0.013544597663,-0.006930239499,-0.044031906873,-0.036910224706,-0.009730094112,-0.023470921442,-0.006757940631,0.014865554869,0.031147789210,-0.003328716615,0.004089702852,0.021518202499,0.014118926600,0.010912255384,0.028620740399,-0.013334010728,0.007767803036,-0.005891660694,0.049622043967,-0.007528499234,-0.035972155631,-0.004929659422,-0.016904423013,-0.018962437287,-0.019115591422,0.013008557260,0.019115591422,0.034076869488,0.035742424428,0.016578970477,-0.037120811641,-0.027835823596,-0.032296448946,0.002720884746,-0.037216532975,-0.022169107571,0.028391009197,-0.026399999857,0.004223712720,0.026457432657,0.029482234269,0.035091515630,-0.013515881263,0.028505874798,0.033445104957,-0.030573459342,0.032487891614,0.010280493647,-0.018598694354,0.052340537310,0.012041769922,-0.013525453396,0.012022625655,0.015085714869,0.016416244209,-0.034900072962,-0.030937202275,-0.011103698052,0.004135170486,-0.019106019288,0.005982595962,-0.015037854202,0.031817838550,0.036546483636,0.031166933477,0.026629732922,-0.005681073293,-0.035014938563,-0.048588253558,0.015420739539,0.034804351628,-0.005451341625,0.020752429962,0.000983538805,0.025844816118,-0.035570122302,0.010797389783,-0.043342713267,-0.055824801326,0.022226542234,0.009935895912,-0.030822334811,-0.006777084898,0.023030601442,0.009514721110,-0.025940537453,-0.016473677009,0.065779842436,0.009284988977,-0.016607686877,-0.002718491713,0.012549093924,-0.006719652098,-0.025825671852,-0.014434807934,-0.026572298259,0.023126324639,-0.006164466962,-0.013334010728,0.022035097703,-0.009596084245,-0.016531109810,-0.012443800457,0.006312835496,0.015832342207,-0.028046410531,0.001279079006,-0.030764902011,-0.014616679400,-0.034153446555,-0.018876288086,0.005111529958,0.032526180148,0.042959827930,0.008825525641,0.044031906873,0.045831471682,-0.008251196705,0.008007106371,-0.040432777256,-0.027969833463,-0.028486730531,0.049200870097,0.007332270034,-0.051459901035,0.004977520090,-0.028678173199,0.007231762167,0.042462073267,0.006308049429,-0.025557650253,0.016081217676,0.016866134480,-0.018206236884,-0.045640029013,0.002711312613,0.012185351923,0.009821030311,-0.015937635675,-0.026227701455,0.002550978912,-0.031626395881,-0.004711892921,-0.000957215379,0.024638723582,0.005781581160,0.042308919132,-0.022686004639,-0.006217114162,-0.014262509532,-0.007351414301,0.042883250862,-0.034995794296,0.004436693154,0.003498622216,0.012884119526,0.020273821428,0.024696156383,0.020369542763,0.047018419951,0.012874547392,-0.007944887504,-0.021556491032,-0.021135315299,0.026859464124,0.024313271046,0.009653517045,-0.005269470625,-0.024581290781,0.006901523098,0.021020449698,0.010797389783,0.001174383680,-0.013142567128,-0.004939231556,-0.030726613477,0.040853951126,0.011218564585,-0.023183757439,0.018282813951,0.023241190240,-0.013113850728,0.003608701983,-0.005451341625,-0.063291080296,-0.001742132008,-0.012252356857,-0.019536765292,0.005752864294,-0.032392170280,0.013592458330,-0.001063107396,-0.051995940506,-0.010127338581,-0.018617838621,-0.023413488641,-0.021001305431,-0.002653879579,-0.016760841012,0.021671356633,0.000164670957,0.012118346989,-0.027165772393,0.031779550016,0.001776831108,-0.044070195407,-0.004793256056,-0.021173603833,0.022973168641,0.026936041191,-0.009256272577,-0.005872516427,0.008524003439,0.008495287038,-0.012577810325,-0.006059173495,-0.010232632048,0.016406672075,-0.059002757072,0.022456273437,-0.003426830983,-0.010050761513,0.032621901482,0.001162418397,-0.026304278523,0.001443002257,0.015248441137,-0.045678317547,-0.032851632684,0.012692675926,0.016023784876,-0.007605076302,-0.008543147705,0.034344889224,-0.014501812868,0.038078028709,0.011965191923,-0.012721392326,0.020254677162,-0.007557215635,-0.029884263873,0.034823495895,0.001672733924,0.049009427428,0.000428054744,0.014540101402,0.037293110043,-0.024026107043,-0.027031762525,0.002110659843,0.013401015662,0.024945033714,0.009572153911,-0.002305692527,0.014530529268,0.003460333683,-0.021996809170,-0.011725888588,-0.002981725847,-0.026361711323,0.030018273741,0.015947207808,-0.038728933781,0.012051342055,0.016655547544,-0.021211892366,-0.008409136906,0.029941696674,-0.016693836078,0.021211892366,0.013803046197,-0.014406091534,-0.011496156454,0.047784190625,-0.065052360296,0.021173603833,-0.017249021679,-0.010366642848,0.006351124030,0.044299926609,0.000962001446,-0.027606092393,-0.008217694238,-0.019029442221,0.032928209752,0.014080638066,0.012807541527,-0.048473387957,-0.032947354019,0.022686004639,0.017172444612,-0.005125888623,0.001707432908,0.015621755272,-0.011132415384,-0.016023784876,-0.037427119911,0.010031617247,0.012491661124,-0.020790718496,-0.018445540220,0.009007397108,-0.010979260318,-0.006308049429,0.002639521379,0.020924728364,0.025404496118,-0.011467440054,0.026151124388,0.015200580470,0.007600290235,-0.003362219082,0.062831617892,-0.015669615939,-0.003692458384,0.000716116745,-0.017555329949,-0.003599129850,0.044070195407,-0.018043510616,-0.019680349156,-0.015238869004,0.003503408283,-0.002120231977,-0.029424801469,-0.027127483860,-0.000042551215,0.011563162319,-0.007198259700,-0.007451921701,0.018100943416,0.049622043967,0.035397823900,0.011658883654,0.035091515630,0.003390935482,0.001654786058,0.046980131418,0.014989992604,-0.007126468699,-0.022800870240,0.005580565892,0.027625236660,0.037446264178,0.006269760896,0.012635243125,-0.013199999928,0.002555764979,0.031856127083,-0.009658303112,-0.016913995147,-0.029175924137,0.048396810889,0.006375054363,0.028773894534,0.036221031100,0.022839158773,0.009955040179,-0.021460769698,-0.010653806850,0.017861640081,0.003941334318,-0.046980131418,-0.014741117135,-0.004486947320,0.047477882355,0.002324836794,-0.004446265288,0.048511676490,0.042347207665,0.001213270472,-0.023394344375,-0.001371211023,-0.021077882499,0.062410444021,-0.014061493799,-0.011745032854,-0.009868890978,-0.010663378984,0.011132415384,-0.004259608686,-0.018455112353,0.036469906569,-0.038786366582,0.086379118264,0.015535606071,-0.024849312380,0.003934155218,0.013334010728,0.019948368892,-0.017430892214,0.001220449572,-0.014425235800,-0.007834807970,-0.002716098679,0.026438288391,0.046673823148,0.009888035245,0.011122843251,-0.008433067240,0.029711965472,0.005800725427,0.058964468539,0.038288615644,0.001188143622,0.043266136199,-0.019622916356,-0.003450761549,-0.004515663721,-0.006461204030,-0.009481218643,0.000404423510,0.043802175671,0.018072227016,-0.019000725821,-0.006403770763,0.008385206573,-0.015420739539,-0.034268312156,-0.022073386237,-0.020503554493,-0.007786947303,-0.012663959526,-0.008528789505,0.011773749255,0.002224329161,-0.012242784724,0.004821972456,-0.025098187849,0.025672515854,0.015535606071,0.014721972868,-0.013582886197,-0.002610804979,0.000243641232,-0.003991588019,0.008021464571,-0.044797681272,-0.000101180660,0.018378535286,0.010242205113,-0.008576650172,-0.005762436427,-0.048511676490,-0.003335895715,0.013736041263,-0.043534155935,-0.033559970558,-0.009366353042,-0.020541843027,0.020790718496,0.009457288310,0.048703119159,0.028716461733,-0.016119508073,-0.025825671852,-0.004620957188,0.005145032890,-0.004608992022,0.058351848274,-0.024313271046,0.057777520269,-0.001308992039,-0.021250180900,-0.016282234341,0.055939666927,0.026534009725,0.025136476383,-0.028161276132,0.018005222082,-0.011228136718,0.008543147705,-0.030994635075,0.001056526438,0.021039593965,0.014051921666,0.000875852071,-0.000006964116,0.015937635675,-0.024236693978,0.021479913965,-0.006901523098,-0.052072517574,0.001121138572,0.003067875281,0.023930383846,-0.020369542763,-0.004845902789,-0.059730239213,-0.004525235854,0.000170055297,-0.012357650325,0.022781725973,-0.015258013271,0.046444091946,-0.004652066622,-0.016090789810,-0.033215373755,-0.008054967038,0.027797535062,0.010203915648,-0.033559970558,0.027759246528,0.016626831144,-0.018694415689,-0.040853951126,-0.018857143819,-0.025768239051,0.014109354466,0.000380193989,0.002452864544,0.015009136871,-0.014511385001,-0.054982453585,-0.004838723689,0.007394488901,0.016511965543,-0.004510877654,0.027433792129,-0.027146628127,-0.001714612008,0.006628716365,-0.022954024374,-0.015755765140,-0.021365048364,-0.036163598299,-0.000167961392,0.023451777175,-0.022839158773,0.035838145763,-0.038633212447,-0.038001451641,0.030056562275,-0.008691515774,0.005915591028,-0.019077302888,-0.018560405821,0.045908048749,0.049200870097,-0.007183901500,0.014415663667,-0.026648877189,-0.020503554493,-0.013573314063,0.001297026873,0.011764177121,0.021307613701,0.035168092698,-0.040241334587,-0.011333430186,0.029673676938,0.021077882499,-0.030286295339,0.062372155488,0.019642060623,0.002376287244,0.013362727128,0.023317767307,0.009553009644,-0.028486730531,-0.046941842884,-0.008452211507,-0.016272662207,0.045295432210,0.006872806698,-0.008299057372,-0.014339086600,0.007054677233,0.011333430186,0.018550833687,-0.026840319857,0.032315593213,0.029367368668,0.008533575572,0.019603772089,-0.040241334587,0.004541987088,0.010194343515,-0.023528354242,0.002288941294,-0.009452502243,-0.024849312380,0.004788469989,0.032526180148,0.007729514036,-0.010548513383,-0.009955040179,-0.036680493504,0.032851632684,-0.005269470625,-0.007662509102,-0.027491226792,0.013937056065,-0.008212908171,0.006226686295,0.048626542091,-0.012730964459,0.005298187025,0.004108847119,-0.000629967370,0.031798694283,-0.007471065968,-0.007834807970,0.024906745180,0.001150453230,-0.037388831377,0.027031762525,0.005652356893,0.032736767083,-0.014520957135,-0.008461783640,-0.018991153687,-0.028907904401,-0.018483828753,-0.001980239293,-0.019106019288,0.015258013271,-0.002622770146,0.011965191923,0.017746772617,-0.018598694354,0.007451921701,-0.016100361943,0.020197244361,-0.008160261437,0.046482380480,-0.008911674842,0.014147643000,-0.031166933477,0.005106743891,0.011314285919,0.013391443528,-0.011094125919,0.017612762749,-0.009117476642,0.021403336897,-0.013094706461,0.011926903389,0.012022625655,-0.013994488865,0.021192748100,-0.032162435353,0.030822334811,-0.034019436687,0.001769651892,0.026610588655,0.023317767307,0.052493691444,0.021613923833,0.032679334283,0.006772298831,-0.021039593965,-0.014348658733,0.016626831144,0.050081510097,-0.020867295563,-0.012826685794,0.002424147911,-0.016588542610,0.018445540220,0.046444091946,0.001139086322,0.014721972868,-0.014329514466,0.014520957135,0.018378535286,-0.020158955827,0.024906745180,-0.012577810325,-0.042538650334,0.008299057372,0.007662509102,0.017440464348,0.003443582449,-0.008337345906,0.022111674771,-0.005570993759,0.015210152604,-0.023241190240,-0.012692675926,0.001823495259,0.013812618330,0.010845250450,-0.033157940954,-0.012750108726,0.026419144124,-0.015487745404,-0.028525019065,-0.013984916732,-0.033387672156,-0.039475563914,-0.031013779342,0.030726613477,0.006427701563,0.013544597663,-0.012549093924,-0.001130112447,0.009955040179,-0.007916171104,0.013889195397,0.012884119526,0.013267004862,0.042155764997,0.002186040627,-0.000468736398,0.023777229711,-0.009093546309,-0.029329080135,-0.005384336691,-0.004879405256,-0.000459463394,-0.016416244209,0.023432632908,0.026648877189,0.036278463900,0.006580855697,-0.007116896566,0.051613055170,-0.008428281173,-0.026093691587,0.005298187025,-0.032219868153,-0.033579114825,0.014482668601,0.013362727128,0.053565774113,0.009811458178,-0.057318057865,0.025040755048,0.002341588261,0.027242349461,0.006097462028,0.022226542234,-0.021020449698,0.028276141733,0.000013339320,-0.004587454721,0.041849456728,-0.050847280771,0.009500362910,0.024677012116,0.006049601361,0.024006962776,0.012903263792,-0.003326323582,0.007121682633,-0.013726469129,-0.035206381232,0.040892239660,-0.002324836794,0.036508195102,-0.015009136871,-0.004838723689,0.002893183613,0.025653371587,0.000656889053,0.016377955675,0.032564468682,-0.002410986228,-0.016751268879,-0.007423205301,0.015717476606,-0.007121682633,0.009529079311,-0.004460623488,-0.008212908171,-0.020101523027,-0.022207396105,-0.030496882275,0.042538650334,0.006652647164,-0.059462219477,-0.056437417865,-0.025232197717,0.019431471825,-0.015066570602,-0.011620595120,0.045103989542,0.003926976118,0.002391841961,-0.006413342897,0.004403190687,0.012778825127,0.003804931184,-0.030362872407,0.042806673795,0.004489340354,0.006619144231,-0.000839956512,0.027759246528,-0.025270486251,0.037886586040,0.016904423013,0.022035097703,-0.012951124460,-0.014444380067,0.025481073186,0.025404496118,0.022417984903,0.027414647862,-0.003893473651,0.020752429962,-0.020580131561,-0.000624583045,-0.038460914046,0.026342567056,0.027108339593,0.002534227679,-0.007686439436,0.028869615868,0.012434228323,0.016588542610,0.000452882523,0.023126324639,0.020044090226,0.019364466891,0.006772298831,0.027950689197,-0.010816534050,-0.023892095312,0.037446264178,0.022781725973,0.018368963152,-0.006360696163,-0.003919797018,0.004896156490,0.007533285301,-0.020809862763,-0.026017114520,0.004967947956,-0.016722552478,0.000664068153,0.020867295563,-0.025538505986,0.020694997162,0.003096591681,0.018416823819,-0.003285641782,0.005489630159,0.016234373674,-0.021250180900,0.038805510849,-0.005891660694,-0.008045394905,0.019575053826,0.013544597663,-0.009189267643,-0.026591444388,-0.013018129393,-0.017124583945,-0.004687962588,-0.010146482848,0.009031327441,-0.024983322248,0.009256272577,0.012558666058,0.021499058232,0.020905584097,0.001126522897,-0.009438144043,-0.016598114744,0.011831182055,0.020331254229,-0.032239016145,-0.019240029156,-0.009868890978,-0.026476576924,0.032507035881,-0.009811458178,0.002821392380,0.011907759123,0.026840319857,0.010816534050,-0.001533937640,0.001963488059,-0.002852501813,-0.016942711547,-0.002282958711,0.034498043358,-0.024198405445,0.009797099046,0.017488325015,-0.009888035245,-0.051306743175,0.010261349380,-0.006614358164,-0.027912400663,0.002229115227,0.013850906864,-0.018952865154,-0.005336476024]
- 向量数据库检索相关知识片段(把用户的输入向量,到向量数据库里检查,一般是返回TOP-K文档片段),如用上面的向量进行TOP-3查询,结果如下:
--- Milvus 检索 hits (TOP-3) ---
[1] id=5 distance=0.603778064250946 category='生平事业'
original_text: 问题:「华仔」通常指哪位艺人?
答案:「华仔」是影迷与歌迷对刘德华的亲切称呼,在华语圈广为人知。
[2] id=1 distance=0.592343807220459 category='生平事业'
original_text: 问题:刘德华出生于何时何地?
答案:1961 年 9 月 27 日出生于中国香港新界大埔镇泰亨村。
[3] id=4 distance=0.5258437991142273 category='生平事业'
original_text: 问题:刘德华除歌手、演员外还有哪些常见身份?
答案:还担任监制、制作人、填词等,并长期参与公益与慈善活动,公众形象较为正面。
---
- 构建增强 Prompt → 调用大模型生成回答(Prompt = 原来Prompt + TOP-K文档片段,叫大模型在这些文档片段里找答案,如果找不到,就回答说不知道,防止出现问答乱说现象),如上面的答案是:
刘德华,通常被称为「华仔」,是华语圈内广为人知的艺人。他于1961年9月27日出生于中国香港新界大埔镇泰亨村。除了作为歌手和演员外,刘德华还担任监制、制作人和填词人,并积极参与公益与慈善活动,公众形象相对正面。
- 内容检测与过滤 → 返回前端
4. 实践效果
- 相比纯大模型问答模式,RAG 提升了回答准确率,回答可解析性更强。
- 知识库内容更新,不需要重新训练模型或进行模型微调,仅需要把相应数据放到向量数据库即可。