Fix bug iin HuggingFaceEndpoint usage

1. Upgrade langchain hugginface from community to partner (community deprecated) Added task=text-generation argument to fix error with tgi_endpoint Signed-off-by: rbrugaro <[email protected]>
opea-project · Jan 30, 2025 · 3b996eb · 3b996eb
1 parent 63c66a0
commit 3b996eb
Showing 1 changed file with 2 additions and 1 deletion.
diff --git a/comps/llms/src/doc-summarization/integrations/tgi.py b/comps/llms/src/doc-summarization/integrations/tgi.py
@@ -4,7 +4,7 @@
 import os
 
 import requests
-from langchain_community.llms import HuggingFaceEndpoint
+from langchain_huggingface import HuggingFaceEndpoint
 
 from comps import CustomLogger, GeneratedDoc, OpeaComponent, OpeaComponentRegistry, ServiceType
 from comps.cores.proto.api_protocol import DocSumChatCompletionRequest
@@ -71,6 +71,7 @@ async def invoke(self, input: DocSumChatCompletionRequest):
             repetition_penalty=input.repetition_penalty if input.repetition_penalty else 1.03,
             streaming=input.stream,
             server_kwargs=server_kwargs,
+            task='text-generation',
         )
         result = await self.generate(input, self.client)