admin管理员组

文章数量:1313112

How to CrossEncoderReranker with HuggingFaceEndpoint instead of local HuggingFaceCrossEncoder?

        index = self.pc.Index(self.index_name)

        embeddings = OpenAIEmbeddings(model="text-embedding-3-large")
        vector_store = PineconeVectorStore(index=index, embedding=embeddings)

        dense_retriever = vector_store.as_retriever(
            search_type="similarity", search_kwargs={"k": 5}
        )
        cross_encoder_model = HuggingFaceEndpoint(
            endpoint_url=";,
            max_new_tokens=512,
            top_k=10,
            top_p=0.95,
            typical_p=0.95,
            temperature=0.01,
            repetition_penalty=1.03,
            huggingfacehub_api_token="XXX"
            
        )
        

        # cross_encoder_model = HuggingFaceCrossEncoder(
        #     model_name="BAAI/bge-reranker-base"
        # )
        reranker = CrossEncoderReranker(model=cross_encoder_model, top_n=3)

        retriever = ContextualCompressionRetriever(
            base_compressor=reranker, base_retriever=dense_retriever
        )
        return retriever

本文标签： langchainHow to HuggingFaceCrossEncoder HuggingFaceEndpoint and CrossEncoderRerankerStack Overflow

版权声明：本文标题：langchain - How to HuggingFaceCrossEncoder HuggingFaceEndpoint and CrossEncoderReranker - Stack Overflow 内容由网友自发贡献，该文观点仅代表作者本人， 转载请联系作者并注明出处：http://www.betaflare.com/web/1741939861a2406078.html， 本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌抄袭侵权/违法违规的内容，一经查实，本站将立刻删除。