from langchain.embeddings.openai import OpenAIEmbeddings
from langchain.vectorstores import DeepLake
from langchain.text_splitter import CharacterTextSplitter
from langchain import OpenAI
from langchain.document_loaders import SeleniumURLLoader
from langchain import PromptTemplate
import os
import openai
import sys
sys.path.append('../..')
from dotenv import load_dotenv, find_dotenv
_ = load_dotenv(find_dotenv()) # read local .env file
openai.api_key = os.environ['OPENAI_API_KEY']1 Introduction
Large language models like GPT-4 and ChatGPT have emerged as key advancements in the IT world as we observe faster technological growth. These cutting-edge models exhibit outstanding skill in content creation. They do, however, face some difficulties, including as biases and hallucinations. Despite these drawbacks, LLMs have the power to completely change the way chatbot development is done.
Traditional chatbots, which are mostly intent-based, are made to react to particular user intentions. These intentions include a number of model questions and related answers. A “Restaurant Recommendations” purpose, for instance, would have sample inquiries like “Can you recommend a good Italian restaurant nearby?” or “Where can I get the best sushi in town?” with answers like “You should try the Italian restaurant”La Trattoria” nearby” or “Sushi Palace” is the best sushi restaurant in town.”
When consumers engage with the chatbot, their inquiries are compared to those with the most like intent, producing the corresponding response. However, as LLMs continue to advance, chatbot development is trending towards more advanced and dynamic options that can handle a wider variety of customer enquiries with more accuracy and nuance.
2 Having a Knowledge Base
LLMs can greatly improve chatbot functionality by linking larger intents with Knowledge Base (KB) documents rather than individual questions and replies. This method simplifies intent management and produces more personalised responses to user enquiries.
The maximum prompt size in GPT3 is roughly 4,000 tokens, which is large but insufficient for combining a full knowledge base into a single prompt.
Future LLMs may not have this restriction while still having text creation capabilities. However, for the time being, we must develop a solution around it.
3 Workflow
The goal of this project is to create a chatbot that uses GPT3 to search for answers within documents. The experiment’s workflow is depicted in the diagram below.
To begin, we extract some content from internet publications, divide it into little parts, compute its embeddings, and store it in Deep Lake. Then, using a user inquiry, we retrieve the most relevant chunks from Deep Lake and place them in a prompt, which will be used by the LLM to construct the final answer.
It is vital to highlight that when utilising LLMs, there is always the possibility of generating hallucinations or incorrect information. Although this may not be acceptable for many customer service use cases, the chatbot can nonetheless aid operators in crafting answers that they can double-check before delivering to the user.
n the next steps, we’ll explore how to manage conversations with GPT-3 and provide examples to demonstrate the effectiveness of this workflow:
4 Import Libs & Setup
First, set up the OPENAI_API_KEY and ACTIVELOOP_TOKEN environment variables with your API keys and tokens.
These libraries provide OpenAI embeddings, vector storage management, text splitting, and communicating with the OpenAI API. They also allow for the development of a context-aware question-answering system that incorporates retrieval and text generation.
Our chatbot’s database will be made up of articles about technical challenges.
# we'll use information from the following articles
urls = ['https://beebom.com/what-is-nft-explained/',
'https://beebom.com/how-delete-spotify-account/',
'https://beebom.com/how-download-gif-twitter/',
'https://beebom.com/how-use-chatgpt-linux-terminal/',
'https://beebom.com/how-delete-spotify-account/',
'https://beebom.com/how-save-instagram-story-with-music/',
'https://beebom.com/how-install-pip-windows/',
'https://beebom.com/how-check-disk-usage-linux/']5 Split the documents into chunks and compute their embeddings
We load the pages from the specified URLs and split them into 1000 parts with no overlap using the CharacterTextSplitter:
# use the selenium scraper to load the documents
loader = SeleniumURLLoader(urls=urls)
docs_not_splitted = loader.load()
# we split the documents into smaller chunks
text_splitter = CharacterTextSplitter(chunk_size=1000, chunk_overlap=0)
docs = text_splitter.split_documents(docs_not_splitted)Created a chunk of size 1226, which is longer than the specified 1000The embeddings are then computed using OpenAIEmbeddings and stored in a Deep Lake vector store in the cloud. In an ideal production scenario, we could upload an entire website or course lesson to a Deep Lake dataset, enabling search over thousands or millions of documents. Because we are using a cloud serverless Deep Lake dataset, applications running in multiple locations may easily access the same centralised dataset without the need for a vector store to be deployed on a specific machine.
Now, change the following code to include your Activeloop organisation ID. It’s worth remembering that the org id is your default username.
# Before executing the following code, make sure to have
# your OpenAI key saved in the “OPENAI_API_KEY” environment variable.
embeddings = OpenAIEmbeddings(model="text-embedding-ada-002")
# create Deep Lake dataset
# TODO: use your organization id here. (by default, org id is your username)
my_activeloop_org_id = "pranath"
my_activeloop_dataset_name = "langchain_course_customer_support"
dataset_path = f"hub://{my_activeloop_org_id}/{my_activeloop_dataset_name}"
db = DeepLake(dataset_path=dataset_path, embedding_function=embeddings)
# add documents to our Deep Lake dataset
db.add_documents(docs)Your Deep Lake dataset has been successfully created!
Dataset(path='hub://pranath/langchain_course_customer_support', tensors=['embedding', 'id', 'metadata', 'text'])
tensor htype shape dtype compression
------- ------- ------- ------- -------
embedding embedding (146, 1536) float32 None
id text (146, 1) str None
metadata json (146, 1) str None
text text (146, 1) str None \ ['52ad71cc-3c5e-11ee-bdd8-acde48001122',
'52ad732a-3c5e-11ee-bdd8-acde48001122',
'52ad738e-3c5e-11ee-bdd8-acde48001122',
'52ad73d4-3c5e-11ee-bdd8-acde48001122',
'52ad7410-3c5e-11ee-bdd8-acde48001122',
'52ad7456-3c5e-11ee-bdd8-acde48001122',
'52ad7492-3c5e-11ee-bdd8-acde48001122',
'52ad74ce-3c5e-11ee-bdd8-acde48001122',
'52ad750a-3c5e-11ee-bdd8-acde48001122',
'52ad7550-3c5e-11ee-bdd8-acde48001122',
'52ad758c-3c5e-11ee-bdd8-acde48001122',
'52ad75c8-3c5e-11ee-bdd8-acde48001122',
'52ad7604-3c5e-11ee-bdd8-acde48001122',
'52ad7640-3c5e-11ee-bdd8-acde48001122',
'52ad7686-3c5e-11ee-bdd8-acde48001122',
'52ad76c2-3c5e-11ee-bdd8-acde48001122',
'52ad76fe-3c5e-11ee-bdd8-acde48001122',
'52ad7744-3c5e-11ee-bdd8-acde48001122',
'52ad7780-3c5e-11ee-bdd8-acde48001122',
'52ad77bc-3c5e-11ee-bdd8-acde48001122',
'52ad77f8-3c5e-11ee-bdd8-acde48001122',
'52ad783e-3c5e-11ee-bdd8-acde48001122',
'52ad787a-3c5e-11ee-bdd8-acde48001122',
'52ad78b6-3c5e-11ee-bdd8-acde48001122',
'52ad78f2-3c5e-11ee-bdd8-acde48001122',
'52ad792e-3c5e-11ee-bdd8-acde48001122',
'52ad7974-3c5e-11ee-bdd8-acde48001122',
'52ad79b0-3c5e-11ee-bdd8-acde48001122',
'52ad79ec-3c5e-11ee-bdd8-acde48001122',
'52ad7a28-3c5e-11ee-bdd8-acde48001122',
'52ad7a64-3c5e-11ee-bdd8-acde48001122',
'52ad7aaa-3c5e-11ee-bdd8-acde48001122',
'52ad7ae6-3c5e-11ee-bdd8-acde48001122',
'52ad7b22-3c5e-11ee-bdd8-acde48001122',
'52ad7b5e-3c5e-11ee-bdd8-acde48001122',
'52ad7b9a-3c5e-11ee-bdd8-acde48001122',
'52ad7be0-3c5e-11ee-bdd8-acde48001122',
'52ad7c1c-3c5e-11ee-bdd8-acde48001122',
'52ad7c94-3c5e-11ee-bdd8-acde48001122',
'52ad7cd0-3c5e-11ee-bdd8-acde48001122',
'52ad7d0c-3c5e-11ee-bdd8-acde48001122',
'52ad7d52-3c5e-11ee-bdd8-acde48001122',
'52ad7d8e-3c5e-11ee-bdd8-acde48001122',
'52ad7dca-3c5e-11ee-bdd8-acde48001122',
'52ad7e10-3c5e-11ee-bdd8-acde48001122',
'52ad7e4c-3c5e-11ee-bdd8-acde48001122',
'52ad7e88-3c5e-11ee-bdd8-acde48001122',
'52ad7ec4-3c5e-11ee-bdd8-acde48001122',
'52ad7f0a-3c5e-11ee-bdd8-acde48001122',
'52ad7f46-3c5e-11ee-bdd8-acde48001122',
'52ad7f82-3c5e-11ee-bdd8-acde48001122',
'52ad7fbe-3c5e-11ee-bdd8-acde48001122',
'52ad7ffa-3c5e-11ee-bdd8-acde48001122',
'52ad805e-3c5e-11ee-bdd8-acde48001122',
'52ad809a-3c5e-11ee-bdd8-acde48001122',
'52ad80d6-3c5e-11ee-bdd8-acde48001122',
'52ad8112-3c5e-11ee-bdd8-acde48001122',
'52ad814e-3c5e-11ee-bdd8-acde48001122',
'52ad8194-3c5e-11ee-bdd8-acde48001122',
'52ad81d0-3c5e-11ee-bdd8-acde48001122',
'52ad820c-3c5e-11ee-bdd8-acde48001122',
'52ad8248-3c5e-11ee-bdd8-acde48001122',
'52ad828e-3c5e-11ee-bdd8-acde48001122',
'52ad82ca-3c5e-11ee-bdd8-acde48001122',
'52ad8306-3c5e-11ee-bdd8-acde48001122',
'52ad8342-3c5e-11ee-bdd8-acde48001122',
'52ad8388-3c5e-11ee-bdd8-acde48001122',
'52ad83c4-3c5e-11ee-bdd8-acde48001122',
'52ad8400-3c5e-11ee-bdd8-acde48001122',
'52ad843c-3c5e-11ee-bdd8-acde48001122',
'52ad8478-3c5e-11ee-bdd8-acde48001122',
'52ad84b4-3c5e-11ee-bdd8-acde48001122',
'52ad84f0-3c5e-11ee-bdd8-acde48001122',
'52ad852c-3c5e-11ee-bdd8-acde48001122',
'52ad8572-3c5e-11ee-bdd8-acde48001122',
'52ad85ae-3c5e-11ee-bdd8-acde48001122',
'52ad85ea-3c5e-11ee-bdd8-acde48001122',
'52ad863a-3c5e-11ee-bdd8-acde48001122',
'52ad8676-3c5e-11ee-bdd8-acde48001122',
'52ad86b2-3c5e-11ee-bdd8-acde48001122',
'52ad86ee-3c5e-11ee-bdd8-acde48001122',
'52ad873e-3c5e-11ee-bdd8-acde48001122',
'52ad877a-3c5e-11ee-bdd8-acde48001122',
'52ad87b6-3c5e-11ee-bdd8-acde48001122',
'52ad87f2-3c5e-11ee-bdd8-acde48001122',
'52ad882e-3c5e-11ee-bdd8-acde48001122',
'52ad8874-3c5e-11ee-bdd8-acde48001122',
'52ad88b0-3c5e-11ee-bdd8-acde48001122',
'52ad88ec-3c5e-11ee-bdd8-acde48001122',
'52ad8928-3c5e-11ee-bdd8-acde48001122',
'52ad8964-3c5e-11ee-bdd8-acde48001122',
'52ad89a0-3c5e-11ee-bdd8-acde48001122',
'52ad89dc-3c5e-11ee-bdd8-acde48001122',
'52ad8a18-3c5e-11ee-bdd8-acde48001122',
'52ad8a54-3c5e-11ee-bdd8-acde48001122',
'52ad8a9a-3c5e-11ee-bdd8-acde48001122',
'52ad8ad6-3c5e-11ee-bdd8-acde48001122',
'52ad8b12-3c5e-11ee-bdd8-acde48001122',
'52ad8b4e-3c5e-11ee-bdd8-acde48001122',
'52ad8b8a-3c5e-11ee-bdd8-acde48001122',
'52ad8bc6-3c5e-11ee-bdd8-acde48001122',
'52ad8c02-3c5e-11ee-bdd8-acde48001122',
'52ad8c3e-3c5e-11ee-bdd8-acde48001122',
'52ad8c7a-3c5e-11ee-bdd8-acde48001122',
'52ad8cb6-3c5e-11ee-bdd8-acde48001122',
'52ad8cf2-3c5e-11ee-bdd8-acde48001122',
'52ad8d2e-3c5e-11ee-bdd8-acde48001122',
'52ad8d6a-3c5e-11ee-bdd8-acde48001122',
'52ad8db0-3c5e-11ee-bdd8-acde48001122',
'52ad8dec-3c5e-11ee-bdd8-acde48001122',
'52ad8e32-3c5e-11ee-bdd8-acde48001122',
'52ad8e6e-3c5e-11ee-bdd8-acde48001122',
'52ad8eaa-3c5e-11ee-bdd8-acde48001122',
'52ad8ee6-3c5e-11ee-bdd8-acde48001122',
'52ad8f22-3c5e-11ee-bdd8-acde48001122',
'52ad8f5e-3c5e-11ee-bdd8-acde48001122',
'52ad8f9a-3c5e-11ee-bdd8-acde48001122',
'52ad8fd6-3c5e-11ee-bdd8-acde48001122',
'52ad9012-3c5e-11ee-bdd8-acde48001122',
'52ad904e-3c5e-11ee-bdd8-acde48001122',
'52ad908a-3c5e-11ee-bdd8-acde48001122',
'52ad90d0-3c5e-11ee-bdd8-acde48001122',
'52ad915c-3c5e-11ee-bdd8-acde48001122',
'52ad91a2-3c5e-11ee-bdd8-acde48001122',
'52ad91de-3c5e-11ee-bdd8-acde48001122',
'52ad921a-3c5e-11ee-bdd8-acde48001122',
'52ad9256-3c5e-11ee-bdd8-acde48001122',
'52ad9292-3c5e-11ee-bdd8-acde48001122',
'52ad92d8-3c5e-11ee-bdd8-acde48001122',
'52ad931e-3c5e-11ee-bdd8-acde48001122',
'52ad935a-3c5e-11ee-bdd8-acde48001122',
'52ad93a0-3c5e-11ee-bdd8-acde48001122',
'52ad93dc-3c5e-11ee-bdd8-acde48001122',
'52ad9418-3c5e-11ee-bdd8-acde48001122',
'52ad9454-3c5e-11ee-bdd8-acde48001122',
'52ad9490-3c5e-11ee-bdd8-acde48001122',
'52ad94d6-3c5e-11ee-bdd8-acde48001122',
'52ad9512-3c5e-11ee-bdd8-acde48001122',
'52ad954e-3c5e-11ee-bdd8-acde48001122',
'52ad958a-3c5e-11ee-bdd8-acde48001122',
'52ad95c6-3c5e-11ee-bdd8-acde48001122',
'52ad960c-3c5e-11ee-bdd8-acde48001122',
'52ad9648-3c5e-11ee-bdd8-acde48001122',
'52ad9684-3c5e-11ee-bdd8-acde48001122',
'52ad96c0-3c5e-11ee-bdd8-acde48001122',
'52ad96fc-3c5e-11ee-bdd8-acde48001122']To retrieve the most similar chunks to a given query, we can use the similarity_search method of the Deep Lake vector store:
# let's see the top relevant documents to a specific query
query = "how to check disk usage in linux?"
docs = db.similarity_search(query)
print(docs[0].page_content)Home Tech How to Check Disk Usage in Linux (4 Methods)
How to Check Disk Usage in Linux (4 Methods)
Beebom Staff
Last Updated: June 19, 2023 5:14 pm
There may be times when you need to download some important files or transfer some photos to your Linux system, but face a problem of insufficient disk space. You head over to your file manager to delete the large files which you no longer require, but you have no clue which of them are occupying most of your disk space. In this article, we will show some easy methods to check disk usage in Linux from both the terminal and the GUI application.
Monitor Disk Usage in Linux (2023)
Table of Contents
Check Disk Space Using the df Command
Display Disk Usage in Human Readable FormatDisplay Disk Occupancy of a Particular Type
Check Disk Usage using the du Command
Display Disk Usage in Human Readable FormatDisplay Disk Usage for a Particular DirectoryCompare Disk Usage of Two Directories6 Craft a prompt for GPT-3 using the suggested strategies
We’ll develop a prompt template that combines role-prompting, Knowledge Base information, and the user’s question:
# let's write a prompt for a customer support chatbot that
# answer questions using information extracted from our db
template = """You are an exceptional customer support chatbot that gently answer questions.
You know the following context information.
{chunks_formatted}
Answer to the following question from a customer. Use only information from the previous context information. Do not invent stuff.
Question: {query}
Answer:"""
prompt = PromptTemplate(
input_variables=["chunks_formatted", "query"],
template=template,
)The template establishes the chatbot’s persona as an outstanding customer support chatbot. The template accepts two variables as input: chunks_formatted, which contains pre-formatted chunks from articles, and query, which represents the customer’s question. The goal is to construct an accurate answer utilising only the available chunks while avoiding the creation of erroneous or fictional information.
7 Utilize the GPT3 model with a temperature of 0 for text generation
To construct a response, we first obtain the top-k (e.g., top-3) chunks that are most comparable to the user question, format the prompt, and send it to the GPT3 model with a temperature of 0.
# the full pipeline
# user question
query = "How to check disk usage in linux?"
# retrieve relevant chunks
docs = db.similarity_search(query)
retrieved_chunks = [doc.page_content for doc in docs]
# format the prompt
chunks_formatted = "\n\n".join(retrieved_chunks)
prompt_formatted = prompt.format(chunks_formatted=chunks_formatted, query=query)
# generate answer
llm = OpenAI(model="text-davinci-003", temperature=0)
answer = llm(prompt_formatted)
print(answer) You can check disk usage in Linux using the df command or by using a GUI tool such as the GDU Disk Usage Analyzer or the Gnome Disks Tool. The df command is used to check the current disk usage and the available disk space in Linux. The syntax for the df command is: df <options> <file_system>. The options to use with the df command are: a, h, t, and x. To install the GDU Disk Usage Analyzer, use the command: sudo snap install gdu-disk-usage-analyzer. To install the Gnome Disks Tool, use the command: sudo apt-get -y install gnome-disk-utility.8 Issues with Generating Answers using GPT-3
In the above scenario, the chatbot performs admirably. However, there are some cases where it may fail.
Assume we ask GPT-3, “Is the Linux distribution free?” and provide context in the form of a document regarding kernel features. It may provide a response such as “Yes, the Linux distribution is free to download and use,” even if such information is not contained in the context page. False information is extremely undesirable for customer service chatbots!
When the answer to the user’s question is contained inside the context, GPT-3 is less likely to generate misleading information. We cannot always rely on the semantic search stage to find the proper document because user questions are frequently brief and vague. There is always the possibility of generating erroneous information.
9 An Alternative - SalesCopilot Helping Support Human Customer Services
There may be times for various reasons you choose to use humans in customer services, in these cases you may be able to use something like SalesCopilot as described by this article which looks into how LangChain, Deep Lake, and GPT-4 can be used to develop a sales assistant able to give advice to salesman, taking into considerations internal guidelines.
This article goes into detail about a sales call assistant that connects you to a chatbot that understands the context of your conversation. One of SalesCopilot’s biggest features is its ability to recognise probable customer complaints and provide ideas on how to effectively handle them.
The post illustrates the obstacles encountered and solutions uncovered during the project’s development. You’ll discover the two unique text-splitting approaches that failed and how these failures paved the path for an effective solution.
Initially, the authors attempted to rely entirely on the LLM, but they experienced challenges with GPT-4 such as response inconsistency and sluggish response times. Second, they erroneously divided the custom knowledge base into chunks, which resulted in context misalignment and inefficient results.
Following these failed attempts, a more intelligent method of partitioning the knowledge base based on its structure was developed. This improvement significantly enhanced response quality and ensured stronger context grounding for LLM responses. This process is detailed, allowing you to understand how to overcome comparable issues in your own AI projects.
The paper then delves into how SalesCopilot was linked with Deep Lake. This integration expanded SalesCopilot’s capabilities by collecting the most appropriate responses from a proprietary knowledge base, resulting in a dependable, efficient, and highly adjustable solution for dealing with client concerns.
10 Conclusion
GPT-3 is quite good at generating conversational chatbots that can answer particular queries based on the context provided in the prompt. However, because the model has a tendency to hallucinate (i.e., invent new, potentially erroneous information), it might be difficult to ensure that it generates answers simply based on the context. The intensity of erroneous information generation varies based on the use case.
Finally, we used LangChain to build a context-aware question-answering system, following the code and ideas supplied. Splitting documents into chunks, computing their embeddings, constructing a retriever to discover related chunks, creating a prompt for GPT-3, and using the GPT3 model for text production were all part of the procedure. This method highlights the power of exploiting GPT-3 to build powerful and contextually correct chatbots while also emphasising the need to be cautious about the possibilities of providing fake information.
Further Reading:
https://learnprompting.org/docs/applied_prompting/build_chatbot_from_kb
11 Acknowledgements
I’d like to express my thanks to the wonderful LangChain & Vector Databases in Production Course by Activeloop - which i completed, and acknowledge the use of some images and other materials from the course in this article.