transformers-chat / ingest.sh
enoreyes's picture
Duplicate from hwchase17/chat-langchain
9d38059
raw
history blame contribute delete
236 Bytes
# Bash script to ingest data
# This involves scraping the data from the web and then cleaning up and putting in Weaviate.
!set -eu
wget -r -A.html https://langchain.readthedocs.io/en/latest/
python3 ingest.py
python3 ingest_examples.py