https://www.linkedin.com/posts/softwaredoug_absolutely-kille...
* Any solid search engine (bm25 + embeddings and hnsw)
* Any api to a model (gpt3.5, gpt4, claude, etc)
* Some middleware to call search then build the prompt
Then the remaining:
* Create an eval dataset, then tune the search and the prompt as needed