There has been a flurry of exciting open-source LLMs which can be fine-tuned. But how does that compare to just using a closed API? — I get this question a lot — from folks on LinkedIn asking me questions on how to fine-tune open source models like LLaMA, companies trying to figure out the business case for selling LLM hosting and deployment solutions, and companies trying to capitalize on AI and LLMs applied to their…

Finance is all about capturing changes. If you do well, you win, if not — you lose. Learn how AI significantly changes the game — Making predictions is hard. On the one hand, predicting something like stock price is extremely simple to conceptualize — you have a graph of a single variable, vs another variable: stock price vs time. …

How much does it cost to deploy LLMs like ChatGPT? Are open-source LLMs cheaper to deploy? What are the tradeoffs? — TLDR: For lower usage in the 1000’s of requests per day range ChatGPT works out cheaper than using open-sourced LLMs deployed to AWS. For millions of requests per day, open-sourced models deployed in AWS work out cheaper. (As of writing this article on April 24th, 2023.) Large Language Models are…

How I created a ChatGPT-Based App For LongForm Q&A. From Ideation → Deployment → Monitoring → Iteration — ChatGPT, BARD, GPT-4 are all taking the world by storm. If multiple large tech companies are heavily invested in the same idea — I don’t think you can take this idea lightly. …

A guide on why and how to make Generative AI like ChatGPT and GPT-4 available to customers — You’ve probably tried ChatGPT or GPT-4 at least a few times over the past months and seen real exciting results. Maybe you use it every day or week as part of your creative process to help generate ideas and other content. Or maybe you want an answer to a question…

This tutorial uncovers how to format multiple inputs to guide dialogues over custom documents using ChatGPT. — Recently, the ChatGPT API has developers all over making interesting product prototypes. In fact, last weekend, an emergency hackathon of sorts was held where hundreds of developers came together with cool ideas for ChatGPT-based products. However, while ChatGPT is capable of many tasks out of the box, I believe…

OpenAI just released the ChatGPT (GPT-3.5) API! This tutorial goes into the various ways you can use the ChatGPT API to turbo-charge your application. — OpenAI just released their ChatGPT API (called GPT-3.5). This is a game changer for developers and businesses that are actively using the ChatGPT web app or using the older GPT-3 APIs like Davinci to serve customers. And the best part — it is 1/10th the cost of their GPT-3 Davinci…

Introducing AnswerChatAI — an OpenAI powered app that finds “needles in information haystacks” including multilingual Q&A, summarization, and paraphrasing — over custom documents — Unless your stuck under a rock, you’ve probably heard of ChatGPT, and the excitement as well as controversy surrounding it’s release and integration with Bing. In fact, the head of AI at Meta, said this about the LLM hype:

The arrival of ChatGPT hints at a new era of search engines, this tutorial dives into the 2 basic types of AI based question answering — Transformer models introduced in 2017 have led to a breakthrough in solving hard language related tasks. Variations of the original transformer architecture in models like BERT, GPT, etc. trained on large amounts of text data have produced state of the art results on language related tasks.