๐ Retrieval augmented generation with open source models using AWS SageMaker
๐ Setting up instances for storing the language model and embedding model
๐ Using a dataset to inform the language model
๐๏ธ Storing vector embeddings in Pinecone database
๐ก The retrieval augmented prompt process using query vectors
๐ฅ๏ธ Implementing the process using AWS SageMaker
๐ Accessing the notebook with installation instructions and importing the required libraries
๐ก The video explains how to configure the image and choose the model ID for Hugging Face language models.
๐ The speaker demonstrates how to search for and select the Google flan T5 XL model for text generation.
โ๏ธ The process of deploying the selected model to an AWS SageMaker instance is shown, including initialization and deployment steps.
๐ Manage spot training can be used with all instances supported in Amazon SageMaker.
๐ RAG (Retrieval Augmented Generation) allows finding chunks of text that can answer a question from a larger database.
๐ก Hugging Face Transformers can be used for efficient feature extraction in embedding models.
๐ The video explores the process of creating query vectors using embedding models and transformer models.
๐ก The embedding models generate token-level embeddings for each input sentence and use mean pooling to create a single sentence embedding.
๐ข The expected dimensionality of the embeddings is 384, but the actual output dimensions are 8 due to the input tokens and padding tokens.
๐ We create XC vectors by taking the mean across a single axis and package it into a single function.
๐ We apply the XC vectors to the Amazon SageMaker FAQs dataset and store them in Pinecone.
๐ We initialize a connection with Pinecone using a free API key and create a new index with the dimensionality of 384.
๐ Creating a database index and storing metadata and embeddings for documents.
๐ Querying the database with a question and retrieving relevant context.
โ๏ธ Answering a question based on the given context.
๐ Retrieval augmented generation with SageMaker and Pinecone allows for the creation of an answer based on given context and prompt.
โ The model is designed to respond with 'I don't know' if the context does not contain relevant information.
๐ก Using open source models and Pinecone, it is relatively easy to set up and use retrieval augmented generation with SageMaker.
Elon Musk Five Step Improvement Process
Video testimonial de la Huella de Carbono Perรบ
ููุฐุง ุฃูุง ู ููุงุฑุฏูุฑ! โุนูุฏู ุง ูุชููู ุฎุจูุฑ ุงูุชูู ูุฉ ุงูุจุดุฑูุฉ ุงูุฌุฒุงุฆุฑู ุงูุฏูุชูุฑ ุฑุดูุฏ ุฃู ูุฑุงู ุนู ุงูุนุทุงุก ูุงูุณุนุงุฏุฉ
Techdili Mekan Sohbetleri - Yapay Zeka ile Deฤer Yaratmak
Mario Mendoza - MARLON BECERRA ENTREVISTA
Techdili Mekan Sohbetleri - Data Translator vs Data Scientist