GPT - A step closer to AGI?
Artificial general intelligence (AGI) is the representation of generalized human cognitive abilities in software so that, faced with an unfamiliar task, the AGI system could find a solution.
By showing LLMs videos, images, and text, machines learn language skills with text-based descriptions, and perception skills with images. 1
This can elevate AI to a place where it learns to perceive emotions and sentiment the same way humans do and, eventually, learn to understand human communication better than actual humans.
Understanding the beast behind
Neural networks are stupidly simple to understand for anyone with a mild knowledge of statistics and calculus.
At the end of the day, they simply measure the gap between the value they predict and the value they should have predicted and close that gap using undergrad-level mathematics.
While AGI models will surely be multimodal, there’s an unbridgeable barrier to this day: humans learn emotions by experiencing them, while machines learn emotions through textual or visual representations of what those emotions are.
Structured Data vs Unstructured Data
Structured data refers to data that can be organized into a formatted repository, typically a database. Such data can be stored in database tables with rows and columns. They have relational keys and can easily be mapped into pre-designed fields. Typical structured data include relational databases such as PostgreSQL, Snowflake data warehouse, etc. 2
Unstructured data refers to data that is not organized in a predefined manner or does not have a predefined data model. Thus, it is not a good fit for a mainstream relational database. Unstructured data is increasingly prevalent in IT systems and is used by organizations in various business intelligence and analytics applications. Examples include YouTube videos, audio files, Word, PDF, Text, and media logs.
Dictionary & Acronym
- NLP: natural language processing
- LLM: Large Language Model is a type of machine learning model that can perform a variety of natural language processing (NLP) tasks, including generating and classifying text, answering questions in a conversational manner and translating text from one language to another.
- Vector Database: a vector database is a type of database that stores data as high-dimensional vectors, which are mathematical representations of features or attributes. Each vector has a certain number of dimensions, which can range from tens to thousands, depending on the complexity and granularity of the data.
- what is used for: vector databases provide the ability to store and retrieve vectors as high-dimensional points. They add additional capabilities for efficient and fast lookup of nearest-neighbors in the N-dimensional space.
Prompts
In AI writing, prompts are what the user says to the AI writing tool to create the context they want. Prompts are essentially commands, which specify the parameters of the assignment such as the topic, length, style, and which words to use. 3