Emergent abilities in large language models (LLMs) represent a fascinating area of artificial intelligence, where models display unexpected and novel behaviors as they increase in size and complexity. These abilities, such as performing arithmetic or understanding complex instructions, often emerge without explicit programming or training for specific tasks, sparking significant interest and debate in the...
Author: Martin Treiber
An introduction to how Large Language Models work
Large Language Models (LLMs) have revolutionized the field of Natural Language Processing (NLP) by offering unprecedented capabilities in generating coherent and fluent text[1]. The evolution of LLMs can be traced back to early language models that were limited by their simplistic architecture and smaller datasets. These initial models primarily focused on predicting the next word...
Coding in the age of AI
Artificial Intelligence (AI) has been making subtle yet significant inroads into the daily workflows of tech professionals. Despite the lack of mainstream media coverage, these transformative tools are reshaping how work is done, often with profound benefits to individual workers rather than firms. Here, we explore two illustrative accounts from Nicholas Carlini and Erik Schluntz,...
‘Intersectional hallucinations’: why AI struggles to understand that a six-year-old can’t be a doctor or claim a pension
When you go to the hospital and get a blood test, the results are put in a dataset and compared with other patients’ results and population data. This lets doctors compare you (your blood, age, sex, health history, scans, etc) to other patients’ results and histories, allowing them to predict, manage and develop new treatments....
The EU AI Act: Your Essential Guide to New Regulations
The EU AI Act is finally here! Published in the Official Journal of the EU on July 12, this groundbreaking regulation comes into force today, August 1, 2024. But don’t worry, the changes won’t hit you all at once. There’s a detailed schedule outlining who needs to comply and when. Key Points You Need to...
The Trend Towards Smaller Language Models in AI
The landscape of artificial intelligence (AI) is undergoing a notable transformation, shifting from the pursuit of ever-larger language models (LLMs) to the development of smaller, more efficient models. This shift, driven by technological advancements and practical considerations, is redefining how AI systems are built, deployed, and utilized across various sectors. The Shift in AI Model...
Understanding Tokens in AI
In the realm of Artificial Intelligence (AI), particularly in the context of Large Language Models (LLMs), tokens are the fundamental units of language that enable machines to comprehend and generate human-like text. This article delves into the world of tokens, exploring their definition, history, types, and significance in the AI landscape. What are Tokens? In...
Embeddings: The Secret Sauce in AI’s Data Cuisine
In the world of artificial intelligence (AI), data is the main ingredient. But just like raw ingredients need preparation before they become a delicious meal, data must be transformed into a palatable format for AI systems, particularly large language models (LLMs), to "digest." This is where embeddings enter the kitchen, serving as the secret sauce...
What are Jupyter Notebooks?
Welcome to the exciting world of Jupyter Notebooks! Whether you’re a seasoned data scientist or a curious beginner, Jupyter Notebooks offer a versatile, interactive environment for developing and sharing code. In this post, we’ll explore what makes Jupyter Notebooks a powerful tool for data analysis, machine learning, and beyond, along with practical examples to get...
AI and the Future of Software Development
Imagine standing on a podium, baton in hand, ready to conduct a symphony of code. This is the future of software development, where developers act more like orchestra conductors than solitary coders. As someone working with LLMs, I’ve witnessed firsthand the rapid advancements that have transformed our capabilities. These changes bring excitement and anxiety, hope...
