AI describing images: Natural Language Generation (NLG) using textual attributes

“Speak English!” said the Eaglet. “I don’t know the meaning of half those long words, and, what’s more, I don’t believe you do either!” — “Alice in Wonderland”, Chapter 3

Dear friends,

let’s teach computers to speak 😉

Today you will read about Natural Language Generation AI that can describe images given some textual attributes.

Keywords: natural language generation (NLG), data-to-text, natural language processing (NLP), image description, encoder-decoder architecture, sequence-to-sequence architecture, biderectional recurrent neural networks (BiRNNs), long short-term memory neural networks (LSTMs), Attention mechanism, neural word embeddings, Machine Learning, Deep Learning, structured data

Why do we need such a system?

• for data-to-text systems which generate textual summaries of databases and data sets. Research has shown that textual summaries can be more effective than graphs and other visuals for decision support
• produce weather forecasts from weather data
• summarise financial and business data
• commercially in automated journalism
• for chatbots, question-answering (QA) systems
  
• generate product descriptions for e-commerce sites
• summarise medical records
• enhance accessibility (for example by describing graphs and data sets to blind people)
• assist human writers and make writing process more efficient and effective
• as basis for video descriptions, for example a very interesting task of generating the descriptions during the World Cup 2022, tracking the players and their actions;
• for creative language generation (jokes generation);
• for expert systems (generate expert answers using structured/unstructured information)
• automatically generate product reviews

and many other useful things 🙂

Again with you – a small overview of topics/projects

Dear-dear Friends,

After quite a long pause I am again with you with an ocean of very important and  interesting information 🙂

This year was for me a year of inspiration,

Prepare your data. Part 1: Pre-processing

Hello, my dear friends. In the last article we had an overview of some interesting datasets for Natural Language Processing and Machine Learning. Let’s learn, how to work with them!

WHY?

Data preparation is the A and B for every data scientist. Despite having good data, you cannot access the information in it, unless it is processed. Only about 20% of information today is available in structured form. Majority of data is presented in text form, which is highly unstructured in nature.

In order to produce actionable insights from data, you have to prepare it. In this article we’ll learn, how to pre-process text information.

Find Data for AI

Dear AI friends,

all you need is … DATA! And love, of course 🙂

Yes, I don’t joke. The fuel for any AI System is Data. No matter how clever the technologies are, they depend on data. More importantly, they depend on “good” data. If you have good Data, you have already solved 50% of your problem. Any AI System is “data-hungry” and can only be as smart as the information you provide it with.

So, before we start with clever ML algorithms, let’s ensure we know, how to find Data for your AI 😉

Let’s create a chatbot

Hello, my dear friends 🙂

Today, we are going to create our own communication bot.

Why?

There are two reasons for it.

• Reason Number One: Today it’s a TREND and a MUST

First of all, bots become a real craze of the modern world. It’s about humans talking directly to machines. It’s about science fiction. It’s about future.

AI Blog

I’m Tatjana Chernenko, a writer and computer scientist living in Germany.

I’m a student in Computational Linguistics at the University of Heidelberg. My interests focus on science, Artificial Intelligence, Machine Learning and Natural Language Processing.

Every day I gain a lot of interesting experience and valuable knowledge. I found my passion in the world of science and AI. Every single step in a journey as a computer scientist is a kind of magic. I decided to start this blog to share my knowledge with you!