<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <issn pub-type="ppub">1613-0073</issn>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Method of Advertising Texts Based on Generative Models</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Khrystyna Lipianina-Honcharenko</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ivan Kit</string-name>
          <email>kitivan400@gmail.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Diana Zahorodnia</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Oleksandr Osolinskyi</string-name>
          <email>oso@wunu.edu.ua</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Workshop</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>West Ukrainian National University</institution>
          ,
          <addr-line>Lvivska Str., 11, Ternopil, 46000</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>This article discusses the creation of a new method for optimizing advertising texts using generative models. The authors investigate the role of these models in automatically generating advertising materials, focusing on the use of GPT-like models. The paper thoroughly examines the process of data collection and processing for training these models and developing an algorithm to achieve the best results. This approach can play a pivotal role in marketing and serve as a springboard for future research. Applying this method in a real advertising campaign demonstrated its effectiveness, which manifested in increased impressions, improved CTR, reduced cost-per-click, and heightened view-through rate, underscoring its advantages over traditional advertising techniques. The campaign metrics from significant improvements across all areas: impressions increased by 2,200; the click-through rate grew by 0.06%; the average cost-per-click decreased from 0.17 UAH to 0.11 UAH; and the view-through rate escalated from 4.27% to 10.8%.</p>
      </abstract>
      <kwd-group>
        <kwd>Generative models</kwd>
        <kwd>advertising text optimization</kwd>
        <kwd>GPT series models</kwd>
        <kwd>content creation</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Social media has long since evolved from a simple communication tool to a powerful marketing
instrument. With deepening digitization and increasing numbers of social media users, these platforms
become increasingly competitive, especially in the context of brands vying for user attention. In this
environment, the effectiveness of advertising texts becomes a decisive factor determining the success
of a marketing campaign. In previous research [
        <xref ref-type="bibr" rid="ref15 ref16 ref17">15-17</xref>
        ], the authors of this study also explored the
importance of improving advertising strategies. They presented intelligent methods that use semantic
analysis to create targeted advertising content. These methods have demonstrated practical utility by
increasing the effectiveness of advertising and reducing costs. The results of these studies provided
valuable insights and recommendations for effective marketing campaigns specifically tailored to the
higher education sector.
      </p>
      <p>This impact is not limited to social media alone but extends into the realm of search engine
advertising, notably on platforms like Google. Google, with its colossal user base and high-frequency
usage, provides an advantageous arena for brands to engage potential customers. Google Ads, the
platform's advertising service, allows businesses to display ads, product listings, and service offerings
in Google's search engine results. This medium is particularly vital due to its ability to reach users at
the point of search, where the intent to interact or make a purchase is often high.</p>
      <p>As the digital landscape continues to evolve rapidly, businesses are facing the growing need to
automate many of their processes in order to remain competitive. This extends to their marketing efforts
as well, particularly in the creation and optimization of advertising texts. Brands recognize that
compelling ad copy is crucial for capturing audience attention and driving engagement. However, given
the scale of operations and the diverse platforms that marketers operate in, manual creation and</p>
      <p>2020 Copyright for this paper by its authors.
CEUR</p>
      <p>ceur-ws.org
optimization of advertising texts can be time-consuming and less efficient. Therefore, automation in
this area could be a game-changer, enabling brands to achieve better marketing results while optimizing
their resources.</p>
      <p>Generative models, like GPT, present a promising solution for automating the creation of advertising
texts. Leveraging machine learning and natural language processing technologies, these models are
capable of generating high-quality text based on the data they've been trained on. When provided with
a large volume of successful advertising texts, these models can learn the nuances of persuasive and
effective ad copy and produce similar texts automatically. This can significantly reduce the time and
effort involved in creating advertising texts and enable marketers to focus more on strategic tasks.</p>
      <p>This topic is dedicated to the present article, the rest of which is distributed as follows. In section 2,
we review an analysis of related works, section 3 introduces the method of optimizing advertising texts
based on generative models, in section 4 the implementation of the algorithm itself. Section 5 presents
the conclusions of the study.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Related Work</title>
      <p>In order to fully appreciate the significance of the methodology developed in this research, it is
essential to consider the context of related works in the field. Previous research has delved into various
aspects of advertising text generation and optimization, providing invaluable insights and laying the
groundwork for further exploration. This section presents a review of these related works, outlining
their contributions and limitations, and subsequently positioning our research within this existing body
of knowledge.</p>
      <p>
        Articles [
        <xref ref-type="bibr" rid="ref1 ref2 ref3">1, 2, 3</xref>
        ] focus on text analysis and processing. Article [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], authored by Li et al., presents a
joint semantic topic model designed specifically for processing short texts. This model aims to capture
the semantic relationships between topics and words in short texts, enabling more accurate analysis and
understanding of their content. In article [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], Qiao et al. propose a method for keyword detection. The
method utilizes advanced techniques to identify and extract relevant keywords from texts. This
approach aids in improving text categorization, information retrieval, and other text-related tasks. Qian
et al., in article [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], focus on predicting content popularity using deep learning techniques. They develop
an approach that leverages deep learning algorithms to analyze various factors and predict the popularity
of online content. This can be valuable for content creators, marketers, and platforms seeking to
optimize their strategies and engage their target audience effectively..
      </p>
      <p>
        In studies [
        <xref ref-type="bibr" rid="ref11 ref12 ref4 ref5 ref8 ref9">4, 5, 8, 9, 11, 12</xref>
        ], various approaches to text generation are considered. Yang et al. [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]
introduce an approach to text-based steganography using recurrent neural networks. Their work focuses
on embedding hidden information within text, demonstrating the potential of utilizing neural networks
for covert communication. Iqbal and Qureshi [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] provide a comprehensive review of deep learning
models for text generation. They analyze various techniques, including recurrent neural networks
(RNNs), generative adversarial networks (GANs), and transformers, highlighting their strengths and
limitations in generating coherent and meaningful text. Lipa-Urbina et al. [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] propose the use of
SentiGAN, a sentiment-aware generative adversarial network, for generating persuasive messages.
Their research aims to enhance the persuasive impact of generated texts by incorporating sentiment
analysis. Fan et al. [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] investigate text-based game world generation, exploring the use of deep learning
techniques to automatically generate game environments and narratives. Their work focuses on the
application of text generation in the context of interactive storytelling. Tang et al. [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] and Heidar and
Rezagholizadeh [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] contribute to improving text generation using generative adversarial networks
(GANs). They explore techniques to enhance the quality, coherence, and diversity of generated text
through the utilization of GAN architectures.
      </p>
      <p>
        The works of Habib et al. [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] and Huang and Zha [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] utilize NLP technologies and deep learning to
improve writing processes in specific areas: medical recommendations and text resumes respectively.
      </p>
      <p>
        In the study conducted by Kabra et al. [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], the main objective is to automate content generation by
utilizing keywords to generate meaningful and relevant content. This approach aims to streamline the
content creation process and ensure that the generated content aligns with the desired objectives and
messaging.
      </p>
      <p>
        Bulut and Mahmoud [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] have employed the GPT-2 model for generating advertising texts and
keywords. Their research showcases promising results in real advertising campaigns, highlighting the
potential of using advanced language models for advertising purposes. Their work is closely related to
our research as they also focus on advertising content generation.
      </p>
      <p>
        Floridi &amp; Chiriatti [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] analyze the limits of GPT-3 and claim that its capabilities to solve
mathematical, semantic, and ethical issues are limited. This is important for our research as you use
GPT models, but your work is focused on specific applications where these limitations may be less
significant.
      </p>
      <p>
        Although the studies by Kabra et al. [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] and Bulut &amp; Mahmoud [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] have made significant
contributions to the understanding of ad text generation and optimization, our study takes a more
comprehensive approach by analyzing the overall ad content. This goes beyond the simple
keywordbased analysis that was central to their study.
      </p>
      <p>A key advancement in our research is the use of more sophisticated and powerful generative models.
By leveraging the capabilities of these advanced AI tools, we can create more relevant and engaging ad
copy, which ultimately leads to more effective advertising campaigns. Another distinctive feature of
our research is the attention we pay to the quality of the input data. We carefully select and pre-process
the data to ensure that our model is trained on the most successful advertising texts. This ensures that
the generated texts are not only grammatically correct, but also effective in terms of achieving
marketing goals.</p>
      <p>
        Although our study builds on the foundations laid by Kabra et al. [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] and Bulut &amp; Mahmoud [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ],
it extends their work by offering a more detailed analysis of advertising content and providing a
practical, proven methodology for using advanced generative models in advertising.
      </p>
    </sec>
    <sec id="sec-3">
      <title>3. Materials and methods</title>
      <p>Optimizing advertising texts using generative models is a complex process, involving data
collection, model training, and experimentation. This aids in the creation of effective advertising
messages. The developed method for optimizing advertising texts based on generative models broadens
marketing possibilities.</p>
      <p>Thus, the method for optimizing advertising texts based on generative models can be conducted
structurally (Fig.1) and comprises several stages:</p>
      <p>Stage 1. Data collection. Gather a large number of advertising texts from various sources that you
deem successful. Success can be measured using metrics such as the:</p>
      <p>Impressions: This is a measure of the number of times an ad is displayed, regardless of
whether it is clicked on or not. It is an indicator of the reach or exposure of an advertisement.
This metric is usually represented as an absolute number. The higher the number of
impressions, the greater the exposure of the ad.</p>
      <p>CTR (Click-Through Rate): This is the ratio of users who click on a specific link to the
number of total users who view a page, email, or advertisement. It is often used to measure
the success of an online advertising campaign for a particular website as well as the
effectiveness of email campaigns. It is calculated by dividing the number of clicks an ad
receives by the number of impressions and is usually expressed as a percentage. A higher
CTR indicates a more effective ad.
•
•
•
= (</p>
      <p>Average Cost Per Click (CPC): This is a measure of the price paid for each click in a
payper-click (PPC) marketing campaign. It's an important metric as it determines the financial
success of your paid advertising campaigns and how much ROI they generate. It's calculated
by dividing the total cost of your clicks by the total number of clicks.</p>
      <p>=</p>
      <p>Start</p>
      <p>Data collection
Define success criteria</p>
      <p>Collect ad texts</p>
      <p>Data preparation
Remove unnecessary items</p>
      <p>Tokenization
Train a generative model</p>
      <p>Use GPT
Conduct learning epochs</p>
      <p>Generate text
Select keywords or phrases</p>
      <p>Generate new ad copy</p>
      <p>Optimization</p>
      <p>Apply A/B testing
Iteration</p>
      <p>Adjust the model or keywords
Doesn't meet the criteria</p>
      <p>Checking compliance</p>
      <p>Meets the criteria
Output: Final image</p>
      <p>End</p>
      <p>Fig. 1. Algorithm for optimizing advertising texts based on a generative model
•</p>
      <p>View-through rate (VTR): This measures the number of completed views of a video ad to
the number of initial impressions. It's often used in digital advertising to measure the
effectiveness of a video campaign. Like CTR, it is calculated by dividing the number of
complete views by the number of impressions and is usually expressed as a percentage. A
higher VTR indicates that users were interested enough to watch your video until the end.</p>
      <p>By tracking these metrics, it's possible to evaluate the effectiveness of different advertising texts.
This helps in identifying patterns and trends that can be used to optimize future marketing efforts.</p>
      <p>Stage 2. Data preparation. In this stage, the raw advertising texts are processed into a suitable format
that the model can understand and learn from.</p>
      <p>
        2.1. Data Cleaning. The first step is to remove all unnecessary elements from the texts. These could
include URLs, special characters [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ], non-relevant hashtags, etc. This helps to ensure that the
model focuses on the meaningful content of the texts. This process can be performed using various
text preprocessing techniques available in libraries like NLTK or spaCy in Python.
2.2. Tokenization. After the data is cleaned, it needs to be tokenized. Tokenization is the process of
splitting the text into individual words or tokens. These tokens serve as the input for the model.
Tokenization can be done at different levels - you can choose to tokenize at the word level, sentence
level, or even at the character level. The choice of tokenization level would depend on your model
and the problem at hand. In Python, tokenization can be easily done using libraries like NLTK,
spaCy, or even the built-in split() function.
2.3. Numerical Encoding. After tokenization, each token is assigned a unique integer. This
transforms the text data into numerical data that the model can process. This step often involves
building a vocabulary of all unique tokens and assigning each token a unique integer. The result
would be sequences of integers representing your advertising texts.
2.4. Padding. When training a model, all input sequences should be of the same length. But since
texts can vary in length, we perform a process called padding. Padding involves adding zeros to the
shorter sequences until they are the same length as the longest sequence. The resulting sequences
form a matrix that can be fed into the model.
      </p>
      <p>Stage 3. Model training. Model training is the phase where the generative model, such as GPT,
learns from the processed advertising texts. Here's how it works:
3.1. Initialization. Before the training begins, the model is initialized with random weights. These
weights are the parameters that the model will adjust to learn the relationships in the data. In the
case of GPT and other transformer models, there could be millions of these parameters.
3.2. Feed-forward. During training, the model takes in the input data (i.e., the sequences of integers
from the data preparation stage) and performs a series of mathematical operations defined by its
architecture (such as attention mechanisms, activation functions, etc.). At the end of this
feedforward process, the model generates a sequence of outputs, which, at the start of training, are likely
quite different from the desired advertising texts.
3.3. Backpropagation and optimization. The difference between the model's outputs and the actual
data is calculated using a loss function. This loss is then used to adjust the model's weights via a
process called backpropagation, where the gradient of the loss is calculated with respect to each
weight, and the weights are adjusted in the direction that minimizes the loss.
3.4. Iteration: Steps 3.2 and 3.3 are repeated for a large number of iterations (or epochs), gradually
improving the model's ability to generate advertising texts similar to those in the input data. During
this process, it is common to split the data into a training set and a validation set. The training set
is used to adjust the weights, while the validation set is used to gauge the model's performance on
unseen data and prevent overfitting.
3.5. Model selection: After training, it might be useful to test several models or model
configurations to find the best performing one. This is typically done using metrics such as
precision, recall, F1-score, etc., on a separate test set not used during training.</p>
      <p>The result of this training process is a model that can generate new sequences of tokens similar to
the advertising texts it was trained on.</p>
      <p>Stage 4. Text generation. After successful training of the model, it's time to generate new advertising
texts. The process generally involves feeding the model with some seed text or keywords related to the
product or service being advertised. The model uses this input to generate contextually relevant text.
Mathematically, this corresponds to feeding the model's input layer with a sequence of integers (tokens),
and the model produces a probability distribution over the possible next tokens.</p>
      <p>Stage 5. Optimization: To ensure the quality and effectiveness of generated texts, optimization
techniques are applied. A common method is A/B testing, where two versions of the ad (A and B) are
shown to different subsets of users. The ad that achieves a better response, as measured by metrics such
as click-through rate (CTR), conversions, or user interactions, is selected. In mathematical terms, if p_A
and p_B represent the probability of success (e.g., a click or a conversion) for ads A and B, we would
choose ad A if p_A &gt; p_B, and ad B otherwise. Further tuning of the model might also be performed
based on these tests, which could involve adjusting the model's hyperparameters or re-training it with
new data.</p>
      <p>Stage 6. Iteration: The process doesn't end after a single cycle. As marketing campaigns progress,
new data can be collected, and the model can be updated or fine-tuned with this data. The input
keywords or seed texts can also be modified to align with the changing marketing strategies. By
repeating this process, businesses can ensure continual improvement in the quality of the generated
advertising texts, leading to better user engagement and higher returns from advertising campaigns.</p>
      <p>The algorithm (see Fig. 1) begins with the data collection phase, where criteria are defined and texts
are gathered. Following this is the data preparation phase, where unwanted elements are removed and
tokenization is conducted. The next step is to train the model, using models such as GPT, and
conducting training epochs. Afterwards, text generation occurs, selecting keywords for generating the
texts. Optimization involves the application of A/B testing and model tuning. Finally, the generation
process is iterated, repeating the steps for further optimization and model improvement.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Experimental Results and Discussion</title>
      <p>To implement the developed algorithm (Fig. 1) for optimizing advertising texts based on generative
models, we have chosen the free programming language Python and open libraries such as LangChain,
OpenAI, Streamlit, and FAISS. The LangChain library is needed to connect the GPT-3.5 language
model with our data. OpenAI, in turn, is used to convert part of the SCV file into vectors. The powerful
FAISS library is used to create a vector store that stores vector representations of CSV data. And the
Streamlit library provides tools for creating a user interface for the chatbot. It allows users to input and
send their queries to the chatbot.</p>
      <p>Next, we will briefly demonstrate the steps of our chatbot operation (Fig. 2). First, the user enters
the OpenAI API key, after which he uploads the CSV file, on the basis of which the chatbot will be
based. If the user has uploaded a CSV file, it is processed using the CSVLoader class from LangChain.
The CSV file is broken down into unique lines.</p>
      <p>Parts of the CSV file obtained after splitting are converted into vectors using OpenAI embeddings.
These vectors then represent an index based on the content of each line of the given file. A vector
storage (FAISS) is created from the documents obtained after embedding.</p>
      <p>Next, a ConversationalRetrievalChain is added, providing it with the necessary chat model (e.g.,
gpt-3.5-turbo) and FAISS vector storage that stores our file converted into vectors via
OpenAIEmbeddings(). This chain allows for a chatbot with memory, using the vector storage to find
relevant information from our dataset.</p>
      <p>This all operates within a previously created user interface using Streamlit. When a user enters a
query, it is passed to the conversational_chat function, which generates the chatbot's response. This
function feeds the user's query and conversation history into the ConversationalRetrievalChain, which
generates the chatbot's response. The chatbot's responses and the user's messages are displayed in the
user interface.</p>
      <p>Fig. 2. The process of chatbot operation using OpenAI API and a CSV file</p>
      <p>This comparative experiment was designed to assess the effectiveness of the proposed method of
text generation in a real-world setting. Google's advertising platform was chosen for the experiment due
to its widespread use and significance in the digital advertising sphere.</p>
      <p>Variant 4, as presented in Figure 2, was selected for the experiment because it best aligns with
Google's character limit for contextual advertising. This decision was based on our aim to ensure that
the generated advertisement would be compatible with Google's guidelines and standards.</p>
      <p>In this experiment, the first variant of advertising, depicted in Figure 3.A, was created following
general rules for crafting advertisements in Google's platform. These rules incorporate a variety of best
practices and recommendations in creating engaging and effective advertisements, including relevance
to the product or service, compelling call-to-action, usage of keywords, and compliance with Google's
editorial guidelines.</p>
      <p>А. Попередня версія
В. Сформовано на основі методу</p>
      <p>Fig. 3. Advertisement for bag sales in Google</p>
      <p>Table 1 presents a comparative analysis of the performance indicators of two advertising campaigns
- one based on general advertising principles and one developed using the proposed text generation
method.</p>
      <p>The first advertising campaign with textual content ran from March 1, 2023, to March 31, 2023 (as
shown in Figure 3.A). The goal of this campaign was to establish a baseline of performance using
traditional advertising methods. During this period, the ads were shown to users and various metrics
such as number of impressions, click-through rate (CTR), average cost per click, and viewability were
measured to assess the overall effectiveness and efficiency of the campaign, allowing for an overall
assessment of the campaign's performance.</p>
      <p>Then, from April 1, 2023, to April 30, 2023, an advertising campaign was run using the textual
content generated by the proposed method (as shown in Figure 3.B). This campaign was essentially a
test run of our proposed method, where advertising text was generated using trained generative models.
The effectiveness of this campaign was also evaluated using the same metrics as the previous one.</p>
      <p>In the context of our research, we examined several key metrics to evaluate the effectiveness of the
proposed method. Let's analyze the changes in these indicators as presented in Table 1:
• Impressions: This metric increased by 2,200 from March to April, indicating an increase in
advertisement visibility or traffic. This is a positive trend since more impressions usually lead to a
greater number of clicks and potential sales.</p>
      <p>Change
• CTR (Click-Through Rate): It increased by 0.06%, from 0.11% to 0.17%. This means that more
people are clicking on your advertisements when they see them, which is a good sign.</p>
      <p>• Average Cost Per Click: The cost per click decreased from 0.17 UAH to 0.11 UAH. This can be
positive if this price decrease did not impact the quality of traffic or sales.</p>
      <p>• View Rate: The rate has significantly increased - from 4.27% to 10.8%, indicating an increase in
the number of people who viewed or interacted with the advertisement. This is a very positive change
that shows greater user interaction with the advertisement. Overall, these data point to an improvement
in the effectiveness of your advertising campaign in April compared to March.</p>
      <p>The dataset gathered during the period of the research provides strong evidence in favor of the
proposed method for advertising text optimization. The fact that these improvements were observed in
just one month (from March to April) hints at the potential for even greater effectiveness with continued
use and refinement of this approach.</p>
      <p>Summarizing the results, the method demonstrates its ability to effectively increase ad visibility,
with a significant increase of 2,200 impressions. This can directly contribute to better brand recognition,
an expanded customer base, and a larger market share. Although a seemingly minor improvement, the
0.06% increase in CTR indicates the content's effectiveness in capturing users' attention and generating
interest. Even small increments in this metric can lead to a substantial rise in user engagement levels.
The average cost-per-click decreased from 0.17 UAH to 0.11 UAH, highlighting improved economic
efficiency. The method not only produces effective content but also does so in a more cost-effective
manner. This can directly result in higher return on ad spend (ROAS), a crucial aspect of any successful
advertising campaign. Lastly, the view-through rate increased from 4.27% to 10.8%, providing
evidence of enhanced interaction and engagement fostered by the new ad texts. This is a critical factor
in the marketing domain as it directly influences conversion rates.</p>
      <p>
        The achievements of this work become more evident when compared to related works such as those
of Kabra et al. [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] and Bulut &amp; Mahmoud [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. Unlike these studies, which focus primarily on keyword
analysis, our research takes a broader perspective, analyzing the overall ad content. Furthermore, while
previous studies have explored the application of machine learning models for advertising, our research
employs more advanced generative models. These models are designed to generate high-quality
advertising texts, a novel approach that sets our work apart from existing research in the field.
      </p>
    </sec>
    <sec id="sec-5">
      <title>5. Conclusions</title>
      <p>During this study, we developed a method for optimizing advertising texts using generative models,
specifically leveraging the power of models such as GPT. Our approach centered on the utilization of a
large corpus of successful advertising texts, primarily sourced from social networks. These texts
provided the training data necessary for the models to learn, understand, and subsequently generate
new, high-quality advertising content.</p>
      <p>The application of this method in a real-world advertising campaign from March to April 2023
provided evidence of its effectiveness, as reflected in improved metrics across all categories.
Impressions: There was an increase of 2,200 impressions, signaling that the advertisements were visible
to a larger audience. This increase in visibility is crucial in the digital advertising landscape, as it often
corresponds to an increased chance of user interaction and potential conversion. Click-Through Rate
(CTR): The CTR, an important indicator of audience engagement, increased by 0.06%. This suggests a
higher percentage of individuals were enticed to click on the ad after seeing it, marking an improvement
in audience interaction. Average Cost Per Click (CPC): Economically, the method proved to be more
efficient as well. The average cost per click decreased from 0.17 UAH to 0.11 UAH, reducing the
financial resources required for each user interaction. View-Through Rate (VTR): Finally, the
viewthrough rate saw a significant jump from 4.27% to 10.8%, demonstrating an increased level of user
engagement with the advertisement.</p>
      <p>The compilation of these indicators points towards the successful implementation of the advertising
strategy based on our proposed method. It shows that the usage of generative models in creating and
optimizing ad content can enhance advertising efficiency, making ads more visible, engaging, and
costeffective.</p>
      <p>Despite these promising results, the research is not yet complete. Future work will focus on
developing more precise performance metrics, refining our model, and adapting the method for a more
global reach, across various languages and cultural contexts. This will ensure a more comprehensive
and versatile approach to optimizing advertising texts using AI-based models.
6. References</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhang</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chi</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Ouyang</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2018</year>
          ).
          <article-title>Filtering out the noise in short text topic modeling</article-title>
          .
          <source>Information Sciences</source>
          ,
          <volume>456</volume>
          ,
          <fpage>83</fpage>
          -
          <lpage>96</lpage>
          . https://doi.org/10.1016/j.ins.
          <year>2018</year>
          .
          <volume>04</volume>
          .071
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Qiao</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , Zhang, J.,
          <string-name>
            <surname>Wei</surname>
            ,
            <given-names>Q.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>Finding competitive keywords from query logs to enhance search engine advertising</article-title>
          .
          <source>Information &amp; Management</source>
          ,
          <volume>54</volume>
          (
          <issue>4</issue>
          ),
          <fpage>531</fpage>
          -
          <lpage>543</lpage>
          . https://doi.org/10.1016/j.im.
          <year>2016</year>
          .
          <volume>11</volume>
          .003
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Qian</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Xu</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liu</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ling</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jiang</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chai</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Liu</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          (
          <year>2022</year>
          ).
          <article-title>Popularity prediction for marketer-generated content: A text-guided attention neural network for multi-modal feature fusion</article-title>
          .
          <source>Information Processing &amp; Management</source>
          ,
          <volume>59</volume>
          (
          <issue>4</issue>
          ), 102984. https://doi.org/10.1016/j.ipm.
          <year>2022</year>
          .102984
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Yang</surname>
            ,
            <given-names>Z.-L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Guo</surname>
            ,
            <given-names>X.-Q.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>Z.-M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Huang</surname>
            ,
            <given-names>Y.-F.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Zhang</surname>
          </string-name>
          , Y.-J. (
          <year>2019</year>
          ).
          <article-title>RNN-Stega: Linguistic Steganography Based on Recurrent Neural Networks</article-title>
          .
          <source>IEEE Transactions on Information Forensics and Security</source>
          ,
          <volume>14</volume>
          (
          <issue>5</issue>
          ),
          <fpage>1280</fpage>
          -
          <lpage>1295</lpage>
          . https://doi.org/10.1109/tifs.
          <year>2018</year>
          .2871746
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Iqbal</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Qureshi</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>The survey: Text generation models in deep learning</article-title>
          .
          <source>Journal of King</source>
          Saud University - Computer and Information Sciences. https://doi.org/10.1016/j.jksuci.
          <year>2020</year>
          .
          <volume>04</volume>
          .001
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Habib</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Faris</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Qaddoura</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Alomari</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Faris</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>A Predictive Text System for Medical Recommendations in Telemedicine: A Deep Learning Approach in the Arabic Context</article-title>
          .
          <source>IEEE Access</source>
          ,
          <volume>9</volume>
          ,
          <fpage>85690</fpage>
          -
          <lpage>85708</lpage>
          . https://doi.org/10.1109/access.
          <year>2021</year>
          .3087593
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>Huang</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Zha</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>A Generative Text Summarization Model Based on Document Structure Neural Network</article-title>
          .
          <source>У Applied Intelligence and Informatics (с. 176-187)</source>
          . Springer International Publishing. https://doi.org/10.1007/978-3-
          <fpage>030</fpage>
          -82269-9_
          <fpage>14</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Lipa-Urbina</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Condori-Fernandez</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Suni-Lopez</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>Towards an Automatic Generation of Persuasive Messages</article-title>
          .
          <source>У Persuasive Technology (с. 55-62)</source>
          . Springer International Publishing. https://doi.org/10.1007/978-3-
          <fpage>030</fpage>
          -79460-
          <issue>6</issue>
          _
          <fpage>5</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Fan</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Urbanek</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ringshia</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dinan</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Qian</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Karamcheti</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Prabhumoye</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kiela</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rocktaschel</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Szlam</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Weston</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>Generating Interactive Worlds with Text</article-title>
          .
          <source>Proceedings of the AAAI Conference on Artificial Intelligence</source>
          ,
          <volume>34</volume>
          (
          <issue>02</issue>
          ),
          <fpage>1693</fpage>
          -
          <lpage>1700</lpage>
          . https://doi.org/10.1609/aaai.v34i02.
          <fpage>5532</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Kabra</surname>
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Solsi</surname>
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jaiswal</surname>
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sankhe</surname>
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Daiya</surname>
            <given-names>V.</given-names>
          </string-name>
          (
          <year>2022</year>
          )
          <article-title>Automated Content Generation System Using Neural Text Generation</article-title>
          . In:
          <string-name>
            <surname>Jacob</surname>
            <given-names>I.J.</given-names>
          </string-name>
          , Kolandapalayam Shanmugam S.,
          <string-name>
            <surname>Bestak</surname>
            <given-names>R</given-names>
          </string-name>
          . (eds) Data Intelligence and
          <string-name>
            <given-names>Cognitive</given-names>
            <surname>Informatics</surname>
          </string-name>
          .
          <source>Algorithms for Intelligent Systems</source>
          . Springer, Singapore. https://doi.org/10.1007/
          <fpage>978</fpage>
          -981-16-6460-1_
          <fpage>63</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Tang</surname>
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Li</surname>
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhao</surname>
            <given-names>W.X.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wen</surname>
            <given-names>JR</given-names>
          </string-name>
          .
          <article-title>(2021) Generating Long and Coherent Text with MultiLevel Generative Adversarial Networks</article-title>
          . In: U L.H.,
          <string-name>
            <surname>Spaniol</surname>
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sakurai</surname>
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chen</surname>
            <given-names>J</given-names>
          </string-name>
          . (eds)
          <article-title>Web and Big Data</article-title>
          .
          <source>APWeb-WAIM 2021. Lecture Notes in Computer Science</source>
          , vol
          <volume>12859</volume>
          . Springer, Cham. https://doi.org/10.1007/978-3-
          <fpage>030</fpage>
          -85899-
          <issue>5</issue>
          _
          <fpage>4</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Haidar</surname>
            <given-names>M.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rezagholizadeh</surname>
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2019</year>
          )
          <article-title>TextKD-GAN: Text Generation Using Knowledge Distillation and Generative Adversarial Networks</article-title>
          . In: Meurs MJ.,
          <string-name>
            <surname>Rudzicz</surname>
            <given-names>F</given-names>
          </string-name>
          . (eds) Advances in Artificial Intelligence.
          <source>Canadian AI 2019. Lecture Notes in Computer Science</source>
          , vol
          <volume>11489</volume>
          . Springer, Cham. https://doi.org/10.1007/978-3-
          <fpage>030</fpage>
          -18305-
          <issue>9</issue>
          _
          <fpage>9</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Bulut</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Mahmoud</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2023</year>
          ).
          <article-title>Generating Campaign Ads &amp; Keywords for Programmatic Advertising</article-title>
          . IEEE Access.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Floridi</surname>
          </string-name>
          , Luciano and Chiriatti, Massimo, GPT‐3
          <string-name>
            <surname>: Its</surname>
            <given-names>Nature</given-names>
          </string-name>
          , Scope, Limits, and
          <string-name>
            <surname>Consequences</surname>
          </string-name>
          (November 1,
          <year>2020</year>
          ). Available at SSRN: https://ssrn.com/abstract=3827044
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <surname>Lipyanina</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          , et al. (
          <year>2020</year>
          ).
          <article-title>Decision tree based targeting model of customer interaction with business page</article-title>
          .
          <source>CMIS</source>
          ,
          <fpage>1001</fpage>
          -
          <lpage>1012</lpage>
          . Retrieved from https://ceur-ws.
          <source>org/</source>
          Vol-
          <volume>2732</volume>
          /20200487.pdf
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>Lipyanina</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sachenko</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Lendyuk</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>Targeting Model of HEI Video Marketing based on Classification Tree</article-title>
          .
          <source>ICTERI Workshops</source>
          ,
          <volume>2732</volume>
          ,
          <fpage>487</fpage>
          -
          <lpage>498</lpage>
          . Retrieved from https://ceurws.org/Vol-
          <volume>2732</volume>
          /20200487.pdf
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <surname>Lipianina-Honcharenko</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lendiuk</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sachenko</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Osolinskyi</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zahorodnia</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Komar</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2022</year>
          ).
          <article-title>An intelligent method for forming the advertising content of higher education institutions based on semantic analysis doi</article-title>
          :
          <volume>10</volume>
          .1007/978-3-
          <fpage>031</fpage>
          -14841-5_
          <fpage>11</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shakhovska</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sachenko</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Komar</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <article-title>A new approach for missing data imputation in big data interface</article-title>
          .
          <source>Information Technology and Control</source>
          ,
          <year>2020</year>
          ,
          <volume>49</volume>
          (
          <issue>4</issue>
          ), pp.
          <fpage>541</fpage>
          -
          <lpage>555</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>