Road accidents cause a large number of deaths and injuries every year. Creation of intelligent tools for preventing traffic accidents by monitoring the physiological state of the driver is an important step toward improving road safety. The paper proposes methods and tools to warn drivers about their physiological state dangerous for driving. This uses the sensory capabilities of modern wearable mobile devices, namely smart watches and bracelets. The method of notifying drivers of dangerous driving conditions includes the following steps: collecting realtime data from the driver of the vehicle using a mobile device worn by the driver; determining whether real-time data indicates hazardous driving conditions; informing the driver if real-time data indicate dangerous driving conditions. Real-time data can also be collected and used to study driver characteristics. These characteristics can be compared with previously collected data to help determine in real time whether the driver's behavior is normal and whether there is a dangerous situation. It is important to use serial wearable mobile devices with different types of data that are normalized before processing. Road accident prevention, intellectual tools, wearable mobile devices, smart watches, 01.01.2021 to 30.11.2021 there were 170972 road accidents in which 2926 people died and 27296
bracelets, monitoring the driver's physiological state.
On average, about 10 people die on the roads of Ukraine every day [
During 2021, 11,744 road accidents were registered in the Lviv region, 228 people died and 2,419
were injured [
The National Highway Traffic Safety Administration (NHTSA) estimates that in 2017, 91,000
police-reported crashes involved drowsy drivers. These crashes led to an estimated 50,000 people
injured and nearly 800 deaths in the United States [
This number of accidents leads to negative socio-economic consequences. Increasingly, this is due
to the human factor - driving fatigue, lack of sleep and falling asleep behind the wheel, illness, as well
as driving under the influence of alcohol [
2022 Copyright for this paper by its authors. the limits beyond which the functional state of the driver can no longer satisfy safe driving. The impact of the human factor is especially great when it comes to public transport drivers, as their critical functional state can endanger the lives and health of many people. Therefore, constant monitoring of the functional state of the driver will increase safety and reduce mortality and injuries on the roads.
People want to avoid car accidents, including those caused by their own physiological state, which can negatively affect their successful driving. Insurance companies would also like to have the tools to obtain a more reliable driver risk profile.
Modern driving efficiency tracking technology is usually based on data collected from the car. See,
for example [
In addition, since the information is collected through the vehicle itself, the data only applies to the movement and operation of the vehicle.
Therefore, methods and means of monitoring the physiological state of drivers themselves and warning drivers in the event of potentially dangerous situations would be desirable.
Although it is assumed that the operation of the vehicle is a direct result of the driver's actions, there are many factors related to driving safety that cannot be taken into account. For example, distraction, drowsiness, stress, shortness of breath, dizziness, fever, etc. can affect the driver in such a way that the car-based system will not notice them. It is desirable to be able to detect such situations and warn drivers of any potential dangers.
The proposed intelligent tools of preventing traffic accidents by monitoring the physiological state of the driver provide warning to drivers about dangerous driving conditions. They use the touch capabilities of wearable mobile technology, such as smart watches, to inform the driver in real time based on the data collected. The method of warning drivers about dangerous driving conditions proposed in the work includes the following steps: collecting real-time data from the driver of the vehicle (data is collected using a mobile device worn by the driver); determining whether real-time data indicates hazardous driving conditions; informing the driver if real-time data indicate dangerous driving conditions.
Real-time data can also be collected and used to study driver characteristics. These characteristics can be compared with the data collected to help determine in real time whether the driver's behavior is normal and whether there is a dangerous situation.
As noted above, there is a need for technology, based on monitoring the physiological state of the driver to warn drivers of potentially dangerous situations. This technology would collect data from the driver himself and not from the vehicle he / she is driving. For example, as will be described in detail below, there are indicators of stress, fatigue, physiological disorders, difficulty breathing, dizziness, fever and so on. These figures can be obtained from data collected from the driver, which may not be obvious at the level of vehicle operation.
The proposed tools use the capabilities of new technology of wearable devices to obtain data from the driver and the introduction of informing the driver about dangerous driving conditions. As will be described in detail below, wearable devices include a variety of sensors capable of collecting a huge amount of data from the user. In addition, drivers can wear wearable devices daily, including while driving. By comparison, a smartphone, for example, is often worn as an accessory and is remote from the driver when he / she is driving. In addition, the wearable device is usually worn on the user's wrist.
The proposed wearable devices are used to collect (real-time) data on the physiological state of the driver and to provide him with real-time warnings about potentially dangerous situations.
In addition to data on the physiological state of the driver, other important data may be collected, in particular, data on hand movements, and driving speed (e.g. detected by GPS positioning device of the wearable device, etc.). Therefore, the proposed tools can be used to notify the driver (using a wearable device and / or other available communication technology) about the need to slow down, the need for rest, call a doctor, etc.
The structure of the driver's physiological state monitoring system is shown in Fig.1. The system operates in two ways to handle and alert the driver to critical changes in health. The first involves the connection between the wearable device and the smartphone. Processing and analysis of indicators in this case takes place on a smartphone and is based on preliminary data and analysis algorithms available at the time of measurement. This approach is needed when there is no possibility of constant access to the Internet. The use of this method is required for the driver to respond independently to his state of health and well-being.
The second type adds a server part to the system. Thanks to this combination, it is possible to save data not only on the local device of the driver; backup data; in-depth data analysis and continuous improvement of algorithms, as the server resource is much higher than in the smartphone. As well as a notification system for persons or organizations related to the driver.
Both methods involve fulfilling their main task - monitoring the critical performance of the driver and instantaneous response to their change.
It is assumed that wearable devices will include a number of sensors for health analysis. Among the most common indicators that are already collected thanks to modern devices are heart rate, ECG, skin temperature, pressure, and saturation (Fig. 2).
Their collection is carried out in parallel and independently, which allows a comprehensive approach to the assessment of the driver's health.
Examples of wearable devices are smart watches, fitness bracelets, and more.
Smart watches that can be used according to these technologies are available from companies such as Motorola™ (for example, MOTO 360), Samsung™ (for example, Samsung Gear™), Apple™ (for example, Apple Watch™), Garmin (for example, Garmin Vivo Active™) etc.
The following is a non-exhaustive list of smartwatch features that can be used to monitor a driver's physiological state. Different smart watches (or other suitable technology for wearing) have different capabilities: different sensors, and interactive user functions (such as voice commands, beeps / traffic signals, etc.). As an example, some smart watch technologies that can be used in the proposed tools include the following. 5.1.
A smartwatch uses one or more sensors located on the driver's body that can measure his
physiological state. These sensors usually require contact with the driver's body to perform their
functions, and are therefore called contact sensors. For example, one such contact sensor is an
electrodermal activity sensor or EDA sensor, the use of which in mobile devices is described in [
More specifically, based on the sweat gland circuit, the EDA measures the strength of the change in skin's conductivity to electrical charge as a reflection of the sympathetic nervous system's response to sensation. This change is due to the activity of the eccrine sweat glands, which are innervated by the sympathetic branch of the autonomic nervous system. Reactions cannot be controlled instantly by the mind, so measurements reliably record the stress caused by external stimuli.
EDA data are classified as a tonic - low-amplitude, low-frequency waveforms, typical in the relaxed state, or phase - high-amplitude and high-frequency waveforms that occur 1-3 seconds after sensory stimulation. This phase measurement is a skin conductivity reaction (SCR). Sensory stimuli can be auditory, visual, olfactory, tactile, or vestibular (vertigo, imbalance).
In the context of this technique, EDA sensors can be used to collect real-time data that indicate the driver's stress level, for example, the driver is in a relaxed state or a state of high anxiety / stress.
For example, based on the above sensory stimulus, the driver may be under stress when he / she drives aggressively, is in an accident, or witnesses an accident or other dangerous situation on the road (for example, other motorists drive incorrectly or exceed speeding, slippery road, garbage on the road, etc.) - based on the above-described sensory stimulus.
Other contact sensors useful in this technique include heart rate monitors and heart rate sensors [
As for modern methods, the driver's heart rate can be an indicator of stress. As described above, driver stress can be caused by his driving condition and / or the condition of others, road conditions and hazards, and so on. These vital indicators are also indicators of disorders, such as when the driver has a disease such as heart failure. It is assumed that under normal driving conditions the user will have a constant pulse. Thus, sudden changes (jumps or decreases) in the driver's heart rate can be indicators of dangerous driving conditions.
In addition, the pulse oximeter measures the level of oxygen in human blood by determining the pulmonary physiological characteristics of the person, which are indicators of such disorders as shortness of breath, dizziness and the like. That is, the departure of these characteristics beyond safe limits means an immediate threat to driving safety. 5.3.
information for analysis. temperature you can detect fever.
Also wearable devices may include human body temperature sensors [
When contact measurement of skin temperature, it is about 24 ° C, i.e. very different from body temperature. It should be noted that, as a rule, skin temperature changes according to changes in human body temperature.
Measuring a person's temperature can detect states of hypothermia and hyperthermia. Hypothermia (low temperature) can indicate a stroke, nervous system damage, alcohol and drug use, septic condition, liver and gallbladder dysfunction, and so on.
Hyperthermia (fever) can indicate food poisoning, blood diseases, chronic inflammation in the body, internal bleeding and more.
The departure of human body temperature from safe limits does not mean an immediate threat to driving safety. But in combination with other characteristics of the human body can provide more
For example, high heart rate and low body temperature often mean hypothermia, but with high body National EWS (NEWS). records and warn the driver. criticality level (see Table 2).
After receiving periodic data sent from all sensors, the critical event detection algorithm must analyze them in real time and alert the driver in case of an emergency. To check for abnormal situations, it is recommended to use the Early Warning Score manual (EWS).
EWS is a guide based on vital signs, such as , and it is used to monitor the level of criticality of the functional state of the human body. For each vital sign ∈ , the collected record ∈ is compared with the normal range for calculating the estimate between 0 and 3; 0 means a normal record, where other values indicate abnormal situations with increasing severity relative to the increase in score. Therefore, for the set of records of
= [ 1, 2, ⋯ , ] is calculated.
the most widely used EWS manuals, developed in the UK and distributed worldwide, and is called
After calculating the scores set for each period, it is suggested to directly analyze the collected
For example, if the set score calculated during the period is
= [
0
To ensure the functioning of the warning system about the dangerous state of the driver, you can use
the monitoring tools described in [
After initialization, the application enters the mode of continuous data acquisition from the wearable device. The data obtained from wearable devices from different manufacturers differ in presentation format, so they must be reduced to a universal format. Then the data is clustered according to a given table of criteria.
If all the data is in satisfactory condition, then nothing happens. If there is data in other groups, an integrated assessment of the deviation from the norm is calculated. If the integrated assessment is critical, the driver is immediately informed by light and sound signals to draw the driver's attention to the critical state of the indications of the functional state of his body. In the threatening case, a message is displayed on the screen about the deviation of the readings of the functional state of the driver's body.
In our opinion, continuous monitoring of health will soon become one of the leading areas of health care. The proposed solution relates to this area and may have an immediate technological and social impact to assist health and public care systems in preventing accidents by monitoring the driver's physiological state and alerting him to threatening or critical conditions.
We have developed intellectual tools that warn drivers about their physiological states that are dangerous to drive. The intellectual tools are based on wireless devices and are designed to monitor the driver's physiological state while driving. The driver’s physiological state is estimated on the continuous analysis of the following parameters: the oxygen level in the blood, pulse frequency, and temperature. These data from the smart devices wirelessly connected to the driver’s smartphone will be processed. The results of processing data are shown to the driver. The monitoring system includes two components: a sensor network of wireless smart sensors and a linked smartphone with a special mobile application.
Optionally, implemented in the mobile application algorithms process results of monitoring, avoiding duplicates, and store them for future usage on the server. It allows a better representation of driver’s indicators and the ability to overview his indicators history which is highly important for insurance companies and doctors.
To check for abnormal situations, we used the Early Warning Score manual. After calculating the scores set for each period, it is suggested to directly analyze the collected records and warn the driver. Dependence of the level of criticality and recommendations on the overall assessment of vital signs of the driver’s state is also proposed. 9. References