Accurate energy consumption prediction is crucial for optimising the operation of electric commercial heavy-duty vehicles, particularly for eficient route planning, refining charging strategies, and ensuring optimal truck configuration for specific tasks. This study investigates the application of multi-task curriculum learning to enhance machine learning models for forecasting the energy consumption of various onboard systems in electric vehicles. Multi-task learning, unlike traditional training approaches, leverages auxiliary tasks to provide additional training signals, which has been shown to enhance predictive performance in many domains. By further incorporating curriculum learning, where simpler tasks are learned before progressing to more complex ones, neural network training becomes more eficient and efective. We evaluate the suitability of these methodologies in the context of electric vehicle energy forecasting, examining whether the combination of multi-task learning and curriculum learning enhances algorithm generalisation, even with limited training data. We primarily focus on understanding the eficacy of diferent curriculum learning strategies, including sequential learning and progressive continual learning, using complex, real-world industrial data. Our research further explores a set of auxiliary tasks designed to facilitate the learning process by targeting key consumption characteristics projected into future time frames. The findings illustrate the potential of multi-task curriculum learning to advance energy consumption forecasting, significantly contributing to the optimisation of electric heavy-duty vehicle operations. This work ofers a novel perspective on integrating advanced machine learning techniques to enhance energy eficiency in the exciting field of electromobility.
Predicting energy consumption for electric vehicles (EVs), especially those used in commercial heavy-duty contexts, is paramount for improving their operational eficiency and promoting sustainability. Efective energy consumption forecasts are indispensable for strategic route planning, optimising charging protocols, and ensuring that vehicle configurations align well with specific operational demands. As electric vehicles gain traction as a viable and ecofriendly alternative to internal combustion engine vehicles, the importance of precise energy consumption predictions becomes increasingly pronounced. The challenges in this domain are multifaceted, stemming from the inherent variability in driving conditions, vehicle load, and diverse environmental factors, which collectively complicate the development of accurate predictive models. Overcoming these obstacles is essential not only for enhancing the reliability and performance of EVs but also for minimising operational costs and boosting the overall eficiency of electric transport systems.
The transition to electric vehicles is a significant step towards reducing greenhouse gas emissions and achieving sustainable transportation goals. However, since limited energy storage puts unique constraints on which operations are feasible, the benefits of EVs can only be fully realised through the development of specified forecasting methods that accurately anticipate energy needs. In this context, AI and ML emerge as transformative tools. AI-driven models can analyse vast amounts of data to uncover patterns and relationships that are not immediately apparent, providing more accurate and reliable energy consumption forecasts. These models can adapt to new data, continuously improving their predictions over time.
Nevertheless, energy consumption forecasting for EVs faces critical challenges, such as dynamic driving conditions and fluctuating loads, which makes even state-of-the-art methods struggle to handle complex real-world data efectively. While the potential to learn from historical data and identify trends that influence energy consumption is the biggest strength of ML-based approaches, it is crucial to develop robust models that can generalise well across diferent scenarios and vehicle types.
The complexity and variability inherent in forecasting energy consumption for electric vehicles make it a relevant testing ground for cutting-edge modelling techniques that promise to handle diverse and dynamic data inputs. In particular, Multi-Task Learning (MTL) presents a compelling solution by enabling simultaneous training across multiple related tasks, thereby leveraging shared information to improve the predictive performance of each task. In contrast, training machine learning models in a traditional setting only utilize the target task. MCL is particularly beneficial in scenarios with limited training data, as it enhances generalisation by incorporating auxiliary tasks that provide additional training signals. Moreover, the eficacy of MTL can be further amplified by integrating curriculum learning (CL), which structures the learning process in a progressive manner. Curriculum learning organises tasks from simple to complex, allowing the model to build a robust foundation before tackling more challenging problems. By combining these methodologies into multi-task curriculum learning (MCL), we can eficiently train neural networks that not only perform better on individual tasks but also generalise more efectively across diferent contexts. MCL optimises the learning trajectory, ensuring that simpler tasks enhance the model’s capability to learn more complex ones, ultimately leading to more accurate and reliable energy consumption forecasts for electric heavy-duty vehicles. This integrative approach has been shown to be a potent strategy to address the multifaceted challenges in several domains but has not been applied to EV auxiliary energy forecasting before. Thus, this paper aims to evaluate the suitability of MCL in this real-world, complex scenario.
Generating a set of auxiliary tasks is a critical step in the implementation of MCL – and how to do it for forecasting energy consumption in EVs requires experimental evaluation. To create auxiliary tasks, one must first obtain an understanding of the primary task, identifying key factors and variables that influence energy consumption and the types of patterns that are indicative of future behaviour. These factors often include vehicle load, driving speed, route characteristics, weather conditions, and driver behaviour. Each of these variables can serve as the basis for an auxiliary task. For instance, an auxiliary task might involve predicting the impact of vehicle load on energy consumption under diferent trafic conditions or estimating the efect of varying driving speeds on battery usage. Historical data from real-world vehicle operations can be mined to extract relevant patterns and correlations, which can then be used to define these auxiliary tasks. In this paper, we have decided to focus on the patterns within the forecasted value itself instead of exploiting multivariate vehicle signals. In particular, we define several types of energy consumption characteristics as targets for the auxiliary tasks, such as questioning whether the consumption in the next time frame exceeds the global mean, whether the consumption will be higher in the next time frame compared to the current consumption, or predicting the consumption diference between the start and the end of the next time frame. These tasks are general enough to be suitable for any forecasting task, while at the same time being suficiently closely related to the actual primary task to, hopefully, provide useful information to boost the training process.
The core contribution of this paper is the evaluation of applying several multi-task curriculum learning techniques for forecasting the energy consumption of heavy-duty electric vehicles, including the proposition of utilising key consumption characteristics as targets for generating auxiliary tasks for MCL. Comparison of MCL variations, with combinations of curriculum learning strategy (sequential learning and progressive continual learning) and auxiliary tasks, illustrates the improvements in the performance on a real-world data collected from normal operations of commercial transportation electric vehicles. The experimental results show progressive continual learning, with a logistic growth weighting function governing the learning balance between the primary and the auxiliary task, achieves the best performance; the result also shows that the first auxiliary task is the most helpful task for subsystems 1 and 4; the third auxiliary task is the most helpful task for subsystems 2 and 3. Furthermore, it is observed that MCL with the proposed auxiliary tasks can improve the learning eficiency of the model, achieving faster convergence to a point beyond which the gain from further training is limited.
Curriculum learning enables the training of machine learning models in a meaning order,
from easy samples to sets of dificult and complex samples [
For a given primary learning task , we create a set of auxiliary tasks , where corresponds to the primary task (in our case, the forecasting of energy consumption for the -th auxiliary subsystem in an electric truck), and corresponds to the -th type of auxiliary task.
The majority of the multi-task learning studies aim to learn all relevant tasks together to improve the performance for each task . In our study, we are only interested in improving the energy forecasting tasks , not the generated auxiliary tasks . All energy forecasting tasks and the auxiliary tasks are learned from the same dataset, multi-variate time series sensor readings were collected from the normal operations of several heavy-duty electric vehicles.
Let us denote data of the multivariate time series x of each vehicle by = { , | = 1, 2, ..., (), = 1, 2, ..., }, where , is the value of the -th feature x given a vehicle/trajectory at time , and () corresponds to the end of the recording. A subset of the features , reflects the energy consumption of subsystem at time . The target energy consumption ,0 in a future time frame ℎ can be approximated by summing up the energy consumed over this time frame ,0 = ∑︀∈[0,0+ ℎ] () · ∆ , where () is the power consumption at time , and ∆ is the time interval between two samples.
In this study, we set ℎ equal to 10 minutes. For a given forecasting task , a regression model (· ) is trained together with one of the auxiliary tasks to estimate consumption ,. In this study, neural networks, a shared feature extractor, with multiple heads, each corresponding to one task, were trained under diferent settings and evaluated for their performance after 200 training epochs. We explore diferent multi-task curriculum learning settings and auxiliary tasks for forecasting energy consumption. The MCL methods were compared to the traditional approach
For a given regression task (forecasting energy consumption for one of the subsystems), a set of auxiliary tasks was generated to assist the learning progress. We explore the use of five types of consumption characteristics as targets for creating the auxiliary tasks: i) 1: classifying whether the consumption in the next time frame exceeds the global mean for that subsystem ; ii) 2: classifying whether the consumption will increase in the next time frame, compared with the current consumption; iii) 3: classifying whether the consumption at the end of the next time frame exceeds the starting point; iv) 4: predicting the consumption diference between the start and the end of the next time frame; v) 5 predicting the diference between the peak consumption and the lowest consumption in the next time frame. The first three auxiliary tasks are classification task, the other two tasks are regression task. Learning to predict these key consumption characteristics in these auxiliary tasks , along with the primary tasks , under MCL, are evaluated for their usefulness.
The regression model evaluated for MCL in this study builds on a multi-layer perceptron. The model is comprised of a shared feature extractor and two heads, one head carries out the main task , and the other corresponds to one of the five auxiliary tasks . The network architecture is illustrated in Figure 1. For auxiliary tasks that are classification tasks, a sigmoid function was applied to the output of the corresponding head.
The two curriculum learning strategies evaluated in this work are sequential learning (SeqL) and progressive continual learning (PCL). The overall optimisation loss ℒ can be defined as: where ℒ denotes the loss for the primary tasks, while ℒ denotes the loss for the auxiliary task . The SeqL employed imposes a fixed ordering of the tasks, e.g. learning the auxiliary task ifrst, before a predetermined epoch, and the primary task afterwards: ℒ = ℒ + (1 − )ℒ = {︃ 0 if <
1 if ≥ where is the current training epochs, and is the number of epochs predetermined to switch to another task.
The PCL employs a weighting mechanism, a function of training epochs, to govern the learning process and gradually increases the weights on the loss corresponding to the primary task: 2 = 1 + (− 10/ ) where is a coeficient governing the change rate (see Figure 2 for an illustration), is the current training epochs, and is the total amount of training epochs. The two curriculum learning strategies were compared with MTL without any special curriculum learning and learning only on the primary task (1) (2) (3)
The two evaluation criteria in this study are (i) the test loss (Mean Absolute Error, MAE) after
training converged, i.e., epochs, and (2) whether the proposed learning strategy achieves a
faster convergence time, i.e., the epoch at which the test loss has reached a saturation point (no
further significant decrease in the loss afterwards). In each case, diferent variants of MCL are
compared against a learning process without any multi-task curriculum learning. The saturation
point is detected using a knee point detection algorithm [
The energy consumption dataset was collected from several electric trucks operating in different countries for a couple of months, including sensor readings of mileage, speed, ambient temperature, and energy consumed for auxiliary subsystems, etc., from sessions of driving. The four subsystems we forecast energy consumption for are the air compressor 1, the air conditioner 2, the cabin heater 3, and the heater of the energy storage system 4.
For the experiment conducted in this paper, the neural networks were implemented via
Pytorch library [
Table 1 and Table 2 show the training and testing losses after 200 epochs of training of the neural networks using multi-task learning with any curriculum learning (MTL), sequential learning (SeqL), progressive continual learning with an of 0.1 (PCL-lin), and an of 0.3 (PCL-exp). The baseline performance, single task learning (STL), is produced with learning only on the primary task for each subsystem, shown in the parenthesis. It is shown in both tables that the lowest averaged MSE is achieved using PCL-exp. As a sanity check, Table 1 demonstrated that the training losses, after 200 epochs of training, of most MCL methods did converge to a level comparable to STL. For the testing losses shown in Table 2, applying PCL-exp on task sets {1, 11} and {4, 41} achieved lowest averaged MSE for forecasting energy consumption of subsystem 1 and 4 (i.e., the first auxiliary task appears to be the most helpful auxiliary task for subsystem 1 and 4); similarly, applying PCL-exp on task sets {2, 23} and {3, 33} achieved lowest averaged MSE for forecasting energy consumption of subsystem 2 and 3.
Figure 3 illustrates the diferences between several multi-task curriculum learning strategies,
focusing on the convergence speed. Specifically, we identify a reference point (epoch) beyond
which the gain from further training is limited. This reference point is computed using a knee
point detection method (algorithm [
Table 3 shows a comparison between MCL methods on the convergence time to the reference point (computed based on STL mean testing losses over the four folds). It is observed that: i) MTL outperforms STL in all four primary tasks, and converged to the reference point faster than other approaches in three out of four primary tasks; ii) the performance of PCL-lin achieved converged fast for two of the tasks; iii) PCL-exp achieved better performance compared to PCL-lin, with overall short convergence time. The result corresponding to SeqL is particularly interesting. Although a of 100 epochs is adopted for SeqL (i.e. trained on one of the auxiliary tasks for the first 100 epochs before learning the primary task), the testing loss converges to the reference point within 10 epochs in the majority of the cases. From an empirical perspective, the proposed auxiliary tasks assisted the learning (of the models) for the primary task, resulting Task 1
Task 2
Task 3
Task 4 STL MTL PCL-Lin PCL-exp
STL MTL PCL-Lin
PCL-exp in a faster convergence time to the reference point.
In this work-in-progress paper, several multi-task curriculum learning strategies were evaluated for forecasting the energy consumption of auxiliary subsystems in heavy-duty electric vehicles. The preliminary results show that progressive continual learning has achieved the best performance (lowest averaged MSE) compared to multi-task learning with any CL, Sequential CL, and the traditional approach (STL). Moreover, the proposed auxiliary tasks, based on key consumption characteristics, for CL have shown to be useful for solving all four primary tasks, both in terms of regression error as well as convergence speed.
Future works include: (i) developing methods to rank/order the auxiliary tasks based on relevancy and select the top number of tasks for CL; (ii) proposing adaptive methods for governing the learning process, e.g. based on weighting the losses of auxiliary tasks using learning dynamics; (iii) enabling CL across primary tasks, based on task relevancy.
The work was carried out with support from the Knowledge Foundation and Vinnova (Sweden’s innovation agency) through the Vehicle Strategic Research and Innovation Programme FFI.