We autonomously directed a small quadcopter package delivery Uncrewed Aerial Vehicle (UAV) or “drone” to take off, fly a specified route, and land for a total of 209 flights while varying a set of operational parameters. The vehicle was equipped with onboard sensors, including GPS, IMU, voltage and current sensors, and an ultrasonic anemometer, to collect high-resolution data on the inertial states, wind speed, and power consumption. Operational parameters, such as commanded ground speed, payload, and cruise altitude, were varied for each flight. This large data set has a total flight time of 10 hours and 45 minutes and was collected from April to October of 2019 covering a total distance of approximately 65 kilometers. The data collected were validated by comparing flights with similar operational parameters. We believe these data will be of great interest to the research and industrial communities, who can use the data to improve UAV designs, safety, and energy efficiency, as well as advance the physical understanding of in-flight operations for package delivery drones.
|Measurement(s)||atmospheric wind speed • atmospheric wind direction • battery current • battery voltage • position|
|Technology Type(s)||anemometer • Current / Voltage measurement sensor • GPS navigation system • inertial measurement unit|
|Factor Type(s)||programmed speed during cruise • programmed altitude during cruise • payload mass|
Machine-accessible metadata file describing the reported data: https://doi.org/10.6084/m9.figshare.13814225
Background & Summary
The last decade has seen considerable development towards using Uncrewed Aerial Vehicles (UAVs) or “drones”1 to improve the efficiency, speed, and access of last-mile package delivery. Apart from the ability to carry packages, the majority of these UAVs also have the capability to takeoff and land vertically to reduce their operational footprint and increase their delivery precision. A common solution is to use a multirotor system that generates lift by pushing the air down by using a set of brushless direct current (BLDC) motors that spin counter-rotating propellers. UAVs that produce lift purely using rotors, either during the entirety of the mission or for a part of it, need considerably large amounts of energy to lift a package compared to a conventional winged aircraft where lift is produced by air flowing over a fixed wing. This larger energy requirement has a considerable impact on the range and endurance of these multi-rotor UAVs. The energy required is a function of the environmental factors like the prevailing wind conditions, temperature, humidity, etc; UAV design parameters such as the powerplant specifications, and the shape and build of the UAV; and mission-specific parameters such as the nominal ground speed, operation altitude, and delivery package specifications. Developing energy models that can accurately predict the energy use of these UAVs using these factors as inputs is critical in improving UAV safety and efficiency2,3. Current research uses theoretical models and physical parameters to estimate energy consumption3,4,5,6,7, while other methods use data-driven approaches to regressed parameters and estimate models8,9,10.
However, a recent survey2 on the state-of-the-art of energy modelling for multirotor UAVs compared various models and found that the even with the common sets of parameters, the energy consumption rate (J/m) varies by a factor of 3 to 5 across the models. The authors advocate for comparing results to empirical data from comprehensive drone delivery field tests to improve the energy prediction accuracy. Most studies only conduct a few flights and the raw flight data is not released into the public domain to aid comparisons. Given the strict regulatory requirements and significant effort required to conduct UAV field tests, no standard comprehensive data set previously existed in the public domain to the best of our knowledge.
In this work, we performed experiments in order to empirically measure the energy use of a Multirotor UAV with autonomous capabilities while carrying a range of payloads through various campaigns. We autonomously directed a DJI Matrice 100 (M100)11 drone to take off, carry a range of payload weights through a triangular flight pattern, and land. We collected high-resolution data on the inertial speeds, altitude, wind and energy for each flight. Between flights, we varied specified parameters, such as commanded ground speed, payload weight, and cruise altitude. We simultaneously collected data from the broad array of on-board sensors throughout 209 flights.
We developed an experimental protocol to ensure the reliability of the data collected. The flights followed a pre-established route with varying altitude (25 m, 50 m, 75 m and 100 m), speed (4 m/s, 6 m/s, 8 m/s, 10 m/s and 12 m/s) and payload mass (no payload, 250 g and 500 g). Each combination was repeated at least three times, totaling 195 flights. In addition, 14 recordings were performed with the drone in hover and idle modes, for a total of 209 flights. Finally, the data provided by each sensor were synchronized at a frequency of approximately 5 Hz. Information on the operational setup, such as payload mass, altitude and speed during cruise, date and time the flight started, and the predefined route, was manually logged and attached to the data set.
The flights were performed in the township of Penn Hills, PA at a site that is approximately 16 kilometers away from Pittsburgh, PA, USA. Proper certifications from federal and local authorities were obtained prior to testing. Checklists were created to ensure that flights would occur safely, consistently, and efficiently. Finally, the information collected on each flight was plotted and assessed in order to validate the consistency of the data acquired.
This section details the acquisition setup used in these experiments and the sensor suite mounted on the airframe. It also discusses the experimental protocol for the flight tests.
The acquisition setup discusses the hardware and software setup used to collect the data. A complete schematic is shown in Fig. 1.
Multirotors are characterized by their use of multiple rotors to produce lift. The majority of the commercially available multirotor systems use 3 to 8 rotors to achieve flight. We used the DJI Matrice 100 quadrotor platform to represent multirotor UAVs, seen in Fig. 2. The Matrice 100 is a fully programmable and customizable UAS with a maximum cruise speed of 17 m/s (in GPS mode). The airframe was equipped with the DJI 3510 motors (350 Kv), DJI E SERIES 620D ESCs, and we used the DJI 1345s for our rotor blades. The system has an on-board autopilot that provides autonomous capabilities. Its standard battery has a capacity of 4500 mAh that gives it a flight time of 22 minutes without any additional payload.
The mass of the airframe is 1831 g, the battery 600 g, the anemometer and pole 136 g, and the onboard computer with small sensors and wiring 1113 g, totaling 3680 g. Therefore, the total takeoff masses were 3680 g (no payload), 3930 g (with the 250-g payload) and 4180 g (with the 500-g payload). The payloads of different masses were all of dimensions 22 × 13.8 × 4.4 cm and were attached to the bottom of the airframe with velcro straps. The mass of the drone includes the mass of the Velcro straps.
Wind measurement sensor
The experiments used a FT Technologies FT205 UAV-mountable ultrasonic anemometer for wind measurements12 which is seen in Fig. 3a. The sensor is accurate up to ±0.1m/s, has a refresh rate of 10 Hz, and is factory calibrated. We used the device’s built-in filtering process to obtain reliable data. UART communication was used to record data from the sensor.
State measurement sensor
We recorded the state of the system (position, velocity, and orientation) using the 3DM-GX5–45 GNSS/INS13 which is seen in Fig. 3b. These sensors use a built-in Kalman filtering system to fuse the GPS and IMU data. The sensor was used at an output rate of 10 Hz. The sensor records data in N(North)-E(East)-D(Down) frame fixed at the takeoff point. The sensor is calibrated as per manufacturer instructions.
Current and voltage measurement sensor
The current and voltage supplied to the drone were measured using a Mauch Electronics PL-200 sensor14. This sensor is based on the Allegra ACS758-200U hall current sensor, which can record currents up to 200 A and voltages up to 33 V. The sensor board is only installed into the “positive” (red) main wire from the battery; the “negative” (black) wire stays untouched, which reduces the risk the sensor board might short circuit. A Hall sensor was chosen for its better accuracy when compared with a traditional shunt sensor. The sensor is calibrated as per manufacturer instructions. Analogue readings from the sensor are converted into a digital format using a 8 channel 17 bit analogue-to-digital converter (ADC). The ADC is based on the MCP3424 from Microchip Technologies Inc and is a delta-sigma A/D converter with low noise differential inputs.
Syncing and recording
Data syncing and recording was handled using the Robot Operating System (ROS) running on a low-power Raspberry Pi Zero W. Data was recorded on the Raspberry Pi’s microSD card. The data provided by each sensor were synchronized to a frequency of approximately 5 Hz using the ApproximateTime15 message filter policy of ROS. The synchronized output approximately follows the current frequency of the sensors. The frequency variability in the synchronized output is thus a by-product of this decision not to interpolate but keep the data intact as received directly from the sensor. All the data has associated timestamps which enables a user to interpolate it at whichever frequency the user desires. A hard synchronization at a particular frequency would have required us to apply an interpolation algorithm, the choice of which we felt should rest with the end-user.
This section discusses the flight routines for data collection. A flight plan was created to ensure safety and reliability of the data collected. Procedures for pre-, during, and post-flight were followed as described below.
Each test day is selected subject to weather conditions. Extremely harsh weather is avoided, such as precipitation and high wind speeds, but care is taken that the data set is not biased towards good weather. The test location (40:465690N; −79:788281W) is an open field, outside of the urban area.
The control variables are the programmed speed during cruise (4 m/s, 6 m/s, 8 m/s, 10 m/s, and 12 m/s), programmed altitude during cruise (25 m, 50 m, 75 m, and 100 m), and Payload mass (0, 250 g, 500 g). Flights with all possible combinations of the control variables were carried out to obtain a comprehensive data set.
Before each flight we ensure that the vehicle is airworthy and that the airframe and control system are calibrated to run the upcoming experiment. We ensure that the flight is configured correctly according to the control variables on the day’s flight plan. We then go through the pre-flight checklist (see Supplementary Information).
Once the preflight is complete, the Remote Pilot-In-Command (PIC) issues a pre-flight notice to the members and uses a custom Graphical User Interface (GUI) to launch the health monitoring scripts. The program first completes a check of all the onboard sensors and ensures that all subroutines are fully operational. Once the system gets a go-ahead from the health monitoring scripts it then starts the data recording. After a verbal “Go for takeoff” notice, the PIC launches the flight control scripts that use the DJI SDK to autonomously control the GPS waypoint guidance. The UAV arms itself and then takes off vertically to reach the commanded cruise altitude at a constant upward speed of approximately 2.5 m/s. Once at the altitude, the UAV turns the heading to the first waypoint and accelerates to reach the commanded ground speed. On reaching the first waypoint, the UAV stops and turns to go to the next waypoint. This continues as the UAV tracks a triangular wind-neutral path while recording the data. The triangular path and a snippet of the recorded data is shown in Fig. 4. When it reaches the launch point again, the UAV stops and descends at approximately 1.5 m/s. Once safely on the ground, the UAV disarms itself and the data recording stops. The PIC calls out flight completed. At all points in the flight, the PIC maintains visual line of sight with the UAV with access to the manual control override to ensure safety of the team and the UAV.
At the conclusion of the flight, a GUI is used to download the raw ROSBag files and then use the post-processing scripts to synchronize the data from various sensors and convert it to a comma-separated values (CSV) file for storage. The raw files are also stored. Concurrently entries are also completed on the flight plan. The post-flight checklist is followed (see Supplementary Information) and the UAV is then configured for the next flight.
Regulation and Safety
All data collection is conducted within the rules and regulations under part 107 for UAS operations. This includes maintaining visual line-of-sight with the aircraft, keeping the aircraft weight under 55 pounds (24.95 kg), flying only in daylight, not flying above 400 feet above ground level, following a preflight inspection, and flying withing permissible airspace16. It is also ensured that the take-off weight and vehicle commands stay within the airframe safety specification. All FAA and local UAV regulations are observed.
Care is taken in the usage of LiPo DJI TB48D batteries. They are charged using chargers which monitor the voltage and temperature. Batteries are transported in a metal container to protect them from puncture and to contain a fire in the case of combustion.
Additionally, safety glasses are worn when appropriate and a fire extinguisher was always made available for use.
All raw and processed data records listed in this section are available at (https://doi.org/10.1184/R1/12683453)17.The data recorded by each sensor are compiled in a .zip file that contains a folder for each flight with a file named raw.bag. A CSV file named parameters.csv provides a list with all flights and flight parameters. Finally, a file flights.zip contains a csv file for each flight with the information on duration, wind speed and direction, current and voltage of the system, aircraft position, orientation speed and acceleration. Table 1 provides a description on each variable.
The data collected were assessed to ensure the reliability of the data provided. The flights were grouped according to altitude, speed during cruise, and payload. Then, we assessed the parameters collected (positional parameters, wind speed, and power) by comparing flights that share the same setup (programmed altitude, programmed speed and payload mas). Figures 5, 6 and 7 show examples flights grouped by similar altitude, payload and speed. For instance, flights 18, 135, and 202 show altitude (Fig. 5a) and ground speed (Fig. 5b) during cruise that oscillate around the programmed parameters of 25 m and 4 m/s, respectively. Figure 6a shows the influence of wind that naturally varies the airspeed readings among flights. On the other hand, Fig. 6b shows that the power demand is kept consistent for all three flights. The variations in the yaw (Fig. 7a) at the beginning of the flight shows that the aircraft was initially facing a different direction before the take-off of flight 202. Once the take-off procedure starts the aircraft automatically rotates to face the preset direction, as followed by the other flights.
The behavior of the parameters assessed shows only minor variations among flights with similar setups. These minor variations were expected due to external factors and the inherent variability of the measuring processes. Nevertheless, in all assessments, the results showed a consistent pattern, with data varying within limits that respect the physical boundaries of the experiment.
In addition, we computed the total energy consumption of each flight by numerically integrating power (current * voltage) over time. Then, we compared the total energy consumption of flights with the same setup (programmed speed, programmed altitude, and payload mass). The mean relative energy amplitude across the flight groups was 4.3% with a standard deviation of 2.6%. Moreover, 95% of the groups had a relative energy amplitude of less than 10%, which reflects natural variations among the flights. The maximum energy amplitude was observed by flights 92, 129, and 252 (approximately 3.5 Wh), which represents a relative amplitude of 15.5% of the mean energy consumption within this group. An in-depth analysis shows that flight 129 (24.8 Wh) had a greater cruise duration, when compared to flights 92 and 252 (21.8 Wh and 21.3 Wh, respectively). However, the air speed experienced by flight 129 after 100 seconds (Fig. 10a) might have reduced the actual ground speed of the drone (Fig. 10b), increasing the total flight duration, and causing this discrepancy on the overall energy consumption.
A similar analysis with two other groups of flights that had relative energy amplitude greater than 10% did not indicate any substantial difference among the flight recorded.
We have also implemented a script to automatically process and assess the values measured during flight and compare them to the programmed values of altitude. 173 out of the 194 flights with cruise movement did not have any altitude readings during cruise beyond the manufacturer’s ±5 m tolerance range. Moreover, there was only one flight that had a mean altitude during cruise (107.1 m) beyond the programmed altitude and manufacturer’s range (105.0 m). However, as the flight pattern and energy consumption of this flight was consistent with the similar flights (relative energy amplitude of 3% within the group) we have decided to maintain its data in the data set.
Finally, the uncertainty inherent to each sensor used has been summarized on Table 2 according to the values provided by each manufacturer.
The data available can be used to model the energy consumption of a small quadcopter drone, empirically fitting the results found or validating theoretical models. These data can also be used to assess the impacts and correlations among the variables presented and/or the estimation of non-measured parameters, such as drag coefficients. These data should not be extrapolated to assess the energy consumption of different drone models or drones operating outside of the range of values tested.
The measurements from the onboard anemometer can be used to calculate the airspeed components (cross-wind and head-wind) and local wind conditions. The anemometer records the wind angle and magnitude with respect to the moving drone. We provide the original data from the anemometer. However, previous works that have used anemometers for onboard wind measurements18,19,20 have reported that while the wind angle measurements were found to be accurate for all flight conditions, the magnitude measurements show a bias that reports a higher wind magnitude than expected. We found that the effect is more pronounced at lower UAV speeds. Thus, future work is required to investigate and correct the magnitude bias in addition to correcting for the UAV motion. In Supplementary Information, we provide one method of magnitude bias and ego motion correction, although work in this area is ongoing.
The codebase used to fly the UAV autonomously, record and synchronize data, and interface between different sensors is available for public use under BSD license. The codebase can be accessed at https://bitbucket.org/castacks/workspace/projects/DOE.
Stolaroff, J. K. et al. Energy use and life cycle greenhouse gas emissions of drones for commercial package delivery. Nature communications 9, 409 (2018).
Zhang, J., Campbell, J. F., Sweeney II, D. C. & Hupman, A. C. Energy consumption models for delivery drones: A comparison and assessment. Transportation Research Part D: Transport and Environment, 90, 102668 (2021).
Liu, Z., Sengupta, R. & Kurzhanskiy, A. A power consumption model for multi-rotor small unmanned aircraft systems. In 2017 International Conference on Unmanned Aircraft Systems (ICUAS), 310–315 (IEEE, 2017).
Bezzo, N. et al. Online planning for energy-efficient and disturbance-aware uav operations. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 5027–5033 (2016).
Troudi, A., Addouche, S.-A., Dellagi, S. & El Mhamedi, A. Sizing of the drone delivery fleet considering energy autonomy. Sustainability 10, 3344, https://doi.org/10.3390/su10093344 (2018).
Abdilla, A., Richards, A. & Burrow, S. Power and endurance modelling of battery-powered rotorcraft. In 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 675–680 (2015).
Figliozzi, M. A. Lifecycle modeling and assessment of unmanned aerial vehicles (Drones) CO2e emissions. Transportation Research Part D: Transport and Environment 57, 251–261, https://doi.org/10.1016/j.trd.2017.09.011 (2017).
Abeywickrama, H. V., Jayawickrama, B. A., He, Y. & Dutkiewicz, E. Empirical power consumption model for uavs. In 2018 IEEE 88th Vehicular Technology Conference (VTC-Fall), 1–5 (IEEE, 2018).
Maekawa, K., Negoro, S., Taniguchi, I. & Tomiyama, H. Power measurement and modeling of quadcopters on horizontal flight. In 2017 Fifth International Symposium on Computing and Networking (CANDAR), 326–329 (IEEE, 2017).
Prasetia, A. S., Wai, R.-J., Wen, Y.-L. & Wang, Y.-K. Mission-based energy consumption prediction of multirotor uav. IEEE Access 7, 33055–33063 (2019).
DJI. Matrice 100 https://www.dji.com/matrice100/info (2020).
FTTechnologies. FT205 Light Weight: Acoustic Resonance Wind Sensor. Tech. Rep. https://fttechnologies.com/wp-content/uploads/2019/04/FT205-Datasheet.pdf.
Lord. 3DM -GX5-45 GNSS-Aided Inertial Navigation System (GNSS/INS). Tech. Rep. https://www.microstrain.com/inertial/3dmgx5-45 (2018).
MAUCH. 100A/200A Hall Sensor PM for Pixhawk/APM - PL-xxx Sensor Boards. Tech. Rep. https://www.mauch-electronic.com/pl-xxx-sensor-boards?__cf_chl_jschl_tk__=12212558db3b9add2522211c95fc5f937130b75b1597429562-0-AU3AqR6UC9s8esr64DqEcoZ8NX2y6Nicn1bRS6mx9dvODUwJaNtE0Rd7mXbTUCUmfa8NGeWvQGY9oeZO5J1CjqVCnEr0Sk6Fyey7DgfA3wWnl1OgQFqkYOcqg36S23.
ROS.org, O. S. R. F. ApproximateTime http://wiki.ros.org/message_filters/ApproximateTime (2010).
Federal Aviation Administration. 14 CFR Parts 21, 43, 61, 91, 101, 107, 119, 133, and 183 https://www.faa.gov/uas/media/RIN_2120-AJ60_Clean_Signed.pdf (2016).
Rodrigues, T. A. et al. Data collected with package delivery quadcopter drone. figshare https://doi.org/10.1184/R1/12683453 (2020).
Garibaldi Castillo, O. & Londner, E. Uav flight testing with an airborne sonic anemometer, imu and gps. In 28th AIAA Applied Aerodynamics Conference, 4572 (2010).
Bruschi, P., Piotto, M., Dell’Agnello, F., Ware, J. & Roy, N. Wind speed and direction detection by means of solid-state anemometers embedded on small quadcopters. Procedia Engineering 168, 802–805 (2016).
Thorpe, R. L., McCrink, M. & Gregory, J. W. Measurement of unsteady gusts in an urban wind field using a uav-based anemometer. In 2018 Applied Aerodynamics Conference, 4218 (2018).
Matrice 100 - airframe cad airframe cad. https://download.dji-innovations.com/downloads/dev/Matrice/M100_Airframe__CAD.STEP.
This work was supported by the U.S. Department of Energy’s Vehicle Technologies Office, Award Number DE-EE0008463. This material is also based upon work supported by the National Science Foundation Graduate Research Fellowship under Grant No. DGE1745016. The work was also supported in part by LORD MicroStrain Sensing Systems. The views and opinions expressed herein are solely those of the authors and do not necessarily state or reflect those of the United States Government, the Department of Energy, or any other organization.
The authors declare no competing interests.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Rodrigues, T.A., Patrikar, J., Choudhry, A. et al. In-flight positional and energy use data set of a DJI Matrice 100 quadcopter for small package delivery. Sci Data 8, 155 (2021). https://doi.org/10.1038/s41597-021-00930-x
International Journal of Aeronautical and Space Sciences (2022)