Skip to content

Latest commit

Β 

History

15 Commits

Folders and files

NameName
Last commit message
Last commit date
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Awesome Efficient HAR Awesome

This repository is under active development.

A curated list of resources for efficient, edge, and wearable Human Activity Recognition (HAR).

Focus areas: wearable and smartphone sensor data (IMU, multimodal), compact models for time-series HAR, and on-device deployment with reliable benchmarking.

Legend: [πŸ“„ paper] [πŸ’» code] [πŸ“¦ dataset] [⚑ efficient] [πŸ“± on-device] [πŸ§ͺ benchmark] [🧠 distillation] [🧩 attention] [πŸ”§ quantization] [πŸͺ“ pruning] [🧰 tooling]

This README is generated from data/entries.yaml via scripts/generate_readme.py.

Contents

  1. Datasets (wearable/IMU/multimodal)
  2. Lightweight architectures for time-series
  3. Attention modules for sensor/time-series
  4. Knowledge distillation for HAR/time-series
  5. Quantization/pruning/compression
  6. On-device benchmarking and tooling
  7. Reproducible benchmarks/leaderboards
  8. Deployment patterns (windowing/streaming/personalization)
  9. Efficiency reporting checklist for HAR papers
  10. Edge HAR starter packs

Datasets (wearable/IMU/multimodal)

  • KU-HAR (2020) - Open HAR dataset for heterogeneous smartphone sensing with 18 daily activities and standardized splits. [πŸ“¦ dataset] [πŸ§ͺ benchmark]
  • MotionSense (2019) - Motion data from iPhone sensors for activity and user context tasks. [πŸ“¦ dataset] [πŸ’» code]
  • SHL Dataset (Sussex-Huawei Locomotion) (2018) - Large-scale smartphone and wearable locomotion benchmark with official Sussex challenge resources. [πŸ“¦ dataset] [πŸ§ͺ benchmark]
  • ExtraSensory (2017) - Multimodal in-the-wild behavior dataset with mobile and wearable sensors, mirrored via Kaggle and paper resources. [πŸ“¦ dataset]
  • SisFall (2017) - Fall and movement dataset with elderly participants, released with the SisFall benchmark paper. [πŸ“¦ dataset]
  • UniMiB SHAR (2017) - Smartphone accelerometer ADL and fall dataset introduced with the UniMiB SHAR benchmark paper. [πŸ“¦ dataset]
  • MobiAct (2016) - Smartphone inertial dataset for daily activities and falls from the MobiAct benchmark collection. [πŸ“¦ dataset]
  • RealWorld HAR (2016) - Smartphone and smartwatch placement diversity in real-world conditions. [πŸ“¦ dataset]
  • Heterogeneity HAR (HHAR) (2015) - Device and user heterogeneity benchmark across phones and watches. [πŸ“¦ dataset] [πŸ§ͺ benchmark]
  • mHealth (2014) - Body-worn sensor dataset for activity monitoring. [πŸ“¦ dataset]
  • DSADS (Daily and Sports Activities) (2013) - Body-worn motion sensors across daily and sport actions. [πŸ“¦ dataset]
  • OPPORTUNITY Activity Recognition (2012) - Multimodal ambient and wearable sensor dataset. [πŸ“¦ dataset] [πŸ§ͺ benchmark]
  • PAMAP2 Physical Activity Monitoring (2012) - Multi-sensor IMU and heart-rate recordings. [πŸ“¦ dataset] [πŸ§ͺ benchmark]
  • UCI HAR Dataset (2012) - Smartphone inertial HAR benchmark with subject-wise protocol. [πŸ“¦ dataset] [πŸ§ͺ benchmark]
  • USC-HAD (2012) - Wearable sensor activities with multiple subjects and repetitions. [πŸ“¦ dataset]
  • WISDM (2011) - Phone/watch accelerometer HAR data with classic activity labels. [πŸ“¦ dataset]

Lightweight architectures for time-series

  • Hydra (2022) - Competing convolutional kernels for fast and accurate time-series classification in low-latency settings. [πŸ“„ paper] [⚑ efficient] [πŸ§ͺ benchmark]
  • MultiROCKET (2021) - Extends ROCKET with multiple pooling operators and transformations for faster, accurate time-series classification. [πŸ“„ paper] [⚑ efficient] [πŸ§ͺ benchmark] [πŸ’» code]
  • Benchmarking TinyML Systems: Challenges and Direction (2020) - Surveys TinyML benchmarking challenges, including hardware variability, metrics, and reproducibility constraints for edge deployments. [πŸ“„ paper] [⚑ efficient] [πŸ“± on-device] [πŸ§ͺ benchmark]
  • MiniROCKET (2020) - Faster deterministic ROCKET variant with strong speed-accuracy tradeoff. [πŸ“„ paper] [⚑ efficient] [πŸ§ͺ benchmark]
  • EfficientNet (2019) - Compound scaling principles adaptable to time-series CNNs. [πŸ“„ paper] [⚑ efficient]
  • InceptionTime (2019) - Competitive time-series architecture often used as HAR baseline. [πŸ“„ paper] [πŸ§ͺ benchmark]
  • MobileNetV3 (2019) - Hardware-aware search and lightweight attention for edge latency. [πŸ“„ paper] [⚑ efficient] [πŸ“± on-device]
  • ROCKET (2019) - Fast random convolution features for time-series classification. [πŸ“„ paper] [⚑ efficient] [πŸ§ͺ benchmark]
  • MobileNetV2 (2018) - Inverted residuals and linear bottlenecks for compact sensor models. [πŸ“„ paper] [⚑ efficient] [πŸ“± on-device]
  • ShuffleNet V2 (2018) - Practical efficiency guidelines for real hardware throughput. [πŸ“„ paper] [⚑ efficient] [πŸ“± on-device]
  • TCN Sequence Modeling (2018) - Strong and efficient sequence baseline for sensor windows. [πŸ“„ paper] [⚑ efficient]
  • DeepSense (2017) - Unified deep architecture for mobile sensing signals and tasks. [πŸ“„ paper] [πŸ“± on-device]
  • MobileNets (2017) - Depthwise separable convolutions widely reused for mobile HAR backbones. [πŸ“„ paper] [⚑ efficient] [πŸ“± on-device]
  • ShuffleNet (2017) - Pointwise group convolution and channel shuffle for low FLOPs. [πŸ“„ paper] [⚑ efficient]
  • DeepConvLSTM for HAR (2016) - Early strong wearable HAR model combining temporal conv and recurrence. [πŸ“„ paper] [πŸ§ͺ benchmark]
  • SqueezeNet (2016) - Fire modules for very small parameter footprint. [πŸ“„ paper] [⚑ efficient]

Attention modules for sensor/time-series

  • PatchTST (2022) - Patching strategy for efficient transformer-style time-series representation. [πŸ“„ paper] [🧩 attention]
  • Informer (2020) - ProbSparse attention for long time-series encoding. [πŸ“„ paper] [🧩 attention] [⚑ efficient]
  • Linformer (2020) - Linear-complexity attention approximation for longer windows. [πŸ“„ paper] [🧩 attention] [⚑ efficient]
  • Performer (2020) - FAVOR+ linear attention with kernel feature maps. [πŸ“„ paper] [🧩 attention] [⚑ efficient]
  • ECA-Net (2019) - Efficient channel attention without heavy dimensionality reduction. [πŸ“„ paper] [🧩 attention] [⚑ efficient]
  • CBAM (2018) - Lightweight channel and spatial attention plug-in module. [πŸ“„ paper] [🧩 attention]
  • Attention Is All You Need (2017) - Transformer self-attention foundation for sequence modeling. [πŸ“„ paper] [🧩 attention]
  • Squeeze-and-Excitation Networks (2017) - Channel reweighting block often adapted to 1D sensor CNNs. [πŸ“„ paper] [🧩 attention] [⚑ efficient]

Knowledge distillation for HAR/time-series

  • DeiT Distillation through Attention (2020) - Distillation-token strategy transferable to sensor transformers. [πŸ“„ paper] [🧠 distillation] [🧩 attention]
  • KD-Lib (2020) - Open-source PyTorch distillation framework for rapid experiments. [πŸ’» code] [🧠 distillation] [🧰 tooling]
  • MobileBERT (2020) - Distilled and compressed transformer optimized for mobile. [πŸ“„ paper] [🧠 distillation] [πŸ“± on-device]
  • DistilBERT (2019) - Practical distillation recipe for lighter transformer deployment. [πŸ“„ paper] [🧠 distillation] [⚑ efficient]
  • TinyBERT (2019) - Multi-stage transformer distillation with layer-wise constraints. [πŸ“„ paper] [🧠 distillation] [⚑ efficient]
  • Born-Again Neural Networks (2018) - Self-distillation via sequential teacher-student training. [πŸ“„ paper] [🧠 distillation]
  • Paying More Attention to Attention (2016) - Attention transfer losses for compact students. [πŸ“„ paper] [🧠 distillation] [🧩 attention]
  • Distilling the Knowledge in a Neural Network (2015) - Foundational teacher-student distillation objective. [πŸ“„ paper] [🧠 distillation]
  • FitNets (2014) - Hint-based intermediate feature matching. [πŸ“„ paper] [🧠 distillation]

Quantization/pruning/compression

  • AIMET (AI Model Efficiency Toolkit) (2021) - Compression toolkit with quantization and pruning recipes. [πŸ’» code] [🧰 tooling] [πŸ”§ quantization] [πŸͺ“ pruning]
  • Movement Pruning (2020) - Structured sparsification for transfer and compression. [πŸ“„ paper] [πŸͺ“ pruning]
  • ONNX Runtime Quantization (2020) - Dynamic and static quantization for portable runtime stacks. [🧰 tooling] [πŸ”§ quantization]
  • PyTorch Quantization (2019) - Eager, FX, and PT2 quantization flows for production models. [🧰 tooling] [πŸ”§ quantization]
  • TensorFlow Lite Post-Training Integer Quantization (2019) - Full-int8 export path for edge inference. [🧰 tooling] [πŸ”§ quantization] [πŸ“± on-device]
  • TensorFlow Model Optimization Toolkit (2019) - Pruning and quantization-aware training utilities. [🧰 tooling] [πŸ”§ quantization] [πŸͺ“ pruning]
  • The Lottery Ticket Hypothesis (2018) - Sparse subnetworks for compact retraining. [πŸ“„ paper] [πŸͺ“ pruning]
  • Deep Compression (2015) - Classical prune-quantize-Huffman compression pipeline. [πŸ“„ paper] [πŸͺ“ pruning] [πŸ”§ quantization]
  • TensorRT (2014) - Deployment-oriented precision and kernel optimization. [🧰 tooling] [πŸ”§ quantization] [πŸ“± on-device]

On-device benchmarking and tooling

  • LiteRT for Microcontrollers (2024) - Official LiteRT microcontroller runtime guide for deploying tiny models on embedded targets. [🧰 tooling] [πŸ“± on-device]
  • PyTorch ExecuTorch (2023) - On-device inference runtime and tooling for edge deployment. [🧰 tooling] [πŸ“± on-device]
  • Edge Impulse Deployment (2021) - Deployment guides for exporting and running edge ML models across embedded and mobile runtimes. [🧰 tooling] [πŸ“± on-device]
  • MLPerf Tiny (2021) - Standardized tiny and edge benchmarking suite including HAR-relevant tasks. [πŸ§ͺ benchmark] [πŸ“± on-device]
  • TensorFlow Lite Model Analyzer (2021) - Inspect model memory and op-level deployment constraints. [🧰 tooling] [πŸ“± on-device]
  • TensorFlow Lite Benchmark Tool (2019) - CLI profiling for latency and memory on target hardware. [🧰 tooling] [πŸ“± on-device] [πŸ§ͺ benchmark]
  • TensorFlow Lite for Microcontrollers (tflite-micro) (2019) - Reference embedded inference runtime and kernels for tiny on-device ML deployments. [🧰 tooling] [πŸ“± on-device] [πŸ’» code]
  • Apache TVM (2018) - End-to-end model compilation stack with microTVM support for constrained edge targets. [🧰 tooling] [πŸ“± on-device]
  • CMSIS-NN (2018) - Optimized neural network kernels for Arm Cortex-M CPUs to accelerate edge inference. [🧰 tooling] [πŸ“± on-device] [πŸ’» code] [⚑ efficient]
  • Perfetto (2018) - System-level tracing for CPU scheduling and thermal effects. [🧰 tooling] [πŸ“± on-device] [πŸ§ͺ benchmark]
  • Android Battery Historian (2015) - Power usage inspection to support energy proxy reporting. [🧰 tooling] [πŸ“± on-device]
  • Android ADB (2008) - Essential deployment and repeatable benchmark automation entrypoint. [🧰 tooling] [πŸ“± on-device]

Reproducible benchmarks/leaderboards

Deployment patterns (windowing/streaming/personalization)

Windowing policy: report window length, stride, overlap, and label-assignment rule; avoid hidden overlap leakage between train and test. Streaming inference: prefer causal feature extraction and stateful models for low-latency online HAR. Subject split discipline: always separate users across train/val/test when claiming generalization. Personalization track: report both cold-start (no user fine-tune) and adaptation (few-shot or calibration) metrics. Fallback behavior: define unknown and transition states plus confidence thresholds for real-world deployment. Battery-accuracy tradeoff: jointly report duty cycle, sampling rate, and latency.

Efficiency reporting checklist for HAR papers

Report these metrics together: parameter count, MACs/FLOPs for the stated input window, end-to-end latency on target hardware, peak memory (RAM and model size), and an energy proxy (power draw, battery drain rate, or joules per inference).

Common pitfalls to document and avoid: window leakage from overlap across data splits, subject split mistakes from random splitting instead of subject-wise splitting, and personalization evaluation without a clear adaptation budget or protocol.

Edge HAR starter packs

MIT license. See https://github.com/sumeyye-agac/awesome-efficient-har/blob/main/LICENSE.

About

An awesome list of papers, datasets, and tools for efficient sensor-based Human Activity Recognition (HAR), with a focus on lightweight and edge-friendly deep learning.

Topics

Resources

Code of conduct

Contributing

Stars

2 stars

Watchers

2 watching

Forks

Contributors

Languages